Data Engineer Advisor
The Woodlands, TX, US, 77380
Job Summary
Western Midstream is seeking a talented and experienced data engineer advisor to join our team in The Woodlands, TX. As a Data Engineer Advisor, you will be at the forefront of designing, developing, and deploying innovative data and analytical solutions. Your expertise will not only shape the landscape of our operations but also accelerate us towards our ambitious business goals.
Responsibilities:
- Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data.
- Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations.
- Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines.
- Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts.
- Employ programming languages like Java or Python for automation and API integration tasks.
- Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models.
- Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture.
- Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.
Requirements:
- Total IT experience of 12-15 years as a Data Engineer, Data Architect, or Software Developer
- In-depth knowledge of Azure cloud services, relational database design principles, data warehousing, performance tuning, and optimization.
- Exhibit strong analytic skills related to working with both structured and unstructured datasets.
- High level proficiency in T-SQL, ADF Pipelines, SSIS packages, Lift and Shift of existing On-premises processes, database design principles, data modeling and data warehousing.
- Have experience using/setting up Azure DevOps integration with cloud services and setting up CI/CD processes.
- Understanding of performance analysis and tuning activities to ensure optimal database performance.
- Must have excellent communication skills with the ability to interact with developers supporting requirements gathering.
Travel Requirements:
Travel will be required up to 5%.
Work Schedule:
This position will work 9 hours Monday through Thursday with 4 hours on Friday and will require Monday, Tuesday, and Thursday at The Woodlands office.
Nearest Major Market: Houston