Data Engineer

BOTG LLC
Chicago, IL
13 Feb 2025

Vacancy expired!

Title: Data Engineer (Hybrid)

Location: Chicago, IL

Duration: Direct Hire

Direct Client

What you'll do:As a Data Engineer, you'll support the Centralized Data Science and Analytics (CDSA) team by managing, optimizing, overseeing and facilitating data retrieval, storage and distribution. Ultimately, your work will allow CDSA to provide meaningful analytics to business units seeking to make data-driven decisions. Specifically, your responsibilities will include:· Participating in technical solution design with a focus on utilizing Azure.· Leveraging cloud architectural knowledge to play a vital role in the design of development, staging, QA, and production implementation of infrastructure resources running in 24×7 environments.· Facilitating delivery of cloud strategies in alignment with business objectives and with a focus on cloud migrations.· Aligning data architecture with business and regulatory requirements for efficient and effective solution delivery.· Leading in the creation of data pipelines (cloud, on-premises and hybrid) used by data scientists, data-centric applications, and other data consumers.· Developing, constructing, testing, maintaining and enhancing technical and data architectures.· Identifying potential improvements to existing solutions' data reliability, efficiency, and quality.· Participating in the deployment of sophisticated analytics programs, machine learning, statistical methods and predictive and prescriptive modeling.· Delivering consumable and relevant updates regarding data engineering efforts to stakeholders and management.· Acting as key stakeholder for validation of new cloud or SaaS.

What we’re looking for:· Experience building and optimizing "big data" data pipelines, architectures and data sets· Working knowledge of message queuing, stream processing and highly scalable "big data" data stores· Advanced working SQL knowledge and experience working with cloud and relational databases· Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement· Experience building processes supporting data transformation, data structures, metadata, dependency and workload management· A successful history of manipulating, processing and extracting value from large, disconnected datasets· Experience using the following software/tools:Ø Relational SQL and NoSQL databases, including PostgresØ Data pipeline and workflow management toolsØ Azure cloud servicesØ Object-oriented/object function scripting languages: Python, PySpark Java, C, R/RStudio/RSparkØ CI/CD systems· Strong understanding across cloud and infrastructure components (server, storage, network, data, and applications) and ability to deliver end to end cloud infrastructure, architectures, and designs· Knowledge and implementation of enterprise scale cloud security platforms and tooling· Experience with enterprise applications, solutions, and data center infrastructures· Bachelor's degree in computer science or similar field; master's degree a plus· Exceptional product, project and client management skills· Azure, AWS or any other cloud/data engineering certifications preferred
  • ID: #49182384
  • State: Illinois Chicago 60606 Chicago USA
  • City: Chicago
  • Salary: $95,000 - $130,000
  • Job type: Permanent
  • Showed: 2023-02-13
  • Deadline: 2023-04-11
  • Category: Et cetera