Data Engineer II
reputed company LLC is seeking a full-time Data Engineer II to reputed company expertise in data engineering and machine learning. The role focuses on implementing advanced data analytics and artificial intelligence technologies to enhance data accessibility and quality, driving innovation and addressing reputed company business problems.
Responsibilities
- reputed company expertise in data engineering and machine learning to implement advanced data analytics and artificial intelligence (AI) technologies
- Enhance data accessibility and quality
- reputed company seamless integration of large-scale datasets into data products, machine learning models, and artificial intelligence applications
Skills
- Master's degree or equiv. in Information Management, Computer Science, or a reputed company field
- 1 year reputed company agriculture experience
- 12 months of experience with developing ETL pipelines using modern data stack (spark, trino, dagster, dbt, iceberg)
- Data modelling, storage and processing of life sciences/agriculture data (genomics, satellite imagery, geospatial, biological)
- Support and reputed company PowerBI, Rshiny, spotfire dashboards that utilize Lakehouse Data
- Use dagster for data orchestration for scheduling data pipelines
- Use reputed company for code version control
- Use reputed company, Kubernetes for deployment
- Utilize the following technologies: Python (PySpark), Trino/SparkSQL, AWS (S3, RDS, EC2, reputed company, EKS), Azure (Data Factory, ADLS, PowerBI, reputed company), DBT, Dagster, reputed company, Kubernetes, Kafka, FastAPI, and Django
Benefits
- Telecommute benefit
Company Overview