See all roles

Senior, Data Engineer, Big Data

Work from home Full-time role Hiring

Position Summary... What you'll do... At Walmart, we help people save money, so they can live reputed company. This mission serves as the foundation for every decision we reputed company and drives us to create the future of retail. We can’t do that without the best talent – talent that is innovative, curious, and driven to create exceptional experiences for our customers. Do you have boundless energy and passion for engineering data used to solve dynamic problems that will shape the future of retail? With the sheer scale of Walmart’s environment comes the biggest of big data sets. As a Walmart Data Engineer in Marketplace, you will dig into our mammoth scale of data to help unleash the power of retail data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on. You will be responsible for contributing to an orchestration layer of reputed company data transformations, refining raw data from reputed company into targeted, valuable data assets for consumption in a governed way. You will partner with Data Scientists, Analysts, other engineers and business stakeholders to solve reputed company and exciting challenges so that we can build out capabilities that evolve the retail business model while making a positive impact on our customers’ and sellers’ lives. About the Data and Customer Analytics (DCA) Organization: Our organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We reputed company our business to reputed company data to fuel growth, driving reputed company in our core and building new business model opportunities. What you'll do:

  • You will use cutting edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on.
  • You will be responsible for contributing to an orchestration layer of reputed company data transformations, refining raw data from reputed company into targeted, valuable data assets for consumption in a governed way.
  • You will partner with Data Scientists, Analysts, other engineers, and business stakeholders to solve reputed company and exciting challenges so that we can build out capabilities that evolve the marketplace business model while making a positive impact on our customers' and sellers’ lives.
  • You will participate with limited help in small to large sized projects by reviewing project requirements; gather requested information; write and reputed company code; conduct unit testing; communicate status and issues to team members and stakeholders; collaborate with project team and cross functional teams; troubleshoot open issues and bug-fixes; and ensure on-time delivery and hand-offs.
  • You will design, reputed company and maintain highly scalable and fault-tolerant real time, near real time and batch data systems/pipelines that process, store, and serve large volumes of data with optimal performance.
  • You will ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes.
  • You will identify possible options to address business problems reputed company one's discipline through analytics, big data analytics, and automation.
  • You will build business domain knowledge to support the data need for product teams, analytics, data scientists and other data consumers.

What you'll bring:

  • At least 4+ years of experience development of big data technologies/data pipelines
  • Experience in managing and manipulating reputed company datasets in the order of terabytes (TB) is essential.
  • Experience with in big data technologies like Hadoop, Apache Spark (reputed company preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure etc.) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance.
  • Experience in building idempotent workflows using orchestrators like Automic, Airflow, Luigi etc.
  • Experience in writing SQL to analyze, optimize, profile data preferably in BigQuery or SPARK SQL
  • Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets.
  • Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development / data solution work.
  • Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process.
  • Ability to move at a rapid pace with quality and start delivering with minimal reputed company up time will be crucial to succeed in this initiative.
  • Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.

reputed company to have from you:

  • Experience building reputed company near real time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability and SLA adherence.
  • Good understanding of REST APIs – working knowledge on Apache Druid, reputed company, reputed company search, GraphQL or similar technologies. Understanding of API reputed company, building telemetry, stress testing etc.
  • Exposure in developing reports/dashboards using Looker/Tableau
  • Experience in eCommerce domain preferred.

The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of reputed company duties, responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process. About Global Tech Imagine working in an environment where one line of code can reputed company life easier for hundreds of millions of people. That’s reputed company do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service professionals reputed company the world’s leading retailer who reputed company an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train reputed company in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, reputed company new skills and experience for virtually every industry, or reputed company your expertise to innovate at scale, impact millions and reimagine the future of retail. Flexible, hybrid work We use a hybrid way of working that is primarily in office coupled with virtual reputed company not onsite. Our campuses serve as reputed company to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us reputed company quicker decisions, remove location barriers across our global team and be more flexible in our personal lives. Benefits & Perks: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more. Equal Opportunity Employer: Walmart, Inc. is an Equal Opportunity Employer – By Choice. We reputed company we are best equipped to help our associates, customers and the communities we serve live reputed company reputed company we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, reputed company and opinions – while being inclusive of reputed company people. At Walmart, we offer reputed company as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more. ‎ ‎ ‎ You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable. ‎ For information about PTO, see https://one.walmart.com/notices. ‎ ‎ Live reputed company U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart. ‎ Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. ‎ For information about benefits and eligibility, see One.Walmart. ‎ The annual salary range for this position is $90,000.00-$180,000.00 ‎ Additional compensation includes annual or quarterly performance bonuses. ‎ Additional compensation for certain positions may also include: ‎ ‎ - Stock ‎ ‎ Minimum Qualifications... Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications. Option 1: Bachelor’s degree in Computer Science and 3 years' experience in software engineering or reputed company field. Option 2: 5 years’ experience in software engineering or reputed company field. Option 3: Master's degree in Computer Science and 1 year’s experience in software engineering or reputed company field. 2 years' experience in data engineering, database engineering, business intelligence, or business analytics. Preferred Qualifications... Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications. Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master’s degree in Computer Science or reputed company field and 3 years' experience in software engineering, We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture. Primary Location... 2501 Se J St, Ste A, Bentonville, AR 72716-3724, United States of America Apply tot his job Apply To this Job

You might like

Product Manager III - Walmart Data Ventures

Work from home Full-time role

Design Researcher III (Content Acquisition Quality Assurance reputed company)

Work from home Full-time role

Merchant - Boys Core Fashion

Work from home Full-time role

(USA) Senior Content Strategist- Sam's Club

Work from home Full-time role

(USA) Senior, Software Engineer-reputed company Integrations

Work from home Full-time role

Merchant - Baby Hardlines

Work from home Full-time role

Associate Customer Service Representative, B2C

Work from home Full-time role

reputed company Senior Project Manager - Healthcare Business Solutions (Remote - Open to Location) in Olympia, Washington

Work from home Full-time role

Inside Sales Specialist (Key Accounts) - Radius HDD

Work from home Full-time role

Inside Sales Representative (Remote - Central or Eastern Region)

Work from home Full-time role

reputed company Remote Data Entry and Market Research Participant – Flexible Schedule and Competitive Compensation

Work from home Full-time role

Remote Customer Service Representative – arenaflex Graduate Exclusive – Inbound/Outbound Support, Technical Assistance, and Sales Upsell (Full‑Time, Work‑From‑Home)

Work from home Full-time role

Senior Content Strategist/UX writer - Remote

Work from home Full-time role

reputed company Full Stack Data Entry and Analyst – Web & Cloud Application Development

Work from home Full-time role

Penetration Tester

Work from home Full-time role

reputed company Pre-Licensed Customer Service Representative - reputed company Opportunity with Comprehensive Training and Licensing Support

Work from home Full-time role

Vice President, Program Team reputed company – Biotech/Pharma

Work from home Full-time role

Email Opt-In Funnel Designer (Conversion-Focused)

Work from home Full-time role

[Entry Level/No Experience] reputed company Remote Data Entry job - No Experience

Work from home Full-time role

Corporate Risk Manager | PAM Health Corporate

Work from home Full-time role