Job description
Russell Tobin & Associates is currently seeking a Content Strategist to work for our client in the tech industry. Apply now for consideration!
W2 Contract: 3 Months
Location: Remote within US
Pay: $50-60/hour (DOE)
Overview
We're seeking an experienced Content Strategist III to develop content evaluation guidelines that empower content reviewers to assess content quality, consistency, and policy alignment at scale. As part of the Product Data Operations team, you'll play a critical role in bridging product strategy with human annotation workflows, enabling high-quality data that powers AI products and experiences.
Job Responsibilities:
- Develop Content Evaluation Guidelines
- Translate product strategy, content policies, and research insights into structured content labeling guidelines for human annotators.
- Collaborate with Product, UX Research, and Product Data Operations (PDO) teams to identify content quality issues and define labeling requirements.
- Write clear, comprehensive guidelines that enable consistent content evaluation across large-scale annotation pipelines.
- Define Evaluation Criteria
- Establish clear, objective, and measurable evaluation criteria aligned with product goals, brand voice, and quality standards.
- Design labeling decision tree questions that are concise, comprehensive, unbiased, and enable reviewers to conduct data annotation accurately & timely
- Iterate on evaluation frameworks based on reviewer feedback, reviewer performance data, and stakeholder input.
- Stakeholder Collaboration
- Work closely with content reviewers, product, and product data operations teams to ensure guidelines meet their needs.
- Provide training and support to content reviewers on the evaluation guidelines.
- Gather feedback from stakeholders to iterate on and improve the guidelines.
- Data Analysis & Reporting
- Develop metrics to measure content quality and consistency.
- Analyze content evaluation data to identify trends, bottlenecks, and areas for guideline improvement.
- Build reporting frameworks to communicate performance insights and guideline effectiveness to stakeholders.
- Continuous Improvement
- Stay informed on emerging content moderation trends, AI advancements, and UXR best practices.
- Design research studies that measure how guideline changes impact reviewer accuracy and content quality outcomes.
- Advocate for inclusive and culturally sensitive evaluation criteria across global content pipelines.
Required Skills:
- 3+ years of experience in content strategy, content operations, or a related field.
- Proven track record of developing and implementing content evaluation guidelines.
- Excellent communication, collaboration, and project management skills.
- Strong analytical and problem-solving skills with Excel.
- Ability to work in a fast-paced environment and adapt to changing priorities.
- Experience with content management systems (CMS)
- Bachelor's degree in English, Communications, Journalism, or a related field.
Preferred Skills:
- Experience with generative AI tools and applications.
- Knowledge of SEO principles and how they impact content evaluation.
- Certification in content strategy or a related field.
- Experience working with global teams and adapting guidelines for different regions and cultures.
Russell Tobin / Pride Global offers eligible employee’s comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance and hospital indemnity), a 401(k)-retirement savings, life & disability insurance, an employee assistance program, identity theft protection, legal support, auto and home insurance, pet insurance, and employee discounts with some preferred vendors.
