Skip to main content

News API

Sync overview

This source retrieves news stories from the News API. It can retrieve news stories all news stories found within the parameters chosen, or just top headlines.

Output schema

This source is capable of syncing the following streams:

  • everything
  • top_headlines

Features

FeatureSupported? (Yes/No)Notes
Full Refresh SyncYes
Incremental SyncNo

Performance considerations

The News API free tier only allows 100 requests per day, and only up to 100 results per request. It is not recommended to attempt to use this source with a free tier API key.

Getting started

Requirements

  1. A News API key. You can get one here. It is highly recommended to use a paid tier key.

Setup guide

The following fields are required fields for the connector to work:

  • api_key: Your News API key.
  • (optional) search_query: A search query to filter the results by. For more information on constructing a search query, see the News API documentation.
  • (optional) search_in: Fields to search in. Possible values are title, description and content.
  • (optional) sources: Sources to search in. For a list of sources, see the News API documentation.
  • (optional) domains: Domains to search in.
  • (optional) exclude_domains: Domains to exclude from the search.
  • (optional) start_date: The start date to search from.
  • (optional) end_date: The end date to search to.
  • (optional) language: The language to search in.
  • country: The country you want headlines for.
  • category: The category you want headlines for.
  • sort_by: How to sort the results.

Reference

Config fields reference

Field
Type
Property name
string
api_key
string
country
string
category
string
sort_by
string
search_query
array<string>
search_in
array<string>
sources
array<string>
domains
array<string>
exclude_domains
string
start_date
string
end_date
string
language

Changelog

Expand to review
VersionDatePull RequestSubject
0.1.142024-08-1043589Update dependencies
0.1.132024-08-0343096Update dependencies
0.1.122024-07-2742820Update dependencies
0.1.112024-07-2042285Update dependencies
0.1.102024-07-1341781Update dependencies
0.1.92024-07-1041599Update dependencies
0.1.82024-07-0941200Update dependencies
0.1.72024-07-0640802Update dependencies
0.1.62024-06-2540297Update dependencies
0.1.52024-06-2240174Update dependencies
0.1.42024-06-1238635Use Poetry, remove $parameters, make Builder compatible
0.1.32024-06-0439038[autopull] Upgrade base image to v1.2.1
0.1.22024-05-2038418[autopull] base image + poetry + up_to_date
0.1.12023-04-3025554Make manifest connector builder friendly
0.1.02022-10-2118301New source