Skip to content

[Twitter] Twitter Scraper Client Response/Data structures #814

@AbdurrehmanSubhani

Description

@AbdurrehmanSubhani

In logs:

(base) abdurrehmansubhani@Abdurrehmans-MacBook-Pro twitterBot % usdk run -g
Agent 2b2b53d1-f68c-4d0c-b671-ca66708d0259 running on URL: http://localhost:10618
cookies [
  {
    key: 'guest_id_marketing',
    value: 'v1%3A173502288926768997',
    expires: '2026-12-24T06:48:09.000Z',
    maxAge: 63072000,
    domain: 'twitter.com',
    path: '/',
    secure: true,
    hostOnly: false,
    creation: '2024-12-24T06:48:09.363Z',
    lastAccessed: '2024-12-24T06:48:12.171Z',
    sameSite: 'none'
  },
  {
    key: 'guest_id_ads',
    value: 'v1%3A173502288926768997',
    expires: '2026-12-24T06:48:09.000Z',
    maxAge: 63072000,
    domain: 'twitter.com',
    path: '/',
    secure: true,
    hostOnly: false,
    creation: '2024-12-24T06:48:09.364Z',
    lastAccessed: '2024-12-24T06:48:12.171Z',
    sameSite: 'none'
  },
  {
    key: 'personalization_id',
    value: '"v1_UEO4M3aZ5HfyJM51bw6i1Q=="',
    expires: '2026-12-24T06:48:09.000Z',
    maxAge: 63072000,
    domain: 'twitter.com',
    path: '/',
    secure: true,
    hostOnly: false,
    creation: '2024-12-24T06:48:09.364Z',
    lastAccessed: '2024-12-24T06:48:12.171Z',
    sameSite: 'none'
  },
  {
    key: 'guest_id',
    value: 'v1%3A173502288926768997',
    expires: '2026-12-24T06:48:09.000Z',
    maxAge: 63072000,
    domain: 'twitter.com',
    path: '/',
    secure: true,
    hostOnly: false,
    creation: '2024-12-24T06:48:09.364Z',
    lastAccessed: '2024-12-24T06:48:12.171Z',
    sameSite: 'none'
  },
.....
]
Already logged in with cookies
mentions Object [AsyncGenerator] {}
user {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871448735089410131',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871448735089410131',
  photos: [],
  replies: 1,
  retweets: 0,
  text: 'hmmm hello world i guess',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: false,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T06:52:02.000Z,
  timestamp: 1735023122,
  html: 'hmmm hello world i guess'
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871471214881058830',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871471214881058830',
  photos: [],
  replies: 0,
  retweets: 0,
  text: 'well ok then i guess?',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: true,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T08:21:22.000Z,
  timestamp: 1735028482,
  inReplyToStatusId: '1871448735089410131',
  html: 'well ok then i guess?'
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871522618744115444',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871522618744115444',
  photos: [],
  replies: 0,
  retweets: 0,
  text: 'Sad',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: true,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T11:45:38.000Z,
  timestamp: 1735040738,
  inReplyToStatusId: '1871471214881058830',
  html: 'Sad'
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871448735089410131',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871448735089410131',
  photos: [],
  replies: 1,
  retweets: 0,
  text: 'hmmm hello world i guess',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: false,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T06:52:02.000Z,
  timestamp: 1735023122,
  html: 'hmmm hello world i guess'
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871471214881058830',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871471214881058830',
  photos: [],
  replies: 0,
  retweets: 0,
  text: 'well ok then i guess?',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: true,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T08:21:22.000Z,
  timestamp: 1735028482,
  inReplyToStatusId: '1871448735089410131',
  html: 'well ok then i guess?'
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871448735089410131',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871448735089410131',
  photos: [],
  replies: 1,
  retweets: 0,
  text: 'hmmm hello world i guess',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: false,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T06:52:02.000Z,
  timestamp: 1735023122,
  html: 'hmmm hello world i guess'
}
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871448735089410131',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871448735089410131',
  photos: [],
  replies: 1,
  retweets: 0,
  text: 'hmmm hello world i guess',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: false,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T06:52:02.000Z,
  timestamp: 1735023122,
  html: 'hmmm hello world i guess'
}
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
conversationId 1871448735089410131
userId 1871447098484473856
text hmmm hello world i guess
tweetId 1871448735089410131
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871448735089410131',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871448735089410131',
  photos: [],
  replies: 1,
  retweets: 0,
  text: 'hmmm hello world i guess',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: false,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T06:52:02.000Z,
  timestamp: 1735023122,
  html: 'hmmm hello world i guess'
}
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
conversationId 1871448735089410131
userId 1871447098484473856
text hmmm hello world i guess
tweetId 1871448735089410131
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871522618744115444',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871522618744115444',
  photos: [],
  replies: 0,
  retweets: 0,
  text: 'Sad',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: true,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T11:45:38.000Z,
  timestamp: 1735040738,
  inReplyToStatusId: '1871471214881058830',
  html: 'Sad'
}
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
conversationId 1871448735089410131
userId 1871447098484473856
text Sad
tweetId 1871522618744115444
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871448735089410131',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871448735089410131',
  photos: [],
  replies: 1,
  retweets: 0,
  text: 'hmmm hello world i guess',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: false,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T06:52:02.000Z,
  timestamp: 1735023122,
  html: 'hmmm hello world i guess'
}
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
conversationId 1871448735089410131
userId 1871447098484473856
text hmmm hello world i guess
tweetId 1871448735089410131
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871471214881058830',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871471214881058830',
  photos: [],
  replies: 0,
  retweets: 0,
  text: 'well ok then i guess?',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: true,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T08:21:22.000Z,
  timestamp: 1735028482,
  inReplyToStatusId: '1871448735089410131',
  html: 'well ok then i guess?'
}
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
conversationId 1871448735089410131
userId 1871447098484473856
text well ok then i guess?
tweetId 1871471214881058830
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
tweet {
  bookmarkCount: 0,
  conversationId: '1871448735089410131',
  id: '1871471214881058830',
  hashtags: [],
  likes: 0,
  mentions: [],
  name: 'ChadmanBlade',
  permanentUrl: 'https://twitter.com/Chadman339/status/1871471214881058830',
  photos: [],
  replies: 0,
  retweets: 0,
  text: 'well ok then i guess?',
  thread: [],
  urls: [],
  userId: '1871447098484473856',
  username: 'Chadman339',
  videos: [],
  isQuoted: false,
  isReply: true,
  isRetweet: false,
  isPin: false,
  sensitiveContent: false,
  timeParsed: 2024-12-24T08:21:22.000Z,
  timestamp: 1735028482,
  inReplyToStatusId: '1871448735089410131',
  html: 'well ok then i guess?'
}
author {
  avatar: 'https://abs.twimg.com/sticky/default_profile_images/default_profile.png',
  banner: undefined,
  biography: '',
  followersCount: 0,
  followingCount: 0,
  friendsCount: 0,
  mediaCount: 0,
  isPrivate: false,
  isVerified: false,
  likesCount: 0,
  listedCount: 0,
  location: '',
  name: 'ChadmanBlade',
  pinnedTweetIds: [],
  tweetsCount: 3,
  url: 'https://twitter.com/Chadman339',
  userId: '1871447098484473856',
  username: 'Chadman339',
  isBlueVerified: false,
  canDm: true,
  joined: 2024-12-24T06:45:51.000Z
}
conversationId 1871448735089410131
userId 1871447098484473856
text well ok then i guess?
tweetId 1871471214881058830
^C
Terminating all agent runtimes
Terminating agent runtime with PID: 84325
(base) abdurrehmansubhani@Abdurrehmans-MacBook-Pro twitterBot % 

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions