【RAG实战】FireCrawl - 开源网页解析API,支持本地化部署 | Jina Reader的平替方案

Поделиться
HTML-код
  • Опубликовано: 25 окт 2024

Комментарии • 11

  • @CharlesLiu-nn8bv
    @CharlesLiu-nn8bv 5 месяцев назад +1

    我理解firecrawl只能爬取那些静态网站,但实际应用中很多内容都是动态加载的,或者是必须登录后才能访问的,这种场景有推荐的工具吗?

  • @风清扬-r7h
    @风清扬-r7h 5 месяцев назад +1

    想学习,不过听着有点一头雾水,希望出一期更易懂的操作流程。😀

    • @01coder30
      @01coder30  5 месяцев назад

      好的。看看这期是否简单些 ruclips.net/video/UAfPpnOHmbY/видео.html

  • @pongpong5441
    @pongpong5441 5 месяцев назад

    赞👍

  • @天地科技
    @天地科技 2 месяца назад

    问一下,本地部署好后,在dify中如何调用firecrawl本地,不使用官网,该如何设置,谢谢

    • @01coder30
      @01coder30  2 месяца назад

      这个我倒是没有琢磨过。需要看看文档,和代码,才能回答你。

  • @LauraMedina-rj9vj
    @LauraMedina-rj9vj 27 дней назад

    请问本地化部署使用免费吗

  • @planplay5921
    @planplay5921 5 месяцев назад

    请问在本地部署是不是就不要api key了,那岂不是可以无限使用了

    • @01coder30
      @01coder30  5 месяцев назад

      对,自己付出的就是运行环境成本

    • @AllenHu-ed2ow
      @AllenHu-ed2ow Месяц назад

      @@01coder30 可以帮忙指导一下 PS C:\Users\AllenHu\firecrawl-main\apps\api> pnpm run workers
      > firecrawl-scraper-js@1.0.0 workers C:\Users\AllenHu\firecrawl-main\apps\api
      > nodemon --exec ts-node src/services/queue-worker.ts
      [nodemon] 2.0.22
      [nodemon] to restart at any time, enter `rs`
      [nodemon] watching path(s): *.*
      [nodemon] watching extensions: ts,json
      [nodemon] starting `ts-node src/services/queue-worker.ts`
      [2024-09-12T15:54:36.535Z]WARN - LOGTAIL_KEY is not provided - your events will not be logged. Using MockLogtail as a fallback. see logtail.ts for more.
      [2024-09-12T15:54:36.961Z]WARN - Authentication is disabled. Supabase client will not be initialized.
      [2024-09-12T15:54:37.630Z]WARN - POSTHOG_API_KEY is not provided - your events will not be logged. Using MockPostHog as a fallback. See posthog.ts for more.
      [2024-09-12T15:54:38.305Z]INFO - Connected to Redis Session Rate Limit Store!
      It is highly recommended to use a minimum Redis version of 6.2.0
      Current: 5.0.14.1
      It is highly recommended to use a minimum Redis version of 6.2.0
      Current: 5.0.14.1
      Cant accept connection 错误的原因嘛?

  • @UTokyo-i-Con
    @UTokyo-i-Con 5 месяцев назад

    第一☝️