Skip to content

stringSplitterAgent ​

Package ​

@graphai/vanilla

Source ​

https://github.com/receptron/graphai/blob/main/agents/vanilla_agents/src/string_agents/string_splitter_agent.ts

Description ​

This agent strip one long string into chunks using following parameters

Schema ​

inputs ​

json

{
  "type": "object",
  "properties": {
    "text": {
      "type": "string",
      "description": "text to be chuncked"
    }
  },
  "required": [
    "text"
  ]
}

output ​

json

{
  "type": "object",
  "properties": {
    "contents": {
      "type": "array",
      "description": "the array of text chunks"
    },
    "count": {
      "type": "number",
      "description": "the number of chunks"
    },
    "chunkSize": {
      "type": "number",
      "description": "the chunk size"
    },
    "overlap": {
      "type": "number",
      "description": "the overlap size"
    }
  }
}

Input example of the next node ​

json

[
  ":agentId",
  ":agentId.contents",
  ":agentId.contents.$0",
  ":agentId.contents.$1",
  ":agentId.contents.$2",
  ":agentId.contents.$3",
  ":agentId.contents.$4",
  ":agentId.contents.$5",
  ":agentId.contents.$6",
  ":agentId.contents.$7",
  ":agentId.contents.$8",
  ":agentId.contents.$9",
  ":agentId.contents.$10",
  ":agentId.count",
  ":agentId.chunkSize",
  ":agentId.overlap"
]

Samples ​

Sample0 ​

inputs ​

json

{
  "text": "Here's to the crazy ones, the misfits, the rebels, the troublemakers, the round pegs in the square holes ... the ones who see things differently -- they're not fond of rules, and they have no respect for the status quo. ... You can quote them, disagree with them, glorify or vilify them, but the only thing you can't do is ignore them because they change things. ... They push the human race forward, and while some may see them as the crazy ones, we see genius, because the people who are crazy enough to think that they can change the world, are the ones who do."
}

params ​

json

{"chunkSize":64}

result ​

json

{
  "contents": [
    "Here's to the crazy ones, the misfits, the rebels, the troublema",
    "roublemakers, the round pegs in the square holes ... the ones wh",
    " ones who see things differently -- they're not fond of rules, a",
    "rules, and they have no respect for the status quo. ... You can ",
    "You can quote them, disagree with them, glorify or vilify them, ",
    "y them, but the only thing you can't do is ignore them because t",
    "ecause they change things. ... They push the human race forward,",
    "forward, and while some may see them as the crazy ones, we see g",
    "we see genius, because the people who are crazy enough to think ",
    "o think that they can change the world, are the ones who do.",
    " do."
  ],
  "count": 11,
  "chunkSize": 64,
  "overlap": 8
}

Author ​

Satoshi Nakajima

Repository ​

https://github.com/receptron/graphai

License ​

MIT

Released under the MIT License.