Aug 05 18:59:31.407259 ip-10-0-133-67 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 05 18:59:31.407271 ip-10-0-133-67 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 05 18:59:31.407280 ip-10-0-133-67 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 05 18:59:31.407593 ip-10-0-133-67 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 05 18:59:41.503938 ip-10-0-133-67 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 05 18:59:41.503956 ip-10-0-133-67 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6b6253f90e864cd28690a8adebeb4e55 --
Aug 05 19:01:43.827474 ip-10-0-133-67 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 19:01:44.210688 ip-10-0-133-67 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 19:01:44.210688 ip-10-0-133-67 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 19:01:44.210688 ip-10-0-133-67 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 19:01:44.210688 ip-10-0-133-67 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 19:01:44.210688 ip-10-0-133-67 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 19:01:44.211420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.210749    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 19:01:44.214855 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214839    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:44.214855 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214855    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214859    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214862    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214865    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214867    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214870    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214874    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214877    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214880    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214884    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214886    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214893    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214896    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214898    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214901    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214904    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214906    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214909    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214911    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214914    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:44.214920 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214916    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214919    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214922    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214925    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214927    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214930    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214933    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214936    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214938    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214940    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214943    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214945    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214948    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214950    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214952    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214956    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214960    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214963    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214966    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:44.215413 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214969    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214972    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214975    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214978    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214981    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214984    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214986    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214989    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214991    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214994    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214996    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.214999    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215001    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215003    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215007    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215010    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215013    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215016    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215018    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:44.215869 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215021    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215023    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215025    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215028    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215031    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215033    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215036    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215038    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215041    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215043    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215045    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215048    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215051    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215053    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215056    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215058    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215061    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215064    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215066    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215068    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:44.216350 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215071    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215073    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215076    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215080    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215082    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215087    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215090    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215093    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215097    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215100    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215103    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215106    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215108    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215110    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215113    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215115    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215118    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215120    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215122    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:44.216857 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.215125    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217246    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217254    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217258    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217261    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217264    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217267    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217270    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217273    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217275    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217278    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217281    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217283    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217288    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217291    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217294    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217297    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217300    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217303    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:44.217336 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217306    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217308    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217311    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217313    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217316    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217319    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217321    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217324    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217326    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217329    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217331    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217334    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217336    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217339    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217342    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217345    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217347    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217351    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217355    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217357    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:44.217803 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217361    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217364    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217367    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217369    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217372    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217374    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217377    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217379    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217382    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217384    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217387    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217389    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217392    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217394    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217398    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217400    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217403    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217406    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217409    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217411    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:44.218300 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217414    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217416    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217419    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217422    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217424    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217427    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217430    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217432    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217434    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217437    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217439    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217442    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217444    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217447    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217450    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217452    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217455    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217457    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217460    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217464    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:44.218788 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217468    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217471    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217475    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217478    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217480    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217485    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217489    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217492    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217495    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217498    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217501    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217503    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217506    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217509    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217511    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217514    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217516    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217519    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217521    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:44.219284 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217524    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217526    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217920    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217925    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217928    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217931    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217937    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217940    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217942    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217945    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217948    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217951    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217953    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217956    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217958    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217961    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217963    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217966    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217969    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:44.219755 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217971    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217976    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217979    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217983    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217985    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217988    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217991    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217994    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217996    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.217999    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218001    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218004    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218006    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218009    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218011    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218014    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218016    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218018    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218022    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:44.220235 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218025    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218028    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218031    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218035    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218037    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218040    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218043    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218046    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218049    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218051    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218053    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218056    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218058    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218061    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218064    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218066    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218069    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218071    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218074    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218076    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218079    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:44.220710 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218081    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218084    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218087    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218090    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218093    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218095    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218098    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218100    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218103    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218106    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218109    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218112    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218114    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218117    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218120    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218123    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218125    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218128    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218131    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218133    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:44.221253 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218136    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218138    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218141    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218144    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218146    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218148    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218159    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218162    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218164    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218167    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218170    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218173    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218189    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218192    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218195    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218197    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218200    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218202    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218205    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:44.221769 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218208    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218210    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218213    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218284    2558 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218291    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218299    2558 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218305    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218314    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218319    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218325    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218329    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218333    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218336    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218339    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218342    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218345    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218348    2558 flags.go:64] FLAG: --cgroup-root=""
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218351    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218354    2558 flags.go:64] FLAG: --client-ca-file=""
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218356    2558 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218359    2558 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218363    2558 flags.go:64] FLAG: --cluster-domain=""
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218366    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218369    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 19:01:44.222241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218372    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218376    2558 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218379    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218382    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218385    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218388    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218391    2558 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218394    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218397    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218400    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218403    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218407    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218410    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218412    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218415    2558 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218418    2558 flags.go:64] FLAG: --enable-server="true"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218422    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218426    2558 flags.go:64] FLAG: --event-burst="100"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218429    2558 flags.go:64] FLAG: --event-qps="50"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218432    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218435    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218437    2558 flags.go:64] FLAG: --eviction-hard=""
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218441    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218444    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218447    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 19:01:44.222807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218449    2558 flags.go:64] FLAG: --eviction-soft=""
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218452    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218455    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218458    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218461    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218464    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218467    2558 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218470    2558 flags.go:64] FLAG: --feature-gates=""
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218474    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218477    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218480    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218483    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218485    2558 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218488    2558 flags.go:64] FLAG: --help="false"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218491    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218494    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218497    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218500    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218503    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218506    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218508    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218511    2558 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218516    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 19:01:44.223452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218519    2558 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218522    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218525    2558 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218528    2558 flags.go:64] FLAG: --kube-reserved=""
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218531    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218534    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218537    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218549    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218552    2558 flags.go:64] FLAG: --lock-file=""
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218554    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218558    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218561    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218566    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218569    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218571    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218574    2558 flags.go:64] FLAG: --logging-format="text"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218577    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218580    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218583    2558 flags.go:64] FLAG: --manifest-url=""
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218586    2558 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218590    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218593    2558 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218597    2558 flags.go:64] FLAG: --max-pods="110"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218599    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218602    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 19:01:44.224023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218605    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218608    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218611    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218614    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218616    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218623    2558 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218627    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218630    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218633    2558 flags.go:64] FLAG: --pod-cidr=""
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218643    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218649    2558 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218652    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218655    2558 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218658    2558 flags.go:64] FLAG: --port="10250"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218661    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218664    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-004876664a020bd23"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218667    2558 flags.go:64] FLAG: --qos-reserved=""
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218669    2558 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218672    2558 flags.go:64] FLAG: --register-node="true"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218675    2558 flags.go:64] FLAG: --register-with-taints=""
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218679    2558 flags.go:64] FLAG: --registry-burst="10"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218681    2558 flags.go:64] FLAG: --registry-qps="5"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218684    2558 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218687    2558 flags.go:64] FLAG: --reserved-memory=""
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218690    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 19:01:44.224633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218693    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218696    2558 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218699    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218702    2558 flags.go:64] FLAG: --runonce="false"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218705    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218708    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218711    2558 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218713    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218716    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218719    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218722    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218725    2558 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218728    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218731    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218735    2558 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218737    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218742    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218750    2558 flags.go:64] FLAG: --system-cgroups=""
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218753    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218758    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218761    2558 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218764    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218767    2558 flags.go:64] FLAG: --tls-min-version=""
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218770    2558 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218773    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 19:01:44.225294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218776    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218778    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218781    2558 flags.go:64] FLAG: --v="2"
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218785    2558 flags.go:64] FLAG: --version="false"
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218789    2558 flags.go:64] FLAG: --vmodule=""
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218792    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.218796    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218920    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218923    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218926    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218929    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218932    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218934    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218938    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218942    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218945    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218948    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218986    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218991    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218995    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:44.225882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.218998    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219002    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219006    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219009    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219011    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219014    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219016    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219019    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219022    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219024    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219027    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219030    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219033    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219035    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219037    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219040    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219042    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219045    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219050    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:44.226409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219053    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219056    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219060    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219063    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219066    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219069    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219071    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219075    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219079    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219081    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219085    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219089    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219092    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219095    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219097    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219100    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219102    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219105    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219108    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219110    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:44.226871 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219113    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219115    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219118    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219121    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219124    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219126    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219129    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219131    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219134    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219136    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219139    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219142    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219144    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219147    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219149    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219152    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219155    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219157    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219159    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219162    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:44.227365 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219165    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219167    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219170    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219173    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219187    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219190    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219193    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219195    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219198    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219201    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219203    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219206    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219208    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219211    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219213    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219216    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219219    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219221    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219223    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219226    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:44.227847 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219228    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219231    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219233    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219236    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219238    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219241    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.219243    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.219867    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.227077    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.227095    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.227967    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.227974    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228037    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228042    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228046    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:44.228352 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228049    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228051    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228056    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228060    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228063    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228066    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228069    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228072    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228074    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228077    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228080    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228082    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228085    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228087    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228090    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228092    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228095    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228097    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228100    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:44.228721 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228103    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228105    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228108    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228111    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228113    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228116    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228119    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228127    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228130    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228133    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228135    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228138    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228140    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228143    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228145    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228148    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228150    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228152    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228155    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:44.229197 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228157    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228159    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228162    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228164    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228166    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228169    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228172    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228174    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228191    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228193    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228196    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228198    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228201    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228204    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228206    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228209    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228211    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228215    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228218    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228221    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:44.229663 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228225    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228233    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228236    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228239    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228241    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228244    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228246    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228249    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228251    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228253    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228256    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228258    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228261    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228263    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228266    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228268    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228271    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228273    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228276    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228278    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:44.230144 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228280    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228284    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228295    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228298    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228301    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228303    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228306    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228308    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228311    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228313    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228316    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228319    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228321    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228324    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228332    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228334    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228336    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:44.230639 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228339    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.228344    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228497    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228502    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228505    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228509    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228512    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228515    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228518    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228520    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228523    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228525    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228528    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228530    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:44.231051 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228532    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228535    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228537    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228540    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228542    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228544    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228547    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228549    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228552    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228554    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228556    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228559    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228561    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228564    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228566    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228569    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228576    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228579    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228582    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228585    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:44.231409 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228587    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228589    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228593    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228596    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228600    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228603    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228606    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228609    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228612    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228614    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228617    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228619    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228621    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228624    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228626    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228629    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228631    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228633    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228636    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:44.231883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228638    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228640    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228643    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228645    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228648    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228651    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228653    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228656    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228658    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228660    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228668    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228670    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228673    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228675    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228678    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228680    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228682    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228685    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228687    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:44.232356 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228690    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228692    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228694    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228697    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228699    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228701    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228703    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228706    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228708    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228710    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228713    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228716    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228718    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228720    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228723    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228725    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228728    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228730    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228733    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228736    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:44.232811 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228738    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228740    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228743    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228760    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228770    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228773    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228776    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228778    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:44.228781    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.228785    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.228909    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.230961    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.232125    2558 server.go:1019] "Starting client certificate rotation"
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.232232    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 19:01:44.233410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.232269    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 19:01:44.236945 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.236923    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 19:01:44.243165 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.243145    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 19:01:44.256707 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.256689    2558 log.go:25] "Validated CRI v1 runtime API"
Aug 05 19:01:44.258145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.258129    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 19:01:44.258627 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.258612    2558 log.go:25] "Validated CRI v1 image API"
Aug 05 19:01:44.259416 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.259397    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 19:01:44.261870 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.261847    2558 fs.go:135] Filesystem UUIDs: map[1e1a12d9-637a-4850-8223-af0ca079f5ae:/dev/nvme0n1p4 43341e9d-3025-4dfd-b35c-5d6d3019b579:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Aug 05 19:01:44.261942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.261868    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 19:01:44.267874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.267745    2558 manager.go:216] Machine: {Timestamp:2026-08-05 19:01:44.266479608 +0000 UTC m=+0.317967292 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094406 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2343f7a03f86af003493f11641c219 SystemUUID:ec2343f7-a03f-86af-0034-93f11641c219 BootID:6b6253f9-0e86-4cd2-8690-a8adebeb4e55 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:ab:88:e4:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:ab:88:e4:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:32:f9:09:c3:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 19:01:44.267874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.267869    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 19:01:44.267968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.267946    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 19:01:44.270408 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.270385    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 19:01:44.270562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.270411    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 19:01:44.271221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.271211    2558 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 19:01:44.271257 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.271224    2558 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 19:01:44.271257 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.271232    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 19:01:44.271864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.271854    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 19:01:44.272702 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.272692    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 19:01:44.276274 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.276262    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 19:01:44.276400 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.276391    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 19:01:44.276430 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.276422    2558 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 19:01:44.276457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.276438    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 19:01:44.276457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.276449    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 19:01:44.276527 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.276482    2558 kubelet.go:398] "Adding apiserver pod source"
Aug 05 19:01:44.276527 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.276495    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 19:01:44.277143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.277124    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 19:01:44.277217 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.277164    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 19:01:44.279375 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.279358    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 19:01:44.281545 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.281421    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 19:01:44.281635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.281548    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 19:01:44.282772 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282753    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282778    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282785    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282791    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282800    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282811    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282820    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282826    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282836    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 19:01:44.282846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282846    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 19:01:44.283113 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282864    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 19:01:44.283113 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.282870    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 19:01:44.283815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.283801    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 19:01:44.284048 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.284032    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 19:01:44.287327 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.287312    2558 server.go:1268] "Started kubelet"
Aug 05 19:01:44.287430 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.287380    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 19:01:44.287485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.287419    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 19:01:44.287485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.287453    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 19:01:44.288229 ip-10-0-133-67 systemd[1]: Started Kubernetes Kubelet.
Aug 05 19:01:44.288437 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.288317    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 19:01:44.288610 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.288595    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 19:01:44.288928 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.288895    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 19:01:44.288987 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.288895    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 19:01:44.290289 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.290274    2558 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 19:01:44.293747 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.293723    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 19:01:44.293980 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.293962    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 19:01:44.293980 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.293976    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 19:01:44.294204 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.294143    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.294729 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.294582    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 19:01:44.294729 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.294605    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 19:01:44.294729 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.294578    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 19:01:44.294884 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.294734    2558 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 19:01:44.294884 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.294742    2558 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 19:01:44.294884 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.294847    2558 factory.go:55] Registering systemd factory
Aug 05 19:01:44.294884 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.294859    2558 factory.go:223] Registration of the systemd container factory successfully
Aug 05 19:01:44.295044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.295029    2558 factory.go:153] Registering CRI-O factory
Aug 05 19:01:44.295044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.295043    2558 factory.go:223] Registration of the crio container factory successfully
Aug 05 19:01:44.295193 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.295099    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 19:01:44.295193 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.295130    2558 factory.go:103] Registering Raw factory
Aug 05 19:01:44.295193 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.295142    2558 manager.go:1196] Started watching for new ooms in manager
Aug 05 19:01:44.295401 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.294555    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-67.ec2.internal.18c8fdfa6e5794a9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-67.ec2.internal,UID:ip-10-0-133-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-67.ec2.internal,},FirstTimestamp:2026-08-05 19:01:44.287286441 +0000 UTC m=+0.338774123,LastTimestamp:2026-08-05 19:01:44.287286441 +0000 UTC m=+0.338774123,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-67.ec2.internal,}"
Aug 05 19:01:44.295484 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.295457    2558 manager.go:349] Starting recovery of all containers
Aug 05 19:01:44.307801 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.300632    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 19:01:44.307801 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.301008    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 19:01:44.307801 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.305825    2558 manager.go:354] Recovery completed
Aug 05 19:01:44.311487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.311474    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:44.313194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.313149    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:44.313261 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.313215    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:44.313261 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.313232    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:44.313722 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.313707    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 19:01:44.313722 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.313720    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 19:01:44.313838 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.313729    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:44.313838 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.313734    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 19:01:44.314482 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.314466    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:44.314549 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.314499    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:44.314549 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.314514    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:44.315064 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.315001    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-67.ec2.internal.18c8fdfa6fe2e9fe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-67.ec2.internal,UID:ip-10-0-133-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-67.ec2.internal,},FirstTimestamp:2026-08-05 19:01:44.313195006 +0000 UTC m=+0.364682693,LastTimestamp:2026-08-05 19:01:44.313195006 +0000 UTC m=+0.364682693,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-67.ec2.internal,}"
Aug 05 19:01:44.315145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.315134    2558 policy_none.go:49] "None policy: Start"
Aug 05 19:01:44.315682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.315671    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 19:01:44.315718 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.315690    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 19:01:44.316410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.316391    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rvbp"
Aug 05 19:01:44.316806 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.316796    2558 policy_none.go:47] "Start"
Aug 05 19:01:44.323400 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.323336    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-67.ec2.internal.18c8fdfa6fe35a47  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-67.ec2.internal,UID:ip-10-0-133-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-67.ec2.internal,},FirstTimestamp:2026-08-05 19:01:44.313223751 +0000 UTC m=+0.364711437,LastTimestamp:2026-08-05 19:01:44.313223751 +0000 UTC m=+0.364711437,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-67.ec2.internal,}"
Aug 05 19:01:44.323917 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.323901    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rvbp"
Aug 05 19:01:44.349740 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.349725    2558 manager.go:337] "Starting Device Plugin manager"
Aug 05 19:01:44.349814 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.349781    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 19:01:44.349814 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.349792    2558 server.go:87] "Starting device plugin registration server"
Aug 05 19:01:44.349995 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.349979    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 19:01:44.350091 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.350001    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 19:01:44.350091 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.350073    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 19:01:44.350230 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.350150    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 19:01:44.350230 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.350165    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 19:01:44.350667 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.350650    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 19:01:44.350750 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.350691    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.450687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.450664    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:44.451743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.451557    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:44.451743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.451586    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:44.451743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.451595    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:44.451743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.451622    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.459272 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.459251    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.459359 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.459275    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-67.ec2.internal\": node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.467998 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.467927    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 19:01:44.467998 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.467962    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.469267 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.469249    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 19:01:44.469320 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.469297    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 19:01:44.469365 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.469322    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 19:01:44.469411 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.469362    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 19:01:44.471519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.471500    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:44.568327 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.568297    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.570463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.570433    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"]
Aug 05 19:01:44.570546 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.570519    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:44.572063 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.572045    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:44.572170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.572076    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:44.572170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.572086    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:44.573636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.573623    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:44.573766 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.573751    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.573829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.573786    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:44.574356 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.574340    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:44.574427 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.574345    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:44.574427 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.574391    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:44.574427 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.574403    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:44.574519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.574368    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:44.574519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.574454    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:44.575954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.575942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.575989 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.575966    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:44.576621 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.576604    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:44.576692 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.576637    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:44.576692 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.576652    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:44.597089 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.597070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f2e2710f910ca2e5499e4e7beb60e27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"1f2e2710f910ca2e5499e4e7beb60e27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.597171 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.597093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f2e2710f910ca2e5499e4e7beb60e27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"1f2e2710f910ca2e5499e4e7beb60e27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.597171 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.597111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/300ceb00d8c140e964e4979aab4ccdce-config\") pod \"kube-apiserver-proxy-ip-10-0-133-67.ec2.internal\" (UID: \"300ceb00d8c140e964e4979aab4ccdce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.611886 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.611867    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-67.ec2.internal\" not found" node="ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.616320 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.616304    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-67.ec2.internal\" not found" node="ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.668910 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.668891    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.697225 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.697196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f2e2710f910ca2e5499e4e7beb60e27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"1f2e2710f910ca2e5499e4e7beb60e27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.697318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.697235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f2e2710f910ca2e5499e4e7beb60e27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"1f2e2710f910ca2e5499e4e7beb60e27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.697318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.697259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/300ceb00d8c140e964e4979aab4ccdce-config\") pod \"kube-apiserver-proxy-ip-10-0-133-67.ec2.internal\" (UID: \"300ceb00d8c140e964e4979aab4ccdce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.697318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.697298    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f2e2710f910ca2e5499e4e7beb60e27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"1f2e2710f910ca2e5499e4e7beb60e27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.697318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.697306    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/300ceb00d8c140e964e4979aab4ccdce-config\") pod \"kube-apiserver-proxy-ip-10-0-133-67.ec2.internal\" (UID: \"300ceb00d8c140e964e4979aab4ccdce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.697458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.697302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f2e2710f910ca2e5499e4e7beb60e27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"1f2e2710f910ca2e5499e4e7beb60e27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.769513 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.769449    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.870135 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.870090    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:44.914628 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.914605    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.919250 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:44.919079    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:44.970893 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:44.970867    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:45.071408 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:45.071344    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:45.171930 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:45.171901    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:45.181367 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.181348    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:45.231914 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.231895    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 19:01:45.232449 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.232009    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 19:01:45.232449 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.232042    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 19:01:45.246554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.246534    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:45.272101 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:45.272077    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:45.328320 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.328216    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 18:56:44 +0000 UTC" deadline="2028-04-25 17:16:34.5675066 +0000 UTC"
Aug 05 19:01:45.328320 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.328269    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15094h14m49.239241299s"
Aug 05 19:01:45.372660 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:45.372614    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found"
Aug 05 19:01:45.426877 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.426852    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:45.471388 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:45.471347    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300ceb00d8c140e964e4979aab4ccdce.slice/crio-f2766208f59ed461ea091ba9706d8fcc8de580c78b5a37dc73acb4664b09d156 WatchSource:0}: Error finding container f2766208f59ed461ea091ba9706d8fcc8de580c78b5a37dc73acb4664b09d156: Status 404 returned error can't find the container with id f2766208f59ed461ea091ba9706d8fcc8de580c78b5a37dc73acb4664b09d156
Aug 05 19:01:45.475560 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.475542    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:01:45.494488 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.494461    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:45.504635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.504620    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 19:01:45.505673 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.505660    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"
Aug 05 19:01:45.517812 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:45.517792    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 19:01:45.634952 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:45.634921    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2e2710f910ca2e5499e4e7beb60e27.slice/crio-c41eda8ceb9faaf52c1d2d9c8f5320ad1282733f878958bffafedb00e39706c9 WatchSource:0}: Error finding container c41eda8ceb9faaf52c1d2d9c8f5320ad1282733f878958bffafedb00e39706c9: Status 404 returned error can't find the container with id c41eda8ceb9faaf52c1d2d9c8f5320ad1282733f878958bffafedb00e39706c9
Aug 05 19:01:46.080501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.080413    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:46.277982 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.277937    2558 apiserver.go:52] "Watching apiserver"
Aug 05 19:01:46.285975 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.285936    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 19:01:46.286511 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.286488    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bp8tx","kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tkgft","openshift-image-registry/node-ca-h6mts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal","openshift-multus/network-metrics-daemon-v45rm","openshift-ovn-kubernetes/ovnkube-node-l4xhz","kube-system/konnectivity-agent-485xc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck","openshift-dns/node-resolver-l4tck","openshift-multus/multus-8s22f","openshift-multus/multus-additional-cni-plugins-qs29m","openshift-network-diagnostics/network-check-target-gvkjx","openshift-network-operator/iptables-alerter-sf5cb"]
Aug 05 19:01:46.288802 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.288775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.290054 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.290028    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.291533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.291509    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 19:01:46.291641 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.291559    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 19:01:46.291641 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.291625    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 19:01:46.291792 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.291773    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 19:01:46.291855 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.291794    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tdfrg\""
Aug 05 19:01:46.291914 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.291854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.292468 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.292323    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 19:01:46.292468 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.292358    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 19:01:46.292757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.292734    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 19:01:46.292850 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.292783    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 19:01:46.292850 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.292826    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 19:01:46.292985 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.292969    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 19:01:46.293341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.293175    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mnk9t\""
Aug 05 19:01:46.293438 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.293380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.294173 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.294150    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 19:01:46.294173 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.294159    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 19:01:46.294549 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.294529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sxvw8\""
Aug 05 19:01:46.295623 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.295233    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 19:01:46.295759 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.295741    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 19:01:46.295837 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.295765    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 19:01:46.295837 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.295773    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2zlrq\""
Aug 05 19:01:46.296091 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.296073    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 19:01:46.296706 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.296687    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.298751 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.298292    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:46.298751 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.298371    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:01:46.298972 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.298939    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72gss\""
Aug 05 19:01:46.298972 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.298965    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 19:01:46.299111 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.298998    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 19:01:46.299250 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.299230    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 19:01:46.300117 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.300096    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.301555 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.301534    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:46.301656 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.301604    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:01:46.302262 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.302221    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 19:01:46.302354 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.302249    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 19:01:46.302696 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.302677    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5jlf2\""
Aug 05 19:01:46.302824 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.302807    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 19:01:46.303903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.303878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.305972 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.305951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.306729 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.306707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 19:01:46.306836 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.306747    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m78n9\""
Aug 05 19:01:46.307196 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307049    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 19:01:46.307196 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-etc-kubernetes\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.307196 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46251e5a-cf58-43b3-a870-244f3579eb5b-tmp\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-systemd-units\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-conf-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsr4j\" (UniqueName: \"kubernetes.io/projected/73fd2155-1e97-4286-9fc6-217dbdd53c9e-kube-api-access-rsr4j\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-kubernetes\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-run\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-kubelet\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcd90924-d716-4f52-944b-71fc7786b355-host-slash\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-node-log\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-log-socket\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-run-netns\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-var-lib-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-cni-netd\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-cni-multus\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307615    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-systemd\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-host\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.308829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovnkube-script-lib\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-os-release\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-netns\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-modprobe-d\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysconfig\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-slash\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-cni-bin\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307865    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-cni-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysctl-conf\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55f8a755-15c7-4719-8733-88c25d7fd7d6-serviceca\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcd90924-d716-4f52-944b-71fc7786b355-iptables-alerter-script\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-cnibin\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-socket-dir-parent\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.307976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-etc-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovnkube-config\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308100    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-daemon-config\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-tuned\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.309885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysctl-d\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq6dv\" (UniqueName: \"kubernetes.io/projected/46251e5a-cf58-43b3-a870-244f3579eb5b-kube-api-access-pq6dv\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308659    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73fd2155-1e97-4286-9fc6-217dbdd53c9e-cni-binary-copy\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-multus-certs\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308865    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j6ftm\""
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-env-overrides\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.308991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjrz\" (UniqueName: \"kubernetes.io/projected/f18e7dd7-f510-4d73-8ec0-117463e1f27a-kube-api-access-bdjrz\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-sys\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-systemd\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-k8s-cni-cncf-io\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309156    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-lib-modules\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55f8a755-15c7-4719-8733-88c25d7fd7d6-host\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.309231    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:01:46.310952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpjhv\" (UniqueName: \"kubernetes.io/projected/55f8a755-15c7-4719-8733-88c25d7fd7d6-kube-api-access-jpjhv\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg9nx\" (UniqueName: \"kubernetes.io/projected/dcd90924-d716-4f52-944b-71fc7786b355-kube-api-access-gg9nx\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-kubelet\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-hostroot\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.309578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-var-lib-kubelet\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.310042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-ovn\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.310086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-system-cni-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.310113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.311853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.310121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-cni-bin\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.313237 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.313191    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2n98z\""
Aug 05 19:01:46.313455 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.313437    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 19:01:46.313693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.313669    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 19:01:46.330337 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.330315    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmg24"
Aug 05 19:01:46.337788 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.337767    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmg24"
Aug 05 19:01:46.396744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.396719    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 19:01:46.410643 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46251e5a-cf58-43b3-a870-244f3579eb5b-tmp\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.410817 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-kubelet-config\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.410817 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.410929 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-systemd-units\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.410929 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-conf-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.410929 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsr4j\" (UniqueName: \"kubernetes.io/projected/73fd2155-1e97-4286-9fc6-217dbdd53c9e-kube-api-access-rsr4j\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.410929 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-kubernetes\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-systemd-units\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-run\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-conf-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.410984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411018    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-kubernetes\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-kubelet\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-run\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcd90924-d716-4f52-944b-71fc7786b355-host-slash\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-sys-fs\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-kubelet\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411134    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-system-cni-dir\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcd90924-d716-4f52-944b-71fc7786b355-host-slash\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg9pm\" (UniqueName: \"kubernetes.io/projected/4e2df668-b1e8-46fa-a223-b46caf31083a-kube-api-access-sg9pm\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-node-log\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-log-socket\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-run-netns\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-var-lib-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-log-socket\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-cni-netd\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-run-netns\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-cni-multus\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-cni-netd\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-node-log\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-systemd\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-var-lib-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-host\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-cni-multus\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovnkube-script-lib\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.411695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-host\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-systemd\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-os-release\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411562    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-netns\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-modprobe-d\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411620    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysconfig\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-slash\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-netns\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-os-release\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-cni-bin\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-cni-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysconfig\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411705    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-slash\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysctl-conf\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411803    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-cni-bin\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-modprobe-d\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q97c\" (UniqueName: \"kubernetes.io/projected/9a8275bb-663f-4f94-9e4f-295070eeac5c-kube-api-access-8q97c\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:46.412611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-cni-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-socket-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrf5w\" (UniqueName: \"kubernetes.io/projected/ab616912-95c1-49a0-ae84-cc6f101ec617-kube-api-access-lrf5w\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysctl-conf\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55f8a755-15c7-4719-8733-88c25d7fd7d6-serviceca\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.411976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcd90924-d716-4f52-944b-71fc7786b355-iptables-alerter-script\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-cnibin\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-cnibin\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-socket-dir-parent\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovnkube-script-lib\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-cnibin\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b085e157-f603-495e-bdf9-444933187a8d-konnectivity-ca\") pod \"konnectivity-agent-485xc\" (UID: \"b085e157-f603-495e-bdf9-444933187a8d\") " pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-etc-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovnkube-config\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-etc-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.413515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-socket-dir-parent\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412302    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-daemon-config\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-tuned\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55f8a755-15c7-4719-8733-88c25d7fd7d6-serviceca\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysctl-d\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq6dv\" (UniqueName: \"kubernetes.io/projected/46251e5a-cf58-43b3-a870-244f3579eb5b-kube-api-access-pq6dv\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-cni-binary-copy\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovnkube-config\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73fd2155-1e97-4286-9fc6-217dbdd53c9e-multus-daemon-config\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.412846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcd90924-d716-4f52-944b-71fc7786b355-iptables-alerter-script\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413182    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-sysctl-d\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73fd2155-1e97-4286-9fc6-217dbdd53c9e-cni-binary-copy\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413237    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.414418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-multus-certs\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-multus-certs\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-device-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-dbus\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413392    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-openvswitch\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-env-overrides\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413554    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjrz\" (UniqueName: \"kubernetes.io/projected/f18e7dd7-f510-4d73-8ec0-117463e1f27a-kube-api-access-bdjrz\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-sys\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413643    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-sys\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-tmp-dir\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73fd2155-1e97-4286-9fc6-217dbdd53c9e-cni-binary-copy\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f18e7dd7-f510-4d73-8ec0-117463e1f27a-env-overrides\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-hosts-file\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75ld5\" (UniqueName: \"kubernetes.io/projected/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-kube-api-access-75ld5\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.415392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-systemd\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.413963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-k8s-cni-cncf-io\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414004    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-systemd\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-lib-modules\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-run-k8s-cni-cncf-io\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55f8a755-15c7-4719-8733-88c25d7fd7d6-host\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55f8a755-15c7-4719-8733-88c25d7fd7d6-host\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpjhv\" (UniqueName: \"kubernetes.io/projected/55f8a755-15c7-4719-8733-88c25d7fd7d6-kube-api-access-jpjhv\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg9nx\" (UniqueName: \"kubernetes.io/projected/dcd90924-d716-4f52-944b-71fc7786b355-kube-api-access-gg9nx\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-lib-modules\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-kubelet\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-kubelet\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-hostroot\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-var-lib-kubelet\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-registration-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414478    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b085e157-f603-495e-bdf9-444933187a8d-agent-certs\") pod \"konnectivity-agent-485xc\" (UID: \"b085e157-f603-495e-bdf9-444933187a8d\") " pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-ovn\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.416357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46251e5a-cf58-43b3-a870-244f3579eb5b-var-lib-kubelet\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414557    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-os-release\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414606    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-hostroot\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-system-cni-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414638    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f18e7dd7-f510-4d73-8ec0-117463e1f27a-run-ovn\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-cni-bin\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-etc-kubernetes\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414687    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-system-cni-dir\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-host-var-lib-cni-bin\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.414739    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73fd2155-1e97-4286-9fc6-217dbdd53c9e-etc-kubernetes\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.417314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.417230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46251e5a-cf58-43b3-a870-244f3579eb5b-etc-tuned\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.417958 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.417907    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f18e7dd7-f510-4d73-8ec0-117463e1f27a-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.420661 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.420613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46251e5a-cf58-43b3-a870-244f3579eb5b-tmp\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.420776 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.420752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsr4j\" (UniqueName: \"kubernetes.io/projected/73fd2155-1e97-4286-9fc6-217dbdd53c9e-kube-api-access-rsr4j\") pod \"multus-8s22f\" (UID: \"73fd2155-1e97-4286-9fc6-217dbdd53c9e\") " pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.421100 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.421060    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq6dv\" (UniqueName: \"kubernetes.io/projected/46251e5a-cf58-43b3-a870-244f3579eb5b-kube-api-access-pq6dv\") pod \"tuned-tkgft\" (UID: \"46251e5a-cf58-43b3-a870-244f3579eb5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.423062 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.423023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjrz\" (UniqueName: \"kubernetes.io/projected/f18e7dd7-f510-4d73-8ec0-117463e1f27a-kube-api-access-bdjrz\") pod \"ovnkube-node-l4xhz\" (UID: \"f18e7dd7-f510-4d73-8ec0-117463e1f27a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.423354 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.423334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpjhv\" (UniqueName: \"kubernetes.io/projected/55f8a755-15c7-4719-8733-88c25d7fd7d6-kube-api-access-jpjhv\") pod \"node-ca-h6mts\" (UID: \"55f8a755-15c7-4719-8733-88c25d7fd7d6\") " pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.423685 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.423663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg9nx\" (UniqueName: \"kubernetes.io/projected/dcd90924-d716-4f52-944b-71fc7786b355-kube-api-access-gg9nx\") pod \"iptables-alerter-sf5cb\" (UID: \"dcd90924-d716-4f52-944b-71fc7786b355\") " pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.475934 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.475867    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" event={"ID":"1f2e2710f910ca2e5499e4e7beb60e27","Type":"ContainerStarted","Data":"c41eda8ceb9faaf52c1d2d9c8f5320ad1282733f878958bffafedb00e39706c9"}
Aug 05 19:01:46.478261 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.478222    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" event={"ID":"300ceb00d8c140e964e4979aab4ccdce","Type":"ContainerStarted","Data":"f2766208f59ed461ea091ba9706d8fcc8de580c78b5a37dc73acb4664b09d156"}
Aug 05 19:01:46.515774 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-kubelet-config\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.515910 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.515910 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:46.515910 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-sys-fs\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.515910 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-system-cni-dir\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.515910 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg9pm\" (UniqueName: \"kubernetes.io/projected/4e2df668-b1e8-46fa-a223-b46caf31083a-kube-api-access-sg9pm\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.515910 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-kubelet-config\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515944    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-sys-fs\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.515972    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.515986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-system-cni-dir\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.516088    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs podName:9a8275bb-663f-4f94-9e4f-295070eeac5c nodeName:}" failed. No retries permitted until 2026-08-05 19:01:47.016064665 +0000 UTC m=+3.067552356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs") pod "network-metrics-daemon-v45rm" (UID: "9a8275bb-663f-4f94-9e4f-295070eeac5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q97c\" (UniqueName: \"kubernetes.io/projected/9a8275bb-663f-4f94-9e4f-295070eeac5c-kube-api-access-8q97c\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516214    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-socket-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrf5w\" (UniqueName: \"kubernetes.io/projected/ab616912-95c1-49a0-ae84-cc6f101ec617-kube-api-access-lrf5w\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.516260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-cnibin\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b085e157-f603-495e-bdf9-444933187a8d-konnectivity-ca\") pod \"konnectivity-agent-485xc\" (UID: \"b085e157-f603-495e-bdf9-444933187a8d\") " pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-cni-binary-copy\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-device-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-dbus\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-tmp-dir\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-cnibin\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516544    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-hosts-file\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75ld5\" (UniqueName: \"kubernetes.io/projected/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-kube-api-access-75ld5\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-hosts-file\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.516721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516633    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-registration-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-socket-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516661    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b085e157-f603-495e-bdf9-444933187a8d-agent-certs\") pod \"konnectivity-agent-485xc\" (UID: \"b085e157-f603-495e-bdf9-444933187a8d\") " pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-os-release\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.516798    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-os-release\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517131    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-tmp-dir\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-device-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab616912-95c1-49a0-ae84-cc6f101ec617-registration-dir\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517303    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-dbus\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.517366    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517408    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e2df668-b1e8-46fa-a223-b46caf31083a-cni-binary-copy\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.517422    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret podName:bee8cc76-3bea-4cb9-ac15-a9de8deadbea nodeName:}" failed. No retries permitted until 2026-08-05 19:01:47.017403781 +0000 UTC m=+3.068891454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret") pod "global-pull-secret-syncer-bp8tx" (UID: "bee8cc76-3bea-4cb9-ac15-a9de8deadbea") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:46.517682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e2df668-b1e8-46fa-a223-b46caf31083a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.518330 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.517872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b085e157-f603-495e-bdf9-444933187a8d-konnectivity-ca\") pod \"konnectivity-agent-485xc\" (UID: \"b085e157-f603-495e-bdf9-444933187a8d\") " pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.519952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.519925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b085e157-f603-495e-bdf9-444933187a8d-agent-certs\") pod \"konnectivity-agent-485xc\" (UID: \"b085e157-f603-495e-bdf9-444933187a8d\") " pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.523080 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.523056    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:46.523212 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.523086    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:46.523212 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.523103    2558 projected.go:196] Error preparing data for projected volume kube-api-access-s9pdz for pod openshift-network-diagnostics/network-check-target-gvkjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:46.523341 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:46.523200    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz podName:30555d21-2d4a-4d0d-b577-0b276cddc611 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:47.023179566 +0000 UTC m=+3.074667242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s9pdz" (UniqueName: "kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz") pod "network-check-target-gvkjx" (UID: "30555d21-2d4a-4d0d-b577-0b276cddc611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:46.525492 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.525456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg9pm\" (UniqueName: \"kubernetes.io/projected/4e2df668-b1e8-46fa-a223-b46caf31083a-kube-api-access-sg9pm\") pod \"multus-additional-cni-plugins-qs29m\" (UID: \"4e2df668-b1e8-46fa-a223-b46caf31083a\") " pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:46.525580 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.525523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrf5w\" (UniqueName: \"kubernetes.io/projected/ab616912-95c1-49a0-ae84-cc6f101ec617-kube-api-access-lrf5w\") pod \"aws-ebs-csi-driver-node-qwpck\" (UID: \"ab616912-95c1-49a0-ae84-cc6f101ec617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.526858 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.526572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q97c\" (UniqueName: \"kubernetes.io/projected/9a8275bb-663f-4f94-9e4f-295070eeac5c-kube-api-access-8q97c\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:46.527105 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.527085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75ld5\" (UniqueName: \"kubernetes.io/projected/9c44f229-aabd-42ce-bdb0-19ce7a2a1c34-kube-api-access-75ld5\") pod \"node-resolver-l4tck\" (UID: \"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34\") " pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.603855 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.603775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:01:46.612705 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.612678    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8s22f"
Aug 05 19:01:46.616438 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:46.616409    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18e7dd7_f510_4d73_8ec0_117463e1f27a.slice/crio-2cd7201033efa25c1ed4554aa549f083e2e55a29ae758ef8c96b0719aa45a6be WatchSource:0}: Error finding container 2cd7201033efa25c1ed4554aa549f083e2e55a29ae758ef8c96b0719aa45a6be: Status 404 returned error can't find the container with id 2cd7201033efa25c1ed4554aa549f083e2e55a29ae758ef8c96b0719aa45a6be
Aug 05 19:01:46.622216 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:46.622187    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73fd2155_1e97_4286_9fc6_217dbdd53c9e.slice/crio-6b2eeb3f892621529d0c16f7f26a60366f34852b475409e19a4c961116a09c09 WatchSource:0}: Error finding container 6b2eeb3f892621529d0c16f7f26a60366f34852b475409e19a4c961116a09c09: Status 404 returned error can't find the container with id 6b2eeb3f892621529d0c16f7f26a60366f34852b475409e19a4c961116a09c09
Aug 05 19:01:46.623518 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.623326    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tkgft"
Aug 05 19:01:46.630030 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.630008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6mts"
Aug 05 19:01:46.638017 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.637993    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sf5cb"
Aug 05 19:01:46.646228 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.646042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck"
Aug 05 19:01:46.653996 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.653973    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:01:46.667999 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.667971    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4tck"
Aug 05 19:01:46.675163 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:46.675132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qs29m"
Aug 05 19:01:47.021331 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.021242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:47.021331 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.021316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:47.021487 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.021378    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:47.021487 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.021412    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:47.021487 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.021452    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret podName:bee8cc76-3bea-4cb9-ac15-a9de8deadbea nodeName:}" failed. No retries permitted until 2026-08-05 19:01:48.021432835 +0000 UTC m=+4.072920510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret") pod "global-pull-secret-syncer-bp8tx" (UID: "bee8cc76-3bea-4cb9-ac15-a9de8deadbea") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:47.021487 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.021469    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs podName:9a8275bb-663f-4f94-9e4f-295070eeac5c nodeName:}" failed. No retries permitted until 2026-08-05 19:01:48.021461186 +0000 UTC m=+4.072948858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs") pod "network-metrics-daemon-v45rm" (UID: "9a8275bb-663f-4f94-9e4f-295070eeac5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:47.030034 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.030005    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:47.121682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.121640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:47.121857 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.121835    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:47.121912 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.121868    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:47.121912 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.121883    2558 projected.go:196] Error preparing data for projected volume kube-api-access-s9pdz for pod openshift-network-diagnostics/network-check-target-gvkjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:47.121982 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.121952    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz podName:30555d21-2d4a-4d0d-b577-0b276cddc611 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:48.121931118 +0000 UTC m=+4.173418803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s9pdz" (UniqueName: "kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz") pod "network-check-target-gvkjx" (UID: "30555d21-2d4a-4d0d-b577-0b276cddc611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:47.340546 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.340432    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 18:56:46 +0000 UTC" deadline="2028-01-14 02:43:33.271331658 +0000 UTC"
Aug 05 19:01:47.340546 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.340486    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12631h41m45.930851518s"
Aug 05 19:01:47.470416 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.470381    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:47.470598 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:47.470515    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:01:47.480784 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.480753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8s22f" event={"ID":"73fd2155-1e97-4286-9fc6-217dbdd53c9e","Type":"ContainerStarted","Data":"6b2eeb3f892621529d0c16f7f26a60366f34852b475409e19a4c961116a09c09"}
Aug 05 19:01:47.482082 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:47.482044    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"2cd7201033efa25c1ed4554aa549f083e2e55a29ae758ef8c96b0719aa45a6be"}
Aug 05 19:01:47.761083 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:47.761046    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd90924_d716_4f52_944b_71fc7786b355.slice/crio-dee1fdc4af22b6c2bb80e95728afd337c7c0fcff329c44b8b2ee353e4f39bf42 WatchSource:0}: Error finding container dee1fdc4af22b6c2bb80e95728afd337c7c0fcff329c44b8b2ee353e4f39bf42: Status 404 returned error can't find the container with id dee1fdc4af22b6c2bb80e95728afd337c7c0fcff329c44b8b2ee353e4f39bf42
Aug 05 19:01:47.762375 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:47.762352    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab616912_95c1_49a0_ae84_cc6f101ec617.slice/crio-46d65b54fb42f3acf1c8feb4bd33ba5415e338ed41d504f75e573d420e9d9a2a WatchSource:0}: Error finding container 46d65b54fb42f3acf1c8feb4bd33ba5415e338ed41d504f75e573d420e9d9a2a: Status 404 returned error can't find the container with id 46d65b54fb42f3acf1c8feb4bd33ba5415e338ed41d504f75e573d420e9d9a2a
Aug 05 19:01:47.769118 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:47.769097    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f8a755_15c7_4719_8733_88c25d7fd7d6.slice/crio-00f303905a53c7de5b27ea7b14d851c343bb14c38080534377876d9891587ee5 WatchSource:0}: Error finding container 00f303905a53c7de5b27ea7b14d851c343bb14c38080534377876d9891587ee5: Status 404 returned error can't find the container with id 00f303905a53c7de5b27ea7b14d851c343bb14c38080534377876d9891587ee5
Aug 05 19:01:47.769825 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:47.769800    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb085e157_f603_495e_bdf9_444933187a8d.slice/crio-27fcc77dc3847207ea19f6a439058d9a32290c78e0c0c3f5a7a6cf507884dc8b WatchSource:0}: Error finding container 27fcc77dc3847207ea19f6a439058d9a32290c78e0c0c3f5a7a6cf507884dc8b: Status 404 returned error can't find the container with id 27fcc77dc3847207ea19f6a439058d9a32290c78e0c0c3f5a7a6cf507884dc8b
Aug 05 19:01:47.771451 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:47.771425    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c44f229_aabd_42ce_bdb0_19ce7a2a1c34.slice/crio-ea1371294051b0b8e1d51567857d8bca55f1d2e43dfa6128865e95b2f387cea7 WatchSource:0}: Error finding container ea1371294051b0b8e1d51567857d8bca55f1d2e43dfa6128865e95b2f387cea7: Status 404 returned error can't find the container with id ea1371294051b0b8e1d51567857d8bca55f1d2e43dfa6128865e95b2f387cea7
Aug 05 19:01:47.772586 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:01:47.772561    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46251e5a_cf58_43b3_a870_244f3579eb5b.slice/crio-cfc4bdf2697322cfe7a3ef080f306eaead9dbac69557732605df9ed0f2f33811 WatchSource:0}: Error finding container cfc4bdf2697322cfe7a3ef080f306eaead9dbac69557732605df9ed0f2f33811: Status 404 returned error can't find the container with id cfc4bdf2697322cfe7a3ef080f306eaead9dbac69557732605df9ed0f2f33811
Aug 05 19:01:48.029745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.029169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:48.029745 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.029456    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:48.029745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.029487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:48.029745 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.029526    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret podName:bee8cc76-3bea-4cb9-ac15-a9de8deadbea nodeName:}" failed. No retries permitted until 2026-08-05 19:01:50.029506115 +0000 UTC m=+6.080993799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret") pod "global-pull-secret-syncer-bp8tx" (UID: "bee8cc76-3bea-4cb9-ac15-a9de8deadbea") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:48.029745 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.029616    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:48.029745 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.029669    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs podName:9a8275bb-663f-4f94-9e4f-295070eeac5c nodeName:}" failed. No retries permitted until 2026-08-05 19:01:50.029652847 +0000 UTC m=+6.081140521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs") pod "network-metrics-daemon-v45rm" (UID: "9a8275bb-663f-4f94-9e4f-295070eeac5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:48.130531 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.130020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:48.130531 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.130176    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:48.130531 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.130190    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:48.130531 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.130199    2558 projected.go:196] Error preparing data for projected volume kube-api-access-s9pdz for pod openshift-network-diagnostics/network-check-target-gvkjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:48.130531 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.130265    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz podName:30555d21-2d4a-4d0d-b577-0b276cddc611 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:50.130246923 +0000 UTC m=+6.181734594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s9pdz" (UniqueName: "kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz") pod "network-check-target-gvkjx" (UID: "30555d21-2d4a-4d0d-b577-0b276cddc611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:48.341413 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.341307    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 18:56:46 +0000 UTC" deadline="2028-04-13 21:27:52.304648002 +0000 UTC"
Aug 05 19:01:48.341413 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.341364    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14810h26m3.963287728s"
Aug 05 19:01:48.472401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.472368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:48.472561 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.472494    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:01:48.472903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.472883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:48.472988 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:48.472960    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:01:48.485995 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.485953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4tck" event={"ID":"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34","Type":"ContainerStarted","Data":"ea1371294051b0b8e1d51567857d8bca55f1d2e43dfa6128865e95b2f387cea7"}
Aug 05 19:01:48.488115 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.488081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-485xc" event={"ID":"b085e157-f603-495e-bdf9-444933187a8d","Type":"ContainerStarted","Data":"27fcc77dc3847207ea19f6a439058d9a32290c78e0c0c3f5a7a6cf507884dc8b"}
Aug 05 19:01:48.489927 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.489898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6mts" event={"ID":"55f8a755-15c7-4719-8733-88c25d7fd7d6","Type":"ContainerStarted","Data":"00f303905a53c7de5b27ea7b14d851c343bb14c38080534377876d9891587ee5"}
Aug 05 19:01:48.491563 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.491536    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sf5cb" event={"ID":"dcd90924-d716-4f52-944b-71fc7786b355","Type":"ContainerStarted","Data":"dee1fdc4af22b6c2bb80e95728afd337c7c0fcff329c44b8b2ee353e4f39bf42"}
Aug 05 19:01:48.495825 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.495638    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f2e2710f910ca2e5499e4e7beb60e27" containerID="8358054fc270007cf351d15510cd5c5964c08efd5a37f2fc3b71dc648bc8c161" exitCode=0
Aug 05 19:01:48.495825 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.495736    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" event={"ID":"1f2e2710f910ca2e5499e4e7beb60e27","Type":"ContainerDied","Data":"8358054fc270007cf351d15510cd5c5964c08efd5a37f2fc3b71dc648bc8c161"}
Aug 05 19:01:48.502417 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.501933    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" event={"ID":"300ceb00d8c140e964e4979aab4ccdce","Type":"ContainerStarted","Data":"f996374ba4d85f38fa2b4fc9f728a4f371fab62554cf724d7300df4c06b165f7"}
Aug 05 19:01:48.504156 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.504131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tkgft" event={"ID":"46251e5a-cf58-43b3-a870-244f3579eb5b","Type":"ContainerStarted","Data":"cfc4bdf2697322cfe7a3ef080f306eaead9dbac69557732605df9ed0f2f33811"}
Aug 05 19:01:48.507061 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.507035    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerStarted","Data":"da766c2c1da1435d3194e4afb819cb29e335a36f0292d5a30c35795639b130af"}
Aug 05 19:01:48.514580 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:48.514550    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck" event={"ID":"ab616912-95c1-49a0-ae84-cc6f101ec617","Type":"ContainerStarted","Data":"46d65b54fb42f3acf1c8feb4bd33ba5415e338ed41d504f75e573d420e9d9a2a"}
Aug 05 19:01:49.470545 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:49.470515    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:49.471017 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:49.470642    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:01:49.524988 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:49.524955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" event={"ID":"1f2e2710f910ca2e5499e4e7beb60e27","Type":"ContainerStarted","Data":"848561f1b3d7deae5cb5552914e1ccca94625563c74eeea96b0873994248fbd6"}
Aug 05 19:01:49.540235 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:49.539786    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" podStartSLOduration=4.539766043 podStartE2EDuration="4.539766043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:48.523604568 +0000 UTC m=+4.575092264" watchObservedRunningTime="2026-08-05 19:01:49.539766043 +0000 UTC m=+5.591253740"
Aug 05 19:01:50.047145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:50.047111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:50.047391 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:50.047157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:50.047391 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.047248    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:50.047391 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.047284    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:50.047391 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.047327    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret podName:bee8cc76-3bea-4cb9-ac15-a9de8deadbea nodeName:}" failed. No retries permitted until 2026-08-05 19:01:54.047305278 +0000 UTC m=+10.098792964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret") pod "global-pull-secret-syncer-bp8tx" (UID: "bee8cc76-3bea-4cb9-ac15-a9de8deadbea") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:50.047391 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.047349    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs podName:9a8275bb-663f-4f94-9e4f-295070eeac5c nodeName:}" failed. No retries permitted until 2026-08-05 19:01:54.04733888 +0000 UTC m=+10.098826734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs") pod "network-metrics-daemon-v45rm" (UID: "9a8275bb-663f-4f94-9e4f-295070eeac5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:50.148353 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:50.148317    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:50.148524 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.148511    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:50.148562 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.148533    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:50.148562 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.148542    2558 projected.go:196] Error preparing data for projected volume kube-api-access-s9pdz for pod openshift-network-diagnostics/network-check-target-gvkjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:50.148641 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.148586    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz podName:30555d21-2d4a-4d0d-b577-0b276cddc611 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:54.148573075 +0000 UTC m=+10.200060746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s9pdz" (UniqueName: "kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz") pod "network-check-target-gvkjx" (UID: "30555d21-2d4a-4d0d-b577-0b276cddc611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:50.470470 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:50.470345    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:50.470813 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.470481    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:01:50.470813 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:50.470345    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:50.470813 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:50.470654    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:01:51.469921 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:51.469885    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:51.470112 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:51.470026    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:01:52.470955 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:52.470294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:52.470955 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:52.470431    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:01:52.470955 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:52.470819    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:52.470955 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:52.470906    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:01:53.469997 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:53.469966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:53.470170 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:53.470074    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:01:54.083561 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:54.082915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:54.083561 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:54.082956    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:54.083561 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.083065    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:54.083561 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.083118    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs podName:9a8275bb-663f-4f94-9e4f-295070eeac5c nodeName:}" failed. No retries permitted until 2026-08-05 19:02:02.083103241 +0000 UTC m=+18.134590914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs") pod "network-metrics-daemon-v45rm" (UID: "9a8275bb-663f-4f94-9e4f-295070eeac5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:54.083561 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.083484    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:54.083561 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.083524    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret podName:bee8cc76-3bea-4cb9-ac15-a9de8deadbea nodeName:}" failed. No retries permitted until 2026-08-05 19:02:02.083513437 +0000 UTC m=+18.135001107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret") pod "global-pull-secret-syncer-bp8tx" (UID: "bee8cc76-3bea-4cb9-ac15-a9de8deadbea") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:54.183392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:54.183354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:54.183594 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.183504    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:54.183594 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.183531    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:54.183594 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.183544    2558 projected.go:196] Error preparing data for projected volume kube-api-access-s9pdz for pod openshift-network-diagnostics/network-check-target-gvkjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:54.183736 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.183604    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz podName:30555d21-2d4a-4d0d-b577-0b276cddc611 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:02.183589438 +0000 UTC m=+18.235077112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s9pdz" (UniqueName: "kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz") pod "network-check-target-gvkjx" (UID: "30555d21-2d4a-4d0d-b577-0b276cddc611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:54.470871 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:54.470791    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:54.471032 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.470942    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:01:54.471032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:54.470985    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:54.471141 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:54.471057    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:01:55.470980 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:55.470461    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:55.470980 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:55.470603    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:01:56.472125 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:56.472096    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:56.472567 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:56.472212    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:01:56.472642 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:56.472578    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:56.472695 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:56.472674    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:01:57.469675 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:57.469643    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:57.469830 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:57.469749    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:01:58.470648 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:58.470611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:01:58.471093 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:58.470665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:01:58.471093 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:58.470778    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:01:58.471093 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:58.470923    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:01:59.470136 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:01:59.470105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:01:59.470307 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:01:59.470216    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:00.470562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:00.470520    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:00.471036 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:00.470566    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:00.471036 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:00.470664    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:00.471168 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:00.471088    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:01.470361 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:01.470327    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:01.470633 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:01.470461    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:02.144397 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:02.144360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:02.144397 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:02.144404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:02.144662 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.144525    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:02:02.144662 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.144581    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret podName:bee8cc76-3bea-4cb9-ac15-a9de8deadbea nodeName:}" failed. No retries permitted until 2026-08-05 19:02:18.144565099 +0000 UTC m=+34.196052770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret") pod "global-pull-secret-syncer-bp8tx" (UID: "bee8cc76-3bea-4cb9-ac15-a9de8deadbea") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:02:02.144662 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.144525    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:02:02.144662 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.144639    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs podName:9a8275bb-663f-4f94-9e4f-295070eeac5c nodeName:}" failed. No retries permitted until 2026-08-05 19:02:18.144627758 +0000 UTC m=+34.196115431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs") pod "network-metrics-daemon-v45rm" (UID: "9a8275bb-663f-4f94-9e4f-295070eeac5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:02:02.245706 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:02.245673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:02.245883 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.245852    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:02:02.245883 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.245875    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:02:02.246020 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.245886    2558 projected.go:196] Error preparing data for projected volume kube-api-access-s9pdz for pod openshift-network-diagnostics/network-check-target-gvkjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:02:02.246020 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.245938    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz podName:30555d21-2d4a-4d0d-b577-0b276cddc611 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:18.245922552 +0000 UTC m=+34.297410222 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s9pdz" (UniqueName: "kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz") pod "network-check-target-gvkjx" (UID: "30555d21-2d4a-4d0d-b577-0b276cddc611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:02:02.470337 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:02.470244    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:02.470514 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.470397    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:02.470737 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:02.470250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:02.471120 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:02.470827    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:03.470279 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:03.470247    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:03.470460 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:03.470358    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:04.471001 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:04.470956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:04.471508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:04.471045    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:04.471508 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:04.471066    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:04.471508 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:04.471140    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:05.470305 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:05.470276    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:05.470491 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:05.470390    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:06.472160 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.471998    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:06.473099 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:06.472979    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:06.473099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.472047    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:06.473099 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:06.473074    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:06.557612 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.557435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"3971b56dec3fc03e810730bbe606e9f52b468eb170419360d4c27a24c2677a22"}
Aug 05 19:02:06.557745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.557671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"6e77bb126957c9c5cdc418bc9e8409539fef5e466d53debe21092f60d41b0653"}
Aug 05 19:02:06.558824 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.558801    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tkgft" event={"ID":"46251e5a-cf58-43b3-a870-244f3579eb5b","Type":"ContainerStarted","Data":"c6d08a43ac155edb94d95d018633ee06ac7255fd50baf9b4535cf6445be9460a"}
Aug 05 19:02:06.560415 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.560392    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e2df668-b1e8-46fa-a223-b46caf31083a" containerID="86e6dbde2eb322cd03fd593e6e51fe621baf6af4139655db3e4a92dbbe607850" exitCode=0
Aug 05 19:02:06.561598 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.560474    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerDied","Data":"86e6dbde2eb322cd03fd593e6e51fe621baf6af4139655db3e4a92dbbe607850"}
Aug 05 19:02:06.562087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.562045    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck" event={"ID":"ab616912-95c1-49a0-ae84-cc6f101ec617","Type":"ContainerStarted","Data":"65396e2edfcd89964af29ad124e8609544c381f7ec5b6dcda5b1f87c45d3b059"}
Aug 05 19:02:06.563726 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.563702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8s22f" event={"ID":"73fd2155-1e97-4286-9fc6-217dbdd53c9e","Type":"ContainerStarted","Data":"3ff16786da45978f5a1272a02ef06ed92bcfc63ca251fbbb8cbb13f6d5e9e1af"}
Aug 05 19:02:06.565147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.565123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4tck" event={"ID":"9c44f229-aabd-42ce-bdb0-19ce7a2a1c34","Type":"ContainerStarted","Data":"b8cf8c916eb8e0aad76baa63c8bbf9f3ddb5968b5cc537e4c639b24ebcc445a8"}
Aug 05 19:02:06.566504 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.566483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-485xc" event={"ID":"b085e157-f603-495e-bdf9-444933187a8d","Type":"ContainerStarted","Data":"fee5edec1c7df308bc6707eb37d3c8068dc794abb28b7807f6eeb2e5533f6cf3"}
Aug 05 19:02:06.568427 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.568402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6mts" event={"ID":"55f8a755-15c7-4719-8733-88c25d7fd7d6","Type":"ContainerStarted","Data":"94069e18df8536e2f2fd1175744b6526448c8fdd557db08102c6e08bba09a561"}
Aug 05 19:02:06.576403 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.576353    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" podStartSLOduration=21.576340183 podStartE2EDuration="21.576340183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:49.540336999 +0000 UTC m=+5.591824692" watchObservedRunningTime="2026-08-05 19:02:06.576340183 +0000 UTC m=+22.627827875"
Aug 05 19:02:06.577124 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.577091    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tkgft" podStartSLOduration=4.115409248 podStartE2EDuration="22.577080787s" totalImagesPullingTime="18.461671539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:06.576157346 +0000 UTC m=+22.627645038" watchObservedRunningTime="2026-08-05 19:02:06.577080787 +0000 UTC m=+22.628568478"
Aug 05 19:02:06.591776 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.591738    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l4tck" podStartSLOduration=4.14723139 podStartE2EDuration="22.591724633s" totalImagesPullingTime="18.444493243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:06.591628141 +0000 UTC m=+22.643115832" watchObservedRunningTime="2026-08-05 19:02:06.591724633 +0000 UTC m=+22.643212325"
Aug 05 19:02:06.605166 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.605121    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-485xc" podStartSLOduration=8.273133854 podStartE2EDuration="22.605106714s" totalImagesPullingTime="14.33197286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:06.604740232 +0000 UTC m=+22.656227924" watchObservedRunningTime="2026-08-05 19:02:06.605106714 +0000 UTC m=+22.656594405"
Aug 05 19:02:06.648618 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.648570    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8s22f" podStartSLOduration=2.992808719 podStartE2EDuration="22.648550577s" totalImagesPullingTime="19.655741858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:06.648251547 +0000 UTC m=+22.699739230" watchObservedRunningTime="2026-08-05 19:02:06.648550577 +0000 UTC m=+22.700038270"
Aug 05 19:02:06.662238 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.662197    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h6mts" podStartSLOduration=8.329723398 podStartE2EDuration="22.662163074s" totalImagesPullingTime="14.332439676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:06.661821385 +0000 UTC m=+22.713309077" watchObservedRunningTime="2026-08-05 19:02:06.662163074 +0000 UTC m=+22.713650765"
Aug 05 19:02:06.969078 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:06.969038    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:07.027453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.027381    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4tck_9c44f229-aabd-42ce-bdb0-19ce7a2a1c34/dns-node-resolver/0.log"
Aug 05 19:02:07.049562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.049524    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:07.470540 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.470464    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:07.470696 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:07.470585    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:07.574737 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.574699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"56b3c55c07237f725a83d4cae0f2cb04cea18b85ede38e4159d318519db62f26"}
Aug 05 19:02:07.575234 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.574779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"7339b1e883ac4a591693308c981cc261b8aa33ab5dc315c5dfd51150e2721e6a"}
Aug 05 19:02:07.575234 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.574830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"55de43927bf34332a25491cd970dd7492156a560c288d3eab21e9a75bfdc78d1"}
Aug 05 19:02:07.575234 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.574913    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"9946a6938cc7eaa455d4b3135523f04899906988b58ca1c1cb352620c08770ce"}
Aug 05 19:02:07.699698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.699664    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:07.807638 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.807592    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:07.824326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.824303    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6mts_55f8a755-15c7-4719-8733-88c25d7fd7d6/node-ca/0.log"
Aug 05 19:02:07.879593 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.879566    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 19:02:07.898195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.898095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:07.991540 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.991510    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:02:07.992139 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:07.992081    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:02:08.064637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.064603    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:08.126958 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.126921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:08.365114 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.364972    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T19:02:07.879589851Z","UUID":"419f1215-c2e2-48a0-a450-d4f4b9200566","Handler":null,"Name":"","Endpoint":""}
Aug 05 19:02:08.366716 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.366696    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 19:02:08.366853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.366737    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 19:02:08.469806 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.469772    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:08.469972 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:08.469926    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:08.470034 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.469991    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:08.470125 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:08.470098    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:08.578753 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.578714    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sf5cb" event={"ID":"dcd90924-d716-4f52-944b-71fc7786b355","Type":"ContainerStarted","Data":"b2b26f8f03d3a75bcee8ada6e65d1ae32211083d93426c36aefac226b2787dee"}
Aug 05 19:02:08.580757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.580726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck" event={"ID":"ab616912-95c1-49a0-ae84-cc6f101ec617","Type":"ContainerStarted","Data":"a6d1175ee4e54ed2e2d0822e6168ab807ba3a5eb281f647e7bbe1c15d638008c"}
Aug 05 19:02:08.580998 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.580985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:02:08.581523 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.581505    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-485xc"
Aug 05 19:02:08.603371 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.603327    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sf5cb" podStartSLOduration=6.145441355 podStartE2EDuration="24.603311635s" totalImagesPullingTime="18.45787028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:08.602741276 +0000 UTC m=+24.654228969" watchObservedRunningTime="2026-08-05 19:02:08.603311635 +0000 UTC m=+24.654799328"
Aug 05 19:02:08.966039 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:08.966009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:09.469626 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:09.469595    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:09.469823 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:09.469718    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:09.587213 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:09.587163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"695653b0b0c2f18a9540d5fbc5d0ce047a1c3717af27520323ccc1ad910f6921"}
Aug 05 19:02:09.713023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:09.712973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:09.877054 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:09.876946    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:09.955588 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:09.955531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:10.061319 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:10.061288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:10.188405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:10.188327    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:10.265631 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:10.265594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:10.395750 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:10.395706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:10.470316 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:10.470024    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:10.470483 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:10.470033    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:10.470483 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:10.470381    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:10.470483 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:10.470430    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:11.470323 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.470080    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:11.470987 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:11.470348    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:11.593865 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.593841    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:11.595865 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.595841    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" event={"ID":"f18e7dd7-f510-4d73-8ec0-117463e1f27a","Type":"ContainerStarted","Data":"5d908e04bf5f5026d1cb0260f54696b08f908899eb2b3295820019905af5d6a1"}
Aug 05 19:02:11.596133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.596112    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:02:11.596223 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.596203    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:02:11.596282 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.596251    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:02:11.597792 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.597765    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e2df668-b1e8-46fa-a223-b46caf31083a" containerID="a6ea7a3e8b3ca53630863da79cacc90d02835f6a9cc92a4dc67e1f561efa8b20" exitCode=0
Aug 05 19:02:11.597953 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.597792    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerDied","Data":"a6ea7a3e8b3ca53630863da79cacc90d02835f6a9cc92a4dc67e1f561efa8b20"}
Aug 05 19:02:11.613363 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.613341    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:02:11.614003 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.613986    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:02:11.622334 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:11.622288    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz" podStartSLOduration=7.951418246 podStartE2EDuration="27.622275507s" totalImagesPullingTime="19.670857261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:11.620892019 +0000 UTC m=+27.672379722" watchObservedRunningTime="2026-08-05 19:02:11.622275507 +0000 UTC m=+27.673763198"
Aug 05 19:02:12.470321 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:12.470289    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:12.470852 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:12.470333    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:12.470852 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:12.470426    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:12.470852 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:12.470542    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:12.605351 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:12.605272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck" event={"ID":"ab616912-95c1-49a0-ae84-cc6f101ec617","Type":"ContainerStarted","Data":"a07c99a0196c675c85e2b7b81734836508e7c0ca49f36c9983e269ae0c33646d"}
Aug 05 19:02:12.623346 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:12.623298    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwpck" podStartSLOduration=5.153457652 podStartE2EDuration="28.623283287s" totalImagesPullingTime="23.469825635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:12.622801072 +0000 UTC m=+28.674288763" watchObservedRunningTime="2026-08-05 19:02:12.623283287 +0000 UTC m=+28.674770978"
Aug 05 19:02:12.904301 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:12.904262    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:13.006954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.006924    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:13.309170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.309088    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:13.409479 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.409441    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:13.469866 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.469832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:13.470019 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:13.469940    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:13.509858 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.509825    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:13.609774 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.609699    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e2df668-b1e8-46fa-a223-b46caf31083a" containerID="8e88f16952613b7a4ee97774a60d77cec7c76af807e0637b4409a12eb3d0f153" exitCode=0
Aug 05 19:02:13.609926 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.609787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerDied","Data":"8e88f16952613b7a4ee97774a60d77cec7c76af807e0637b4409a12eb3d0f153"}
Aug 05 19:02:13.792309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.792276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:13.995870 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:13.995784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:14.192815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:14.192781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:14.245457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:14.245426    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:14.396220 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:14.396116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:14.471780 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:14.471744    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:14.471923 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:14.471874    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:14.471923 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:14.471915    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:14.472018 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:14.471999    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:15.390493 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:15.390460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:15.470509 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:15.470474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:15.470667 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:15.470579    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:15.491584 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:15.491549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:15.615916 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:15.615886    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e2df668-b1e8-46fa-a223-b46caf31083a" containerID="11515a45b9545588c5cf4086d1093e1815eb5fdde6dcc6a4685678bc358dbc52" exitCode=0
Aug 05 19:02:15.616072 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:15.615939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerDied","Data":"11515a45b9545588c5cf4086d1093e1815eb5fdde6dcc6a4685678bc358dbc52"}
Aug 05 19:02:15.788073 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:15.787986    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:16.000744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:16.000715    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:16.205328 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:16.205252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:16.390980 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:16.390928    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:16.470362 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:16.470275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:16.470362 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:16.470325    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:16.470597 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:16.470425    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:16.470597 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:16.470564    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:17.193090 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:17.193058    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:17.469649 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:17.469577    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:17.470092 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:17.469685    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:17.802373 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:17.802266    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:17.989269 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:17.989226    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:18.166963 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.166755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:18.166963 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.166864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:18.166963 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.166919    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:02:18.167228 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.166987    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs podName:9a8275bb-663f-4f94-9e4f-295070eeac5c nodeName:}" failed. No retries permitted until 2026-08-05 19:02:50.166969099 +0000 UTC m=+66.218456773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs") pod "network-metrics-daemon-v45rm" (UID: "9a8275bb-663f-4f94-9e4f-295070eeac5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:02:18.167228 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.166998    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:02:18.167228 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.167054    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret podName:bee8cc76-3bea-4cb9-ac15-a9de8deadbea nodeName:}" failed. No retries permitted until 2026-08-05 19:02:50.167037798 +0000 UTC m=+66.218525467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret") pod "global-pull-secret-syncer-bp8tx" (UID: "bee8cc76-3bea-4cb9-ac15-a9de8deadbea") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:02:18.197947 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.197907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:18.267688 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.267649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:18.267850 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.267797    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:02:18.267850 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.267818    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:02:18.267850 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.267829    2558 projected.go:196] Error preparing data for projected volume kube-api-access-s9pdz for pod openshift-network-diagnostics/network-check-target-gvkjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:02:18.268020 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.267895    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz podName:30555d21-2d4a-4d0d-b577-0b276cddc611 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:50.267877065 +0000 UTC m=+66.319364738 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s9pdz" (UniqueName: "kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz") pod "network-check-target-gvkjx" (UID: "30555d21-2d4a-4d0d-b577-0b276cddc611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:02:18.357960 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.357906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:18.409881 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.409842    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:18.470283 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.470192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:18.470283 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.470237    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:18.470815 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.470341    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:18.470815 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:18.470471    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:18.842502 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.842418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:18.943280 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:18.943252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:19.388060 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:19.388026    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:19.470280 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:19.470240    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:19.470751 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:19.470379    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:19.591906 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:19.591878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:19.693014 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:19.692917    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:19.794675 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:19.794649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:19.994522 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:19.994496    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:20.388129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:20.388035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:20.470044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:20.470010    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:20.470234 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:20.470158    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:20.470234 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:20.470202    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:20.470315 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:20.470288    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:20.570110 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:20.570070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:20.629969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:20.629935    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e2df668-b1e8-46fa-a223-b46caf31083a" containerID="040dee29021cd52588858892c5bc8482ffd0d617ba54a60ebb0e65613303e30d" exitCode=0
Aug 05 19:02:20.630160 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:20.629981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerDied","Data":"040dee29021cd52588858892c5bc8482ffd0d617ba54a60ebb0e65613303e30d"}
Aug 05 19:02:21.469781 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:21.469747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:21.469934 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:21.469861    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:21.635242 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:21.635205    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e2df668-b1e8-46fa-a223-b46caf31083a" containerID="b23a8ec184109499772f1ba4f45a0fbe59e0f5b021c4b0b2427e6ca1c71e3fa2" exitCode=0
Aug 05 19:02:21.635583 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:21.635276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerDied","Data":"b23a8ec184109499772f1ba4f45a0fbe59e0f5b021c4b0b2427e6ca1c71e3fa2"}
Aug 05 19:02:22.033773 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.033594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:22.133923 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.133890    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:22.188763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.188731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:22.328682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.328609    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:22.469910 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.469879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:22.470094 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.469882    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:22.470094 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:22.469996    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:22.470094 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:22.470057    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:22.640551 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.640463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qs29m" event={"ID":"4e2df668-b1e8-46fa-a223-b46caf31083a","Type":"ContainerStarted","Data":"e9faa8ff58cfe66301cc03d76679aadde10efd9f0264b279e195504dfc185ae5"}
Aug 05 19:02:22.661942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.661889    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qs29m" podStartSLOduration=9.266557334 podStartE2EDuration="38.661872989s" totalImagesPullingTime="29.395315655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:22.660595143 +0000 UTC m=+38.712082835" watchObservedRunningTime="2026-08-05 19:02:22.661872989 +0000 UTC m=+38.713360681"
Aug 05 19:02:22.711190 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.711152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:22.812297 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:22.812265    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:23.109871 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:23.109834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:23.299758 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:23.299723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:23.470579 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:23.470500    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:23.470722 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:23.470623    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:23.920743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:23.920710    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:24.120128 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:24.120098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:24.343365 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:24.343331    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:24.443718 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:24.443685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:24.470301 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:24.470274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:24.470439 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:24.470363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:24.470487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:24.470470    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:24.470596 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:24.470575    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:24.625136 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:24.625051    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:24.681698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:24.681662    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:25.469510 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:25.469461    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:25.469953 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:25.469603    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:26.469709 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:26.469669    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:26.469709 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:26.469691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:26.470131 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:26.469818    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:26.470131 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:26.469917    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:27.470039 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:27.470012    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:27.470441 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:27.470110    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:28.469563 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:28.469527    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:28.469806 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:28.469638    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:28.469806 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:28.469693    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:28.469806 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:28.469778    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:29.470354 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:29.470321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:29.470743 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:29.470420    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:29.845740 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:29.845706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:29.914398 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:29.914369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:30.014832 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:30.014787    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:30.114814 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:30.114722    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:30.213900 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:30.213867    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:30.470322 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:30.470247    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:30.470475 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:30.470248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:30.470475 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:30.470352    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:30.470475 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:30.470440    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:30.741492 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:30.741393    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:30.845113 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:30.845085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:31.022946 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.022907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:31.119620 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.119583    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:31.404363 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.404321    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp8tx"]
Aug 05 19:02:31.404536 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.404430    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:31.404615 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:31.404531    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:31.407591 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.407567    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v45rm"]
Aug 05 19:02:31.407843 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.407824    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:31.407973 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:31.407938    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:31.408483 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.408461    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvkjx"]
Aug 05 19:02:31.408567 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:31.408548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:31.408653 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:31.408634    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:32.777467 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:32.777427    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:32.877422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:32.877382    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:33.470287 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:33.470254    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:33.470456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:33.470266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:33.470456 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:33.470392    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkjx" podUID="30555d21-2d4a-4d0d-b577-0b276cddc611"
Aug 05 19:02:33.470456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:33.470268    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:33.470456 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:33.470439    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp8tx" podUID="bee8cc76-3bea-4cb9-ac15-a9de8deadbea"
Aug 05 19:02:33.470631 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:33.470533    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v45rm" podUID="9a8275bb-663f-4f94-9e4f-295070eeac5c"
Aug 05 19:02:35.222170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.221987    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeReady"
Aug 05 19:02:35.222524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.222276    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 19:02:35.270940 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.270909    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6bzq5"]
Aug 05 19:02:35.293271 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.293245    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6c9v7"]
Aug 05 19:02:35.293470 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.293368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.297865 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.297728    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 19:02:35.298006 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.297907    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 19:02:35.298071 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.298016    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 19:02:35.298490 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.298355    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s6kl2\""
Aug 05 19:02:35.311415 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.311391    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bzq5"]
Aug 05 19:02:35.311499 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.311421    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c9v7"]
Aug 05 19:02:35.311499 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.311441    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n8vl7"]
Aug 05 19:02:35.311582 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.311496    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.313887 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.313843    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 19:02:35.314099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.314073    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 19:02:35.314791 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.314134    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 19:02:35.314791 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.314160    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gsd7c\""
Aug 05 19:02:35.314791 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.314073    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 19:02:35.329564 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.329542    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8vl7"]
Aug 05 19:02:35.329664 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.329646    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.331790 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.331773    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 19:02:35.331989 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.331773    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6qmv\""
Aug 05 19:02:35.331989 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.331816    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 19:02:35.392051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c28d8d99-35ea-49e3-a327-964b9d63b870-config-volume\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.392051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28d8d99-35ea-49e3-a327-964b9d63b870-tmp-dir\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.392341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.392341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28d8d99-35ea-49e3-a327-964b9d63b870-metrics-tls\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.392341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-crio-socket\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.392341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6x9\" (UniqueName: \"kubernetes.io/projected/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-kube-api-access-zl6x9\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.392341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-data-volume\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.392341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.392570 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8xw\" (UniqueName: \"kubernetes.io/projected/c28d8d99-35ea-49e3-a327-964b9d63b870-kube-api-access-ng8xw\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.392570 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb30e3e-6611-4d30-a64d-a2ea5f7d709b-cert\") pod \"ingress-canary-6bzq5\" (UID: \"deb30e3e-6611-4d30-a64d-a2ea5f7d709b\") " pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.392570 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.392411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stct4\" (UniqueName: \"kubernetes.io/projected/deb30e3e-6611-4d30-a64d-a2ea5f7d709b-kube-api-access-stct4\") pod \"ingress-canary-6bzq5\" (UID: \"deb30e3e-6611-4d30-a64d-a2ea5f7d709b\") " pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.396506 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.396473    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:35.470443 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.470402    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:35.470605 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.470454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:35.470605 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.470409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:35.473071 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.472952    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 19:02:35.473205 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.473103    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 19:02:35.473205 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.473141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk5vf\""
Aug 05 19:02:35.473369 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.473277    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7thz\""
Aug 05 19:02:35.473369 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.473291    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 19:02:35.473369 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.473325    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 19:02:35.492895 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.492877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c28d8d99-35ea-49e3-a327-964b9d63b870-config-volume\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.492990 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.492900    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28d8d99-35ea-49e3-a327-964b9d63b870-tmp-dir\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.492990 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.492930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.492990 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.492947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28d8d99-35ea-49e3-a327-964b9d63b870-metrics-tls\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.492990 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.492969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-crio-socket\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.493194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6x9\" (UniqueName: \"kubernetes.io/projected/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-kube-api-access-zl6x9\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.493194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493027    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-data-volume\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.493194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.493194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8xw\" (UniqueName: \"kubernetes.io/projected/c28d8d99-35ea-49e3-a327-964b9d63b870-kube-api-access-ng8xw\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.493194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb30e3e-6611-4d30-a64d-a2ea5f7d709b-cert\") pod \"ingress-canary-6bzq5\" (UID: \"deb30e3e-6611-4d30-a64d-a2ea5f7d709b\") " pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.493194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stct4\" (UniqueName: \"kubernetes.io/projected/deb30e3e-6611-4d30-a64d-a2ea5f7d709b-kube-api-access-stct4\") pod \"ingress-canary-6bzq5\" (UID: \"deb30e3e-6611-4d30-a64d-a2ea5f7d709b\") " pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.493485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28d8d99-35ea-49e3-a327-964b9d63b870-tmp-dir\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.493485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-data-volume\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.493485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-crio-socket\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.493658 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c28d8d99-35ea-49e3-a327-964b9d63b870-config-volume\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.493934 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.493909    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.497008 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.496982    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.497157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.497139    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb30e3e-6611-4d30-a64d-a2ea5f7d709b-cert\") pod \"ingress-canary-6bzq5\" (UID: \"deb30e3e-6611-4d30-a64d-a2ea5f7d709b\") " pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.497157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.497150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28d8d99-35ea-49e3-a327-964b9d63b870-metrics-tls\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.501260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.501236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stct4\" (UniqueName: \"kubernetes.io/projected/deb30e3e-6611-4d30-a64d-a2ea5f7d709b-kube-api-access-stct4\") pod \"ingress-canary-6bzq5\" (UID: \"deb30e3e-6611-4d30-a64d-a2ea5f7d709b\") " pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.501789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.501767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8xw\" (UniqueName: \"kubernetes.io/projected/c28d8d99-35ea-49e3-a327-964b9d63b870-kube-api-access-ng8xw\") pod \"dns-default-n8vl7\" (UID: \"c28d8d99-35ea-49e3-a327-964b9d63b870\") " pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.501881 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.501839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6x9\" (UniqueName: \"kubernetes.io/projected/dd084fc2-3ef8-4d1a-be0d-3d0347d812c0-kube-api-access-zl6x9\") pod \"insights-runtime-extractor-6c9v7\" (UID: \"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0\") " pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.605516 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.605484    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bzq5"
Aug 05 19:02:35.621672 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.621654    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c9v7"
Aug 05 19:02:35.637770 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.637746    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:35.825905 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.825720    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c9v7"]
Aug 05 19:02:35.826519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.826375    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8vl7"]
Aug 05 19:02:35.827258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:35.827237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bzq5"]
Aug 05 19:02:35.831486 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:35.831456    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb30e3e_6611_4d30_a64d_a2ea5f7d709b.slice/crio-2b42e24dc6ccf005966fb39f5a583078a0d6d9b401d681385a485e6ca73379fc WatchSource:0}: Error finding container 2b42e24dc6ccf005966fb39f5a583078a0d6d9b401d681385a485e6ca73379fc: Status 404 returned error can't find the container with id 2b42e24dc6ccf005966fb39f5a583078a0d6d9b401d681385a485e6ca73379fc
Aug 05 19:02:35.832371 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:35.832335    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28d8d99_35ea_49e3_a327_964b9d63b870.slice/crio-20c1076a912d5c7689a3935ff887943241f43ff8dfba5a775bef74942f87ef00 WatchSource:0}: Error finding container 20c1076a912d5c7689a3935ff887943241f43ff8dfba5a775bef74942f87ef00: Status 404 returned error can't find the container with id 20c1076a912d5c7689a3935ff887943241f43ff8dfba5a775bef74942f87ef00
Aug 05 19:02:36.543962 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:36.543723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:36.646666 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:36.646420    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:36.674944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:36.674896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bzq5" event={"ID":"deb30e3e-6611-4d30-a64d-a2ea5f7d709b","Type":"ContainerStarted","Data":"2b42e24dc6ccf005966fb39f5a583078a0d6d9b401d681385a485e6ca73379fc"}
Aug 05 19:02:36.676393 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:36.676352    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8vl7" event={"ID":"c28d8d99-35ea-49e3-a327-964b9d63b870","Type":"ContainerStarted","Data":"20c1076a912d5c7689a3935ff887943241f43ff8dfba5a775bef74942f87ef00"}
Aug 05 19:02:36.679002 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:36.678905    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c9v7" event={"ID":"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0","Type":"ContainerStarted","Data":"0ec038695bab1a47723037082ea469cc120b60577b195b8ad92a51f0ba6b81e0"}
Aug 05 19:02:36.679002 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:36.678958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c9v7" event={"ID":"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0","Type":"ContainerStarted","Data":"4e79f8e0483cce0b6274c75167f14f24429eab5b9d3868fe56ed2cc13bf755bb"}
Aug 05 19:02:37.380372 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.380336    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64cbb55f85-vq28x"]
Aug 05 19:02:37.382538 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.382519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.384900 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.384878    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 05 19:02:37.385898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.385852    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 05 19:02:37.385898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.385879    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-98pjq\""
Aug 05 19:02:37.386465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.386168    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 05 19:02:37.386465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.386249    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 05 19:02:37.386465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.386271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 05 19:02:37.386465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.386288    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 05 19:02:37.386465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.386375    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 05 19:02:37.392607 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.392585    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cbb55f85-vq28x"]
Aug 05 19:02:37.405611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.405582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-oauth-config\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.405700 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.405653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-service-ca\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.405772 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.405700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-oauth-serving-cert\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.405772 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.405756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-serving-cert\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.405874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.405776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-console-config\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.405874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.405792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmlz\" (UniqueName: \"kubernetes.io/projected/d5255a6e-01c7-453d-b437-c793ddea28fd-kube-api-access-bsmlz\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.507124 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-serving-cert\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.507124 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-console-config\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.507366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmlz\" (UniqueName: \"kubernetes.io/projected/d5255a6e-01c7-453d-b437-c793ddea28fd-kube-api-access-bsmlz\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.507366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-oauth-config\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.507366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-service-ca\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.507366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-oauth-serving-cert\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.508382 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507884    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-console-config\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.508382 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.507981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-oauth-serving-cert\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.508944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.508923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-service-ca\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.511676 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.511654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-oauth-config\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.511788 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.511767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-serving-cert\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.516227 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.516203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmlz\" (UniqueName: \"kubernetes.io/projected/d5255a6e-01c7-453d-b437-c793ddea28fd-kube-api-access-bsmlz\") pod \"console-64cbb55f85-vq28x\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") " pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:37.683458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.683376    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c9v7" event={"ID":"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0","Type":"ContainerStarted","Data":"550fa86df654918628bdd5a0262768b715c1a896419e48c00ad18eb5a0eb2e71"}
Aug 05 19:02:37.694650 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:37.694624    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:38.151899 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.151855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:38.208665 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.208620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:38.580389 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.580158    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cbb55f85-vq28x"]
Aug 05 19:02:38.586275 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:38.586215    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5255a6e_01c7_453d_b437_c793ddea28fd.slice/crio-50316fec3cd8d04b5dcd7b661715d194f267a69ac1a6bd72c6339d2641930e81 WatchSource:0}: Error finding container 50316fec3cd8d04b5dcd7b661715d194f267a69ac1a6bd72c6339d2641930e81: Status 404 returned error can't find the container with id 50316fec3cd8d04b5dcd7b661715d194f267a69ac1a6bd72c6339d2641930e81
Aug 05 19:02:38.688211 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.688062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cbb55f85-vq28x" event={"ID":"d5255a6e-01c7-453d-b437-c793ddea28fd","Type":"ContainerStarted","Data":"50316fec3cd8d04b5dcd7b661715d194f267a69ac1a6bd72c6339d2641930e81"}
Aug 05 19:02:38.690918 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.690888    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8vl7" event={"ID":"c28d8d99-35ea-49e3-a327-964b9d63b870","Type":"ContainerStarted","Data":"ddfeb378090014bd19900194a2428547cc62ae61012eb029373ea5f8ca20a039"}
Aug 05 19:02:38.691035 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.690942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8vl7" event={"ID":"c28d8d99-35ea-49e3-a327-964b9d63b870","Type":"ContainerStarted","Data":"094dbe443ff0336d00932b9b07a4512ec54ecac4e4e1601d3e208b1d1afb7add"}
Aug 05 19:02:38.691260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.691213    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:38.698494 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.694045    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bzq5" event={"ID":"deb30e3e-6611-4d30-a64d-a2ea5f7d709b","Type":"ContainerStarted","Data":"c1ef23d6d26707314f4b6a92dcd590b84748ba4a40ff7bf4a22f6b654b090215"}
Aug 05 19:02:38.708201 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.708135    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n8vl7" podStartSLOduration=1.105159828 podStartE2EDuration="3.708112149s" totalImagesPullingTime="2.602952321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:38.707406631 +0000 UTC m=+54.758894325" watchObservedRunningTime="2026-08-05 19:02:38.708112149 +0000 UTC m=+54.759599845"
Aug 05 19:02:38.722489 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:38.722420    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6bzq5" podStartSLOduration=1.112489716 podStartE2EDuration="3.722399986s" totalImagesPullingTime="2.60991027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:38.721937928 +0000 UTC m=+54.773425620" watchObservedRunningTime="2026-08-05 19:02:38.722399986 +0000 UTC m=+54.773887678"
Aug 05 19:02:39.342017 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.341976    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:39.442671 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.442638    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:39.680813 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.680644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:39.701928 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.701898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c9v7" event={"ID":"dd084fc2-3ef8-4d1a-be0d-3d0347d812c0","Type":"ContainerStarted","Data":"f21edbd291f67cbd834ee05697558d7f8cb82c717627069ad732d046a5b7efbd"}
Aug 05 19:02:39.723924 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.723871    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6c9v7" podStartSLOduration=1.391683636 podStartE2EDuration="4.723855592s" totalImagesPullingTime="3.332171956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:02:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:39.722571789 +0000 UTC m=+55.774059491" watchObservedRunningTime="2026-08-05 19:02:39.723855592 +0000 UTC m=+55.775343284"
Aug 05 19:02:39.780478 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.780382    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:39.861169 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.861133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:39.865010 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.864977    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"]
Aug 05 19:02:39.867150 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.867113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:39.869567 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.869545    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 05 19:02:39.869567 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.869556    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4mw7c\""
Aug 05 19:02:39.877495 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.877474    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"]
Aug 05 19:02:39.929168 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:39.929132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-527nz\" (UID: \"b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:40.030501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:40.030472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-527nz\" (UID: \"b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:40.030658 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:40.030604    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Aug 05 19:02:40.030714 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:40.030675    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd-tls-certificates podName:b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd nodeName:}" failed. No retries permitted until 2026-08-05 19:02:40.530660483 +0000 UTC m=+56.582148154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-527nz" (UID: "b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd") : secret "prometheus-operator-admission-webhook-tls" not found
Aug 05 19:02:40.274969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:40.274930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:40.375388 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:40.375299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:40.535074 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:40.535036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-527nz\" (UID: \"b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:40.539443 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:40.539420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-527nz\" (UID: \"b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:40.778079 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:40.778043    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:41.287384 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:41.287352    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:41.344444 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:41.344411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:41.795850 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:41.795821    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"]
Aug 05 19:02:41.798519 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:41.798494    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ec1e6b_41e8_4340_b2d1_67b8b9d6a9cd.slice/crio-da947ad012286bac996a91023d4e408ed29d554b8cd675a6f02bec999f5a5bf4 WatchSource:0}: Error finding container da947ad012286bac996a91023d4e408ed29d554b8cd675a6f02bec999f5a5bf4: Status 404 returned error can't find the container with id da947ad012286bac996a91023d4e408ed29d554b8cd675a6f02bec999f5a5bf4
Aug 05 19:02:42.155567 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:42.155537    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:42.215540 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:42.215484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:42.721545 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:42.721508    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz" event={"ID":"b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd","Type":"ContainerStarted","Data":"da947ad012286bac996a91023d4e408ed29d554b8cd675a6f02bec999f5a5bf4"}
Aug 05 19:02:42.723160 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:42.723130    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cbb55f85-vq28x" event={"ID":"d5255a6e-01c7-453d-b437-c793ddea28fd","Type":"ContainerStarted","Data":"d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c"}
Aug 05 19:02:42.741273 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:42.741114    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64cbb55f85-vq28x" podStartSLOduration=2.6007319989999997 podStartE2EDuration="5.741095421s" totalImagesPullingTime="3.140363422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:42.740779809 +0000 UTC m=+58.792267512" watchObservedRunningTime="2026-08-05 19:02:42.741095421 +0000 UTC m=+58.792583117"
Aug 05 19:02:43.091491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.091434    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:43.152956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.152921    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b7f9c6ff-s5zqn"]
Aug 05 19:02:43.170838 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.170811    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b7f9c6ff-s5zqn"]
Aug 05 19:02:43.170979 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.170909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.171608 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.171580    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:43.177877 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.177859    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 05 19:02:43.260606 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.260573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-service-ca\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.260714 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.260614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-trusted-ca-bundle\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.260714 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.260676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-oauth-config\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.260714 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.260703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-serving-cert\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.260819 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.260767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-config\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.260819 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.260792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-oauth-serving-cert\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.260819 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.260810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfbg4\" (UniqueName: \"kubernetes.io/projected/078f8100-e10c-4b9b-a462-b1cfa19118c4-kube-api-access-vfbg4\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.361944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.361828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-config\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.361944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.361859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-oauth-serving-cert\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.361944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.361884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfbg4\" (UniqueName: \"kubernetes.io/projected/078f8100-e10c-4b9b-a462-b1cfa19118c4-kube-api-access-vfbg4\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.361944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.361927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-service-ca\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.362291 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.361950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-trusted-ca-bundle\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.362291 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.362009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-oauth-config\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.362291 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.362053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-serving-cert\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.362848 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.362819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-config\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.363102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.363066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-oauth-serving-cert\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.363282 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.363256    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-service-ca\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.363334 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.363295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-trusted-ca-bundle\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.364643 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.364619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-oauth-config\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.364854 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.364835    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-serving-cert\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.371046 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.371025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfbg4\" (UniqueName: \"kubernetes.io/projected/078f8100-e10c-4b9b-a462-b1cfa19118c4-kube-api-access-vfbg4\") pod \"console-9b7f9c6ff-s5zqn\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") " pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.480865 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.480824    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:43.624572 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.624509    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhz"
Aug 05 19:02:43.632308 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.632285    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b7f9c6ff-s5zqn"]
Aug 05 19:02:43.635243 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:43.635222    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078f8100_e10c_4b9b_a462_b1cfa19118c4.slice/crio-cc721f3439090c128f6890b036cf75438dfa8ab07ea7bbb9aa4a76fb4f3a792b WatchSource:0}: Error finding container cc721f3439090c128f6890b036cf75438dfa8ab07ea7bbb9aa4a76fb4f3a792b: Status 404 returned error can't find the container with id cc721f3439090c128f6890b036cf75438dfa8ab07ea7bbb9aa4a76fb4f3a792b
Aug 05 19:02:43.727091 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.727063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz" event={"ID":"b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd","Type":"ContainerStarted","Data":"a343f43e6c31b22593aca7cf19d24e17aeeb6506b917612f3b7fb0d2eaf903c1"}
Aug 05 19:02:43.727239 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.727220    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:43.728303 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.728281    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b7f9c6ff-s5zqn" event={"ID":"078f8100-e10c-4b9b-a462-b1cfa19118c4","Type":"ContainerStarted","Data":"cc721f3439090c128f6890b036cf75438dfa8ab07ea7bbb9aa4a76fb4f3a792b"}
Aug 05 19:02:43.731997 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.731981    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz"
Aug 05 19:02:43.772974 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.772943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:43.780373 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.780331    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-527nz" podStartSLOduration=3.342115264 podStartE2EDuration="4.780317892s" totalImagesPullingTime="1.438202628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:43.757590262 +0000 UTC m=+59.809077955" watchObservedRunningTime="2026-08-05 19:02:43.780317892 +0000 UTC m=+59.831805583"
Aug 05 19:02:43.841606 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.841569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:43.918744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.918663    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:43.921714 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.921692    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"]
Aug 05 19:02:43.923793 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.923779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:43.926132 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.926104    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 05 19:02:43.926268 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.926170    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 19:02:43.926406 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.926388    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 19:02:43.926466 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.926433    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-phfvv\""
Aug 05 19:02:43.926516 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.926503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 05 19:02:43.926856 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.926841    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 19:02:43.942363 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.942335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"]
Aug 05 19:02:43.966825 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.966792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:43.966976 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.966853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wttrl\" (UniqueName: \"kubernetes.io/projected/39c6520a-bad2-4976-8896-68b523145709-kube-api-access-wttrl\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:43.966976 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.966896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:43.966976 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:43.966943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c6520a-bad2-4976-8896-68b523145709-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.068115 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.068080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.068273 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.068135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttrl\" (UniqueName: \"kubernetes.io/projected/39c6520a-bad2-4976-8896-68b523145709-kube-api-access-wttrl\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.068273 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.068165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.068273 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.068219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c6520a-bad2-4976-8896-68b523145709-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.068273 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:44.068254    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 05 19:02:44.068399 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:44.068324    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-tls podName:39c6520a-bad2-4976-8896-68b523145709 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:44.568306841 +0000 UTC m=+60.619794524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-9vjq2" (UID: "39c6520a-bad2-4976-8896-68b523145709") : secret "prometheus-operator-tls" not found
Aug 05 19:02:44.068990 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.068920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c6520a-bad2-4976-8896-68b523145709-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.070670 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.070649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.079838 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.079813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wttrl\" (UniqueName: \"kubernetes.io/projected/39c6520a-bad2-4976-8896-68b523145709-kube-api-access-wttrl\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.293340 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.293280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:44.573194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.573100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.575547 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.575524    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c6520a-bad2-4976-8896-68b523145709-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-9vjq2\" (UID: \"39c6520a-bad2-4976-8896-68b523145709\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.732804 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.732769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b7f9c6ff-s5zqn" event={"ID":"078f8100-e10c-4b9b-a462-b1cfa19118c4","Type":"ContainerStarted","Data":"f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833"}
Aug 05 19:02:44.749395 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.749325    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b7f9c6ff-s5zqn" podStartSLOduration=1.749308418 podStartE2EDuration="1.749308418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:44.749114532 +0000 UTC m=+60.800602224" watchObservedRunningTime="2026-08-05 19:02:44.749308418 +0000 UTC m=+60.800796111"
Aug 05 19:02:44.834947 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.834878    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-phfvv\""
Aug 05 19:02:44.843540 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.843519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"
Aug 05 19:02:44.968565 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:44.968542    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-9vjq2"]
Aug 05 19:02:44.971134 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:44.971111    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c6520a_bad2_4976_8896_68b523145709.slice/crio-77a98402346259a8a09dcba248691874a609d02c3ddb6f823684608175b89b74 WatchSource:0}: Error finding container 77a98402346259a8a09dcba248691874a609d02c3ddb6f823684608175b89b74: Status 404 returned error can't find the container with id 77a98402346259a8a09dcba248691874a609d02c3ddb6f823684608175b89b74
Aug 05 19:02:45.737103 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:45.737070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2" event={"ID":"39c6520a-bad2-4976-8896-68b523145709","Type":"ContainerStarted","Data":"77a98402346259a8a09dcba248691874a609d02c3ddb6f823684608175b89b74"}
Aug 05 19:02:46.301352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:46.301254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:46.741733 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:46.741657    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2" event={"ID":"39c6520a-bad2-4976-8896-68b523145709","Type":"ContainerStarted","Data":"48b7d6b08903a350b34c34fdc766125b60c7b4890f29099550a0d3aaff8e23ab"}
Aug 05 19:02:46.741733 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:46.741711    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2" event={"ID":"39c6520a-bad2-4976-8896-68b523145709","Type":"ContainerStarted","Data":"935ff43a6684cc4fe9e1445f4104666c8c8e126aae8f76747926e6009cfafc66"}
Aug 05 19:02:46.758270 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:46.758223    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-9vjq2" podStartSLOduration=2.685571339 podStartE2EDuration="3.758209603s" totalImagesPullingTime="1.072638264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:46.757310935 +0000 UTC m=+62.808798628" watchObservedRunningTime="2026-08-05 19:02:46.758209603 +0000 UTC m=+62.809697292"
Aug 05 19:02:47.146143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.146105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:47.202091 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.202062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:47.392627 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.392584    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:47.493415 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.493328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:47.695416 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.695386    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:47.695574 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.695443    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:47.700115 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.700087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:47.748701 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.748643    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:02:47.753654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:47.753628    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.040041 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.040010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.146392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.146361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.255205 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.255150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.279646 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.279615    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"]
Aug 05 19:02:48.283286 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.283255    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.285483 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.285453    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 05 19:02:48.285602 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.285498    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 05 19:02:48.285768 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.285752    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f89pc\""
Aug 05 19:02:48.290882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.290831    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"]
Aug 05 19:02:48.293024 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.293006    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.294405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.294381    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"]
Aug 05 19:02:48.295759 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.295737    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 05 19:02:48.295871 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.295799    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h2cjs\""
Aug 05 19:02:48.295871 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.295737    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 05 19:02:48.295871 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.295864    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 05 19:02:48.306912 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.306890    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zsdpr"]
Aug 05 19:02:48.309110 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.309091    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"]
Aug 05 19:02:48.309241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.309195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.311468 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.311447    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 19:02:48.311731 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.311718    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 19:02:48.311851 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.311834    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 19:02:48.312107 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.312092    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47nns\""
Aug 05 19:02:48.361000 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.360964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.409304 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.409459 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-textfile\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409459 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.409459 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjghg\" (UniqueName: \"kubernetes.io/projected/a442431e-1e6f-4462-b803-dda1c4d55397-kube-api-access-gjghg\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.409459 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.409459 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ppgs\" (UniqueName: \"kubernetes.io/projected/55f3971a-8a9d-4046-8497-afe8eaa42827-kube-api-access-9ppgs\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409459 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-sys\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409492    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55f3971a-8a9d-4046-8497-afe8eaa42827-metrics-client-ca\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.409636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-tls\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-wtmp\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409627    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409805 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.409805 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.409805 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a442431e-1e6f-4462-b803-dda1c4d55397-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.409805 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-root\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.409923 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwvw\" (UniqueName: \"kubernetes.io/projected/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-api-access-qxwvw\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.409923 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.409829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.429261 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.429230    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.510883 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.510844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.510883 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.510885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a442431e-1e6f-4462-b803-dda1c4d55397-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.511133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.510903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-root\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.510948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwvw\" (UniqueName: \"kubernetes.io/projected/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-api-access-qxwvw\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.511133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.510970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.511133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.510986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.511133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-textfile\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.511133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-root\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:48.511129    2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:48.511259    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-tls podName:a442431e-1e6f-4462-b803-dda1c4d55397 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:49.011234322 +0000 UTC m=+65.062722001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-rn5f8" (UID: "a442431e-1e6f-4462-b803-dda1c4d55397") : secret "openshift-state-metrics-tls" not found
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjghg\" (UniqueName: \"kubernetes.io/projected/a442431e-1e6f-4462-b803-dda1c4d55397-kube-api-access-gjghg\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ppgs\" (UniqueName: \"kubernetes.io/projected/55f3971a-8a9d-4046-8497-afe8eaa42827-kube-api-access-9ppgs\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-textfile\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-sys\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55f3971a-8a9d-4046-8497-afe8eaa42827-metrics-client-ca\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:48.511563    2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:02:48.511614    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-tls podName:0909b5ab-02c0-40e3-b9a4-88c2e32ae178 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:49.011598008 +0000 UTC m=+65.063085699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-lb9bt" (UID: "0909b5ab-02c0-40e3-b9a4-88c2e32ae178") : secret "kube-state-metrics-tls" not found
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-sys\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-tls\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-wtmp\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.511903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a442431e-1e6f-4462-b803-dda1c4d55397-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.512463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.512463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.511942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-wtmp\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.512463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.512211    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.512463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.512307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55f3971a-8a9d-4046-8497-afe8eaa42827-metrics-client-ca\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.512830 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.512805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.513945 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.513918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.514141 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.514116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.514350 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.514327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.514395 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.514339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55f3971a-8a9d-4046-8497-afe8eaa42827-node-exporter-tls\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.519647 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.519628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ppgs\" (UniqueName: \"kubernetes.io/projected/55f3971a-8a9d-4046-8497-afe8eaa42827-kube-api-access-9ppgs\") pod \"node-exporter-zsdpr\" (UID: \"55f3971a-8a9d-4046-8497-afe8eaa42827\") " pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.519794 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.519772    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwvw\" (UniqueName: \"kubernetes.io/projected/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-api-access-qxwvw\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:48.519875 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.519860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjghg\" (UniqueName: \"kubernetes.io/projected/a442431e-1e6f-4462-b803-dda1c4d55397-kube-api-access-gjghg\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:48.556385 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.556287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.617777 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.617745    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zsdpr"
Aug 05 19:02:48.627641 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:48.627611    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f3971a_8a9d_4046_8497_afe8eaa42827.slice/crio-6e0768849244efaaa59432bc62ceccc1157b1262c63f4d5b5f967764db8e8b29 WatchSource:0}: Error finding container 6e0768849244efaaa59432bc62ceccc1157b1262c63f4d5b5f967764db8e8b29: Status 404 returned error can't find the container with id 6e0768849244efaaa59432bc62ceccc1157b1262c63f4d5b5f967764db8e8b29
Aug 05 19:02:48.656980 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.656956    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.704468 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.704448    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n8vl7"
Aug 05 19:02:48.751069 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.751043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsdpr" event={"ID":"55f3971a-8a9d-4046-8497-afe8eaa42827","Type":"ContainerStarted","Data":"6e0768849244efaaa59432bc62ceccc1157b1262c63f4d5b5f967764db8e8b29"}
Aug 05 19:02:48.757456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.757425    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.858946 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.858874    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:48.959773 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:48.959742    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:49.016000 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.015973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:49.016000 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.016003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:49.018613 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.018589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0909b5ab-02c0-40e3-b9a4-88c2e32ae178-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lb9bt\" (UID: \"0909b5ab-02c0-40e3-b9a4-88c2e32ae178\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:49.018705 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.018589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a442431e-1e6f-4462-b803-dda1c4d55397-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-rn5f8\" (UID: \"a442431e-1e6f-4462-b803-dda1c4d55397\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:49.192958 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.192879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"
Aug 05 19:02:49.201701 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.201656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"
Aug 05 19:02:49.286411 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.286230    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:49.362446 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.362394    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8"]
Aug 05 19:02:49.362604 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:49.362576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda442431e_1e6f_4462_b803_dda1c4d55397.slice/crio-3ac53d11e3c33bfabf93641fc00fb86df5b7001a8ae1c808cc18e4f69e05e6ec WatchSource:0}: Error finding container 3ac53d11e3c33bfabf93641fc00fb86df5b7001a8ae1c808cc18e4f69e05e6ec: Status 404 returned error can't find the container with id 3ac53d11e3c33bfabf93641fc00fb86df5b7001a8ae1c808cc18e4f69e05e6ec
Aug 05 19:02:49.371263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.371197    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt"]
Aug 05 19:02:49.374751 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:49.374730    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0909b5ab_02c0_40e3_b9a4_88c2e32ae178.slice/crio-25eed7f355d6ea0e1b1b5b3229f676b104c32f6a8685a034b649e5340ffc1e13 WatchSource:0}: Error finding container 25eed7f355d6ea0e1b1b5b3229f676b104c32f6a8685a034b649e5340ffc1e13: Status 404 returned error can't find the container with id 25eed7f355d6ea0e1b1b5b3229f676b104c32f6a8685a034b649e5340ffc1e13
Aug 05 19:02:49.380357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.380326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:49.490413 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.490377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:49.756071 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.756046    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt" event={"ID":"0909b5ab-02c0-40e3-b9a4-88c2e32ae178","Type":"ContainerStarted","Data":"25eed7f355d6ea0e1b1b5b3229f676b104c32f6a8685a034b649e5340ffc1e13"}
Aug 05 19:02:49.757446 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.757427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8" event={"ID":"a442431e-1e6f-4462-b803-dda1c4d55397","Type":"ContainerStarted","Data":"f988992da7e6aa3f6a6fba810018a3cb4523243009efade0e7745b0c22c72900"}
Aug 05 19:02:49.757542 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:49.757466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8" event={"ID":"a442431e-1e6f-4462-b803-dda1c4d55397","Type":"ContainerStarted","Data":"3ac53d11e3c33bfabf93641fc00fb86df5b7001a8ae1c808cc18e4f69e05e6ec"}
Aug 05 19:02:50.228154 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.228119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:50.228370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.228228    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:50.230228 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.230202    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 19:02:50.230869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.230855    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 19:02:50.240727 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.240704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8cc76-3bea-4cb9-ac15-a9de8deadbea-original-pull-secret\") pod \"global-pull-secret-syncer-bp8tx\" (UID: \"bee8cc76-3bea-4cb9-ac15-a9de8deadbea\") " pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:50.240824 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.240797    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a8275bb-663f-4f94-9e4f-295070eeac5c-metrics-certs\") pod \"network-metrics-daemon-v45rm\" (UID: \"9a8275bb-663f-4f94-9e4f-295070eeac5c\") " pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:50.329646 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.329617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:50.331847 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.331822    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 19:02:50.342287 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.342263    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 19:02:50.353951 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.353921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9pdz\" (UniqueName: \"kubernetes.io/projected/30555d21-2d4a-4d0d-b577-0b276cddc611-kube-api-access-s9pdz\") pod \"network-check-target-gvkjx\" (UID: \"30555d21-2d4a-4d0d-b577-0b276cddc611\") " pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:50.482817 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.482786    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk5vf\""
Aug 05 19:02:50.485685 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.485649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp8tx"
Aug 05 19:02:50.490784 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.490760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v45rm"
Aug 05 19:02:50.492798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.492777    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7thz\""
Aug 05 19:02:50.501890 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.501866    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:50.655652 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.655619    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp8tx"]
Aug 05 19:02:50.677174 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.677137    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v45rm"]
Aug 05 19:02:50.763240 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.763197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8" event={"ID":"a442431e-1e6f-4462-b803-dda1c4d55397","Type":"ContainerStarted","Data":"f9d2a4635cddbb1377aa31e1ad1369c78e4215402a5d9bd124dcc5fb4f174cfb"}
Aug 05 19:02:50.765094 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.765063    2558 generic.go:356] "Generic (PLEG): container finished" podID="55f3971a-8a9d-4046-8497-afe8eaa42827" containerID="d617439769b9086163b4d4dcc7ea8d17e9e31e735d5c2ca3a6a228b9ccc1ea6d" exitCode=0
Aug 05 19:02:50.765272 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:50.765101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsdpr" event={"ID":"55f3971a-8a9d-4046-8497-afe8eaa42827","Type":"ContainerDied","Data":"d617439769b9086163b4d4dcc7ea8d17e9e31e735d5c2ca3a6a228b9ccc1ea6d"}
Aug 05 19:02:50.891882 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:50.891820    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee8cc76_3bea_4cb9_ac15_a9de8deadbea.slice/crio-2b29a8288dcba1ff9f6856ff04790c037ab59acc37682154d36108720060fc05 WatchSource:0}: Error finding container 2b29a8288dcba1ff9f6856ff04790c037ab59acc37682154d36108720060fc05: Status 404 returned error can't find the container with id 2b29a8288dcba1ff9f6856ff04790c037ab59acc37682154d36108720060fc05
Aug 05 19:02:51.092293 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:51.092259    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8275bb_663f_4f94_9e4f_295070eeac5c.slice/crio-18eca65f6de94a74b6b3b0f2c0278f5aea87eba505bbe4aea89c3db433dfe4fb WatchSource:0}: Error finding container 18eca65f6de94a74b6b3b0f2c0278f5aea87eba505bbe4aea89c3db433dfe4fb: Status 404 returned error can't find the container with id 18eca65f6de94a74b6b3b0f2c0278f5aea87eba505bbe4aea89c3db433dfe4fb
Aug 05 19:02:51.241088 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.241061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:51.274723 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.274578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvkjx"]
Aug 05 19:02:51.327099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.327018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:51.509951 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.509855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:51.774087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.773205    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsdpr" event={"ID":"55f3971a-8a9d-4046-8497-afe8eaa42827","Type":"ContainerStarted","Data":"94afe4c6a8d702d4bcf8916fc7503221ec3a5e3b965dfa6c781cf5f9cbadbd7f"}
Aug 05 19:02:51.774087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.773275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsdpr" event={"ID":"55f3971a-8a9d-4046-8497-afe8eaa42827","Type":"ContainerStarted","Data":"522abed708c67073c29be0a176d2b57212ebeb6582582a8b20dfd2c674914565"}
Aug 05 19:02:51.777174 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.777137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt" event={"ID":"0909b5ab-02c0-40e3-b9a4-88c2e32ae178","Type":"ContainerStarted","Data":"d8f6afded174f9bbcea7685b8f411ba542b4db0e8ab37ae2580277bbbf185272"}
Aug 05 19:02:51.777328 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.777234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt" event={"ID":"0909b5ab-02c0-40e3-b9a4-88c2e32ae178","Type":"ContainerStarted","Data":"d9da2d773c39685c1c49730cd62226e04f7ea686bd56b1838828e797f0052891"}
Aug 05 19:02:51.777328 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.777268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt" event={"ID":"0909b5ab-02c0-40e3-b9a4-88c2e32ae178","Type":"ContainerStarted","Data":"4c70d334977b9cee8f61031a432cb80ec8cbbc9975b3b60c53b1c57efff7a867"}
Aug 05 19:02:51.780559 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.780531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8" event={"ID":"a442431e-1e6f-4462-b803-dda1c4d55397","Type":"ContainerStarted","Data":"88ce94e97d829abc15303f4e8fec0b941b04a70bdecefb130cf1b7af1220d84b"}
Aug 05 19:02:51.783476 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.783447    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp8tx" event={"ID":"bee8cc76-3bea-4cb9-ac15-a9de8deadbea","Type":"ContainerStarted","Data":"2b29a8288dcba1ff9f6856ff04790c037ab59acc37682154d36108720060fc05"}
Aug 05 19:02:51.785420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.785395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvkjx" event={"ID":"30555d21-2d4a-4d0d-b577-0b276cddc611","Type":"ContainerStarted","Data":"039ae74989d14b2cae7fb0ffc3c96528165240efd376fa6a33a65bb012c2c0fe"}
Aug 05 19:02:51.788497 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.788443    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v45rm" event={"ID":"9a8275bb-663f-4f94-9e4f-295070eeac5c","Type":"ContainerStarted","Data":"18eca65f6de94a74b6b3b0f2c0278f5aea87eba505bbe4aea89c3db433dfe4fb"}
Aug 05 19:02:51.792931 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.792786    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zsdpr" podStartSLOduration=2.302960718 podStartE2EDuration="3.792773803s" totalImagesPullingTime="1.390221169s" totalInitContainerRuntime="99.591916ms" isStatefulPod=true podCreationTimestamp="2026-08-05 19:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:51.792745664 +0000 UTC m=+67.844233358" watchObservedRunningTime="2026-08-05 19:02:51.792773803 +0000 UTC m=+67.844261477"
Aug 05 19:02:51.822400 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.821009    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lb9bt" podStartSLOduration=2.071958457 podStartE2EDuration="3.820988184s" totalImagesPullingTime="1.749029727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:51.818683074 +0000 UTC m=+67.870170770" watchObservedRunningTime="2026-08-05 19:02:51.820988184 +0000 UTC m=+67.872475879"
Aug 05 19:02:51.839378 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.837911    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-rn5f8" podStartSLOduration=2.544708299 podStartE2EDuration="3.837892874s" totalImagesPullingTime="1.293184575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:51.837540238 +0000 UTC m=+67.889027933" watchObservedRunningTime="2026-08-05 19:02:51.837892874 +0000 UTC m=+67.889380567"
Aug 05 19:02:51.931541 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:51.931453    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:52.795344 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:52.795234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v45rm" event={"ID":"9a8275bb-663f-4f94-9e4f-295070eeac5c","Type":"ContainerStarted","Data":"2e18042653884c91f0feed95a763a105194d53c08bcba72b8dae256965019bf9"}
Aug 05 19:02:52.795344 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:52.795287    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v45rm" event={"ID":"9a8275bb-663f-4f94-9e4f-295070eeac5c","Type":"ContainerStarted","Data":"00940899b767a30358e00e2f07346c9dea337cfcb4d44f492fce4b4042141f48"}
Aug 05 19:02:52.813609 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:52.813556    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v45rm" podStartSLOduration=67.723994223 podStartE2EDuration="1m8.81353828s" totalImagesPullingTime="1.089544057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:52.812573453 +0000 UTC m=+68.864061146" watchObservedRunningTime="2026-08-05 19:02:52.81353828 +0000 UTC m=+68.865025973"
Aug 05 19:02:53.025263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.025226    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:53.089366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.089281    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b7f9c6ff-s5zqn"]
Aug 05 19:02:53.115067 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.115033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:53.122577 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.118227    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86945ff565-wwl67"]
Aug 05 19:02:53.122577 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.120580    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.132640 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.132612    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86945ff565-wwl67"]
Aug 05 19:02:53.260648 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.260610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-service-ca\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.260803 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.260682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-serving-cert\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.260803 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.260711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-oauth-serving-cert\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.260803 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.260743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-console-config\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.260803 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.260800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-oauth-config\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.260978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.260823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68fhf\" (UniqueName: \"kubernetes.io/projected/1f215703-c931-415c-a24e-ef15257ee40c-kube-api-access-68fhf\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.260978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.260856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-trusted-ca-bundle\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.362263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.362167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-oauth-config\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.362263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.362230    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68fhf\" (UniqueName: \"kubernetes.io/projected/1f215703-c931-415c-a24e-ef15257ee40c-kube-api-access-68fhf\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.362491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.362266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-trusted-ca-bundle\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.362491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.362309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-service-ca\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.362491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.362356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-serving-cert\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.362491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.362377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-oauth-serving-cert\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.362491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.362404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-console-config\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.363087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.363015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-console-config\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.363372 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.363339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-service-ca\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.363840 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.363819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-oauth-serving-cert\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.364387 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.364357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-trusted-ca-bundle\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.365035 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.365014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-oauth-config\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.366341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.366321    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-serving-cert\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.372579 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.372557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68fhf\" (UniqueName: \"kubernetes.io/projected/1f215703-c931-415c-a24e-ef15257ee40c-kube-api-access-68fhf\") pod \"console-86945ff565-wwl67\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") " pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.375235 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.375208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:53.436079 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.436042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:02:53.473250 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.473204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:53.481137 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.481110    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:02:53.573053 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.573011    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:53.673616 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:53.673530    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:54.397407 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.397369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:54.497134 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.497056    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:54.573766 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.573726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:54.574574 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.574543    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 19:02:54.578004 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.577980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.581249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.580114    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 05 19:02:54.581249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.580372    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 05 19:02:54.581249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.580413    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 05 19:02:54.581249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.580905    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 05 19:02:54.581249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.580951    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 05 19:02:54.581249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.581098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 05 19:02:54.581579 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.581312    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k7hfn\""
Aug 05 19:02:54.581579 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.581554    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 05 19:02:54.581676 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.581584    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3hp1p126tcl2r\""
Aug 05 19:02:54.581676 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.581601    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 05 19:02:54.581676 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.581552    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 05 19:02:54.581951 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.581935    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 05 19:02:54.582194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.582158    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 05 19:02:54.582276 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.582206    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 05 19:02:54.582276 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.582214    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 05 19:02:54.594662 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.591930    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 05 19:02:54.598065 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.597869    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 05 19:02:54.598793 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.598367    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 19:02:54.642273 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.642239    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:54.672927 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.672850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673076 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.672904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673076 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673076 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673029    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673076 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673054    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-config\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673134    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcsq7\" (UniqueName: \"kubernetes.io/projected/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-kube-api-access-tcsq7\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.673637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.673544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.699533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.699492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:02:54.774572 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774724 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774724 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-config\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774724 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774724 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774724 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774709    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcsq7\" (UniqueName: \"kubernetes.io/projected/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-kube-api-access-tcsq7\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774854    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774908    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.774968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774956    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.774986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.775011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.775042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.775096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.775135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.775377    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775883 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.775629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.775883 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.775685    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.776254 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.776229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.778077 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.777285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.778077 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.777997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.780394 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.778711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.780536 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.780512    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.781535 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.781510    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.781816 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.781799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.782337 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.782317    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.783310 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.783283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.783404 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.783289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.783672 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.783651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-config\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.783952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.783721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.783952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.783873    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.783952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.783877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.784289 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.784171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.785475 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.785449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.791810 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.791784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcsq7\" (UniqueName: \"kubernetes.io/projected/f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9-kube-api-access-tcsq7\") pod \"prometheus-k8s-0\" (UID: \"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:54.902687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:54.902651    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:02:56.221604 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.221578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 19:02:56.234266 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.231943    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86945ff565-wwl67"]
Aug 05 19:02:56.238488 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:02:56.238455    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f215703_c931_415c_a24e_ef15257ee40c.slice/crio-40da6d0ee3d2b5b3fb232f9d2b38c49988ca2716c9e25324ee409c5946a149c6 WatchSource:0}: Error finding container 40da6d0ee3d2b5b3fb232f9d2b38c49988ca2716c9e25324ee409c5946a149c6: Status 404 returned error can't find the container with id 40da6d0ee3d2b5b3fb232f9d2b38c49988ca2716c9e25324ee409c5946a149c6
Aug 05 19:02:56.815159 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.815114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvkjx" event={"ID":"30555d21-2d4a-4d0d-b577-0b276cddc611","Type":"ContainerStarted","Data":"172b3d6584829b2d0636db26bbc01e982f75295861a591bedeffa25d8c9b5146"}
Aug 05 19:02:56.815360 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.815303    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:02:56.816435 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.816411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerStarted","Data":"1ff4979ceb453f43b9840e71885a38cc001ae9bcda3d0767595bbd7d834a0c16"}
Aug 05 19:02:56.817986 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.817965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86945ff565-wwl67" event={"ID":"1f215703-c931-415c-a24e-ef15257ee40c","Type":"ContainerStarted","Data":"1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74"}
Aug 05 19:02:56.818060 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.818000    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86945ff565-wwl67" event={"ID":"1f215703-c931-415c-a24e-ef15257ee40c","Type":"ContainerStarted","Data":"40da6d0ee3d2b5b3fb232f9d2b38c49988ca2716c9e25324ee409c5946a149c6"}
Aug 05 19:02:56.819453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.819433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp8tx" event={"ID":"bee8cc76-3bea-4cb9-ac15-a9de8deadbea","Type":"ContainerStarted","Data":"535aedcce3a42635202a5e4eb71a642e0b09eb657d4a1109e8abe24443460534"}
Aug 05 19:02:56.834386 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.834332    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gvkjx" podStartSLOduration=68.05507674 podStartE2EDuration="1m12.834313556s" totalImagesPullingTime="4.779236816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:56.833063503 +0000 UTC m=+72.884551197" watchObservedRunningTime="2026-08-05 19:02:56.834313556 +0000 UTC m=+72.885801243"
Aug 05 19:02:56.853642 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.853593    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86945ff565-wwl67" podStartSLOduration=3.853580162 podStartE2EDuration="3.853580162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:56.852920525 +0000 UTC m=+72.904408217" watchObservedRunningTime="2026-08-05 19:02:56.853580162 +0000 UTC m=+72.905067855"
Aug 05 19:02:56.873087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:56.873032    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bp8tx" podStartSLOduration=67.695899291 podStartE2EDuration="1m12.873016216s" totalImagesPullingTime="5.177116925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:56.872866283 +0000 UTC m=+72.924353975" watchObservedRunningTime="2026-08-05 19:02:56.873016216 +0000 UTC m=+72.924503909"
Aug 05 19:02:57.825982 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:57.825948    2558 generic.go:356] "Generic (PLEG): container finished" podID="f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9" containerID="b97fd4b453b885e251422748607faaeb80599ada2cc433862634ea931cdb894c" exitCode=0
Aug 05 19:02:57.826472 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:02:57.826054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerDied","Data":"b97fd4b453b885e251422748607faaeb80599ada2cc433862634ea931cdb894c"}
Aug 05 19:03:01.846569 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:01.846525    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerStarted","Data":"15054ec79791f4d172cdf47be501b669d914ae9f40f0772b3d1522f942061e36"}
Aug 05 19:03:01.847053 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:01.846618    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerStarted","Data":"06a37c0206bcee8b9cf3186dcf7592a37665c31a67119d09bd8b65d461a83acc"}
Aug 05 19:03:02.108050 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:02.107948    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:02.260315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:02.260278    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:03.338210 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.338147    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:03.437255 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.437172    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:03:03.437437 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.437321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:03:03.439576 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.439544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:03.442550 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.442528    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:03:03.859173 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.859143    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerStarted","Data":"f7c1d896b2c70c997ae886b49027d4b6d242f98bf6e3955a75377f677f541c87"}
Aug 05 19:03:03.859292 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.859226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerStarted","Data":"a1da8a4d4e5539f98929daffa1dd0524f9fd371dbd28754b2ded8727bf428ad4"}
Aug 05 19:03:03.863629 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.863606    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:03:03.911787 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:03.911758    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64cbb55f85-vq28x"]
Aug 05 19:03:04.006307 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:04.006232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:04.059956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:04.059925    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:04.112092 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:04.112058    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:04.866674 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:04.866636    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerStarted","Data":"96a58e38dff7d3ac840ae5a24f15935fa4f00713431b4332abd774adcc665b0e"}
Aug 05 19:03:04.867124 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:04.866702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9","Type":"ContainerStarted","Data":"acbcdfbdd0a9300cdb60c14ab65cbe537c233e32cd369e45483f4c30b808b1ff"}
Aug 05 19:03:04.892489 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:04.892436    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.040982171 podStartE2EDuration="10.892418185s" totalImagesPullingTime="6.834262407s" totalInitContainerRuntime="17.173607ms" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:03:04.890648989 +0000 UTC m=+80.942136681" watchObservedRunningTime="2026-08-05 19:03:04.892418185 +0000 UTC m=+80.943905878"
Aug 05 19:03:04.902865 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:04.902769    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:03:09.659650 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:09.659609    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:09.760690 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:09.760655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:18.113056 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.112989    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9b7f9c6ff-s5zqn" podUID="078f8100-e10c-4b9b-a462-b1cfa19118c4" containerName="console" containerID="cri-o://f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833" gracePeriod=15
Aug 05 19:03:18.348617 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.348595    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:03:18.387309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387233    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-trusted-ca-bundle\") pod \"078f8100-e10c-4b9b-a462-b1cfa19118c4\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") "
Aug 05 19:03:18.387309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387263    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfbg4\" (UniqueName: \"kubernetes.io/projected/078f8100-e10c-4b9b-a462-b1cfa19118c4-kube-api-access-vfbg4\") pod \"078f8100-e10c-4b9b-a462-b1cfa19118c4\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") "
Aug 05 19:03:18.387309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387290    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-serving-cert\") pod \"078f8100-e10c-4b9b-a462-b1cfa19118c4\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") "
Aug 05 19:03:18.387556 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387317    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-oauth-config\") pod \"078f8100-e10c-4b9b-a462-b1cfa19118c4\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") "
Aug 05 19:03:18.387556 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387364    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-service-ca\") pod \"078f8100-e10c-4b9b-a462-b1cfa19118c4\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") "
Aug 05 19:03:18.387556 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387381    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-oauth-serving-cert\") pod \"078f8100-e10c-4b9b-a462-b1cfa19118c4\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") "
Aug 05 19:03:18.387556 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-config\") pod \"078f8100-e10c-4b9b-a462-b1cfa19118c4\" (UID: \"078f8100-e10c-4b9b-a462-b1cfa19118c4\") "
Aug 05 19:03:18.387761 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387734    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "078f8100-e10c-4b9b-a462-b1cfa19118c4" (UID: "078f8100-e10c-4b9b-a462-b1cfa19118c4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:03:18.387844 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387815    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-service-ca" (OuterVolumeSpecName: "service-ca") pod "078f8100-e10c-4b9b-a462-b1cfa19118c4" (UID: "078f8100-e10c-4b9b-a462-b1cfa19118c4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:03:18.387844 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "078f8100-e10c-4b9b-a462-b1cfa19118c4" (UID: "078f8100-e10c-4b9b-a462-b1cfa19118c4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:03:18.387952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.387837    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-config" (OuterVolumeSpecName: "console-config") pod "078f8100-e10c-4b9b-a462-b1cfa19118c4" (UID: "078f8100-e10c-4b9b-a462-b1cfa19118c4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:03:18.389787 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.389751    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "078f8100-e10c-4b9b-a462-b1cfa19118c4" (UID: "078f8100-e10c-4b9b-a462-b1cfa19118c4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:03:18.389787 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.389773    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/078f8100-e10c-4b9b-a462-b1cfa19118c4-kube-api-access-vfbg4" (OuterVolumeSpecName: "kube-api-access-vfbg4") pod "078f8100-e10c-4b9b-a462-b1cfa19118c4" (UID: "078f8100-e10c-4b9b-a462-b1cfa19118c4"). InnerVolumeSpecName "kube-api-access-vfbg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:03:18.389932 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.389796    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "078f8100-e10c-4b9b-a462-b1cfa19118c4" (UID: "078f8100-e10c-4b9b-a462-b1cfa19118c4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:03:18.488389 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.488366    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:18.488389 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.488389    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:18.488533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.488399    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:18.488533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.488408    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078f8100-e10c-4b9b-a462-b1cfa19118c4-trusted-ca-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:18.488533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.488416    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfbg4\" (UniqueName: \"kubernetes.io/projected/078f8100-e10c-4b9b-a462-b1cfa19118c4-kube-api-access-vfbg4\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:18.488533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.488425    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:18.488533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.488434    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078f8100-e10c-4b9b-a462-b1cfa19118c4-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:18.922362 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.922331    2558 generic.go:356] "Generic (PLEG): container finished" podID="078f8100-e10c-4b9b-a462-b1cfa19118c4" containerID="f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833" exitCode=0
Aug 05 19:03:18.922528 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.922389    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b7f9c6ff-s5zqn"
Aug 05 19:03:18.922528 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.922391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b7f9c6ff-s5zqn" event={"ID":"078f8100-e10c-4b9b-a462-b1cfa19118c4","Type":"ContainerDied","Data":"f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833"}
Aug 05 19:03:18.922528 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.922524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b7f9c6ff-s5zqn" event={"ID":"078f8100-e10c-4b9b-a462-b1cfa19118c4","Type":"ContainerDied","Data":"cc721f3439090c128f6890b036cf75438dfa8ab07ea7bbb9aa4a76fb4f3a792b"}
Aug 05 19:03:18.923225 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.923207    2558 scope.go:117] "RemoveContainer" containerID="f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833"
Aug 05 19:03:18.932405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.932389    2558 scope.go:117] "RemoveContainer" containerID="f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833"
Aug 05 19:03:18.932656 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:03:18.932637    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833\": container with ID starting with f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833 not found: ID does not exist" containerID="f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833"
Aug 05 19:03:18.932716 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.932662    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833"} err="failed to get container status \"f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833\": rpc error: code = NotFound desc = could not find container \"f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833\": container with ID starting with f4ec4015fb2fefd1fb0075dbcfc08e320c8d4ce0b5f1bb09d12e14a76b2d8833 not found: ID does not exist"
Aug 05 19:03:18.936913 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.936891    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b7f9c6ff-s5zqn"]
Aug 05 19:03:18.938872 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:18.938851    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9b7f9c6ff-s5zqn"]
Aug 05 19:03:20.474289 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:20.474253    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="078f8100-e10c-4b9b-a462-b1cfa19118c4" path="/var/lib/kubelet/pods/078f8100-e10c-4b9b-a462-b1cfa19118c4/volumes"
Aug 05 19:03:26.340840 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:26.340806    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bzq5_deb30e3e-6611-4d30-a64d-a2ea5f7d709b/serve-healthcheck-canary/0.log"
Aug 05 19:03:27.829067 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:27.829037    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gvkjx"
Aug 05 19:03:27.965972 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:27.965941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:28.940218 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:28.940157    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64cbb55f85-vq28x" podUID="d5255a6e-01c7-453d-b437-c793ddea28fd" containerName="console" containerID="cri-o://d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c" gracePeriod=15
Aug 05 19:03:29.223562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.223535    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:03:29.271599 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.271576    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-oauth-serving-cert\") pod \"d5255a6e-01c7-453d-b437-c793ddea28fd\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") "
Aug 05 19:03:29.271751 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.271615    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-oauth-config\") pod \"d5255a6e-01c7-453d-b437-c793ddea28fd\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") "
Aug 05 19:03:29.271751 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.271633    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-service-ca\") pod \"d5255a6e-01c7-453d-b437-c793ddea28fd\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") "
Aug 05 19:03:29.271751 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.271667    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-serving-cert\") pod \"d5255a6e-01c7-453d-b437-c793ddea28fd\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") "
Aug 05 19:03:29.271751 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.271729    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-console-config\") pod \"d5255a6e-01c7-453d-b437-c793ddea28fd\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") "
Aug 05 19:03:29.271948 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.271762    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsmlz\" (UniqueName: \"kubernetes.io/projected/d5255a6e-01c7-453d-b437-c793ddea28fd-kube-api-access-bsmlz\") pod \"d5255a6e-01c7-453d-b437-c793ddea28fd\" (UID: \"d5255a6e-01c7-453d-b437-c793ddea28fd\") "
Aug 05 19:03:29.272056 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.272029    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d5255a6e-01c7-453d-b437-c793ddea28fd" (UID: "d5255a6e-01c7-453d-b437-c793ddea28fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:03:29.272056 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.272038    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "d5255a6e-01c7-453d-b437-c793ddea28fd" (UID: "d5255a6e-01c7-453d-b437-c793ddea28fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:03:29.272152 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.272061    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-console-config" (OuterVolumeSpecName: "console-config") pod "d5255a6e-01c7-453d-b437-c793ddea28fd" (UID: "d5255a6e-01c7-453d-b437-c793ddea28fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:03:29.274043 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.274013    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d5255a6e-01c7-453d-b437-c793ddea28fd" (UID: "d5255a6e-01c7-453d-b437-c793ddea28fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:03:29.274147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.274046    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5255a6e-01c7-453d-b437-c793ddea28fd-kube-api-access-bsmlz" (OuterVolumeSpecName: "kube-api-access-bsmlz") pod "d5255a6e-01c7-453d-b437-c793ddea28fd" (UID: "d5255a6e-01c7-453d-b437-c793ddea28fd"). InnerVolumeSpecName "kube-api-access-bsmlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:03:29.274147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.274068    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d5255a6e-01c7-453d-b437-c793ddea28fd" (UID: "d5255a6e-01c7-453d-b437-c793ddea28fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:03:29.372952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.372922    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:29.372952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.372947    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsmlz\" (UniqueName: \"kubernetes.io/projected/d5255a6e-01c7-453d-b437-c793ddea28fd-kube-api-access-bsmlz\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:29.372952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.372958    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:29.373167 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.372968    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:29.373167 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.372977    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5255a6e-01c7-453d-b437-c793ddea28fd-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:29.373167 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.372986    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5255a6e-01c7-453d-b437-c793ddea28fd-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:03:29.965571 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.965529    2558 generic.go:356] "Generic (PLEG): container finished" podID="d5255a6e-01c7-453d-b437-c793ddea28fd" containerID="d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c" exitCode=0
Aug 05 19:03:29.965571 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.965574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cbb55f85-vq28x" event={"ID":"d5255a6e-01c7-453d-b437-c793ddea28fd","Type":"ContainerDied","Data":"d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c"}
Aug 05 19:03:29.966032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.965593    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cbb55f85-vq28x"
Aug 05 19:03:29.966032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.965639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cbb55f85-vq28x" event={"ID":"d5255a6e-01c7-453d-b437-c793ddea28fd","Type":"ContainerDied","Data":"50316fec3cd8d04b5dcd7b661715d194f267a69ac1a6bd72c6339d2641930e81"}
Aug 05 19:03:29.966032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.965658    2558 scope.go:117] "RemoveContainer" containerID="d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c"
Aug 05 19:03:29.973954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.973933    2558 scope.go:117] "RemoveContainer" containerID="d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c"
Aug 05 19:03:29.974265 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:03:29.974245    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c\": container with ID starting with d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c not found: ID does not exist" containerID="d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c"
Aug 05 19:03:29.974334 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.974274    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c"} err="failed to get container status \"d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c\": rpc error: code = NotFound desc = could not find container \"d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c\": container with ID starting with d09a512e5dea566265cb85225855d5c6634f8de73f1d623cf8e246fb1eab859c not found: ID does not exist"
Aug 05 19:03:29.984922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.984898    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64cbb55f85-vq28x"]
Aug 05 19:03:29.988247 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:29.988228    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64cbb55f85-vq28x"]
Aug 05 19:03:30.474475 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:30.474446    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5255a6e-01c7-453d-b437-c793ddea28fd" path="/var/lib/kubelet/pods/d5255a6e-01c7-453d-b437-c793ddea28fd/volumes"
Aug 05 19:03:31.807466 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:31.807428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:31.907527 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:31.907480    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:31.959139 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:31.959103    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:03:54.903152 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:54.903119    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:03:54.922501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:54.922479    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:03:55.084768 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:03:55.084744    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 19:04:07.496825 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:07.496778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:07.878143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:07.878081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:15.743487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.743450    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58cf7684cc-jdksb"]
Aug 05 19:04:15.743869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.743717    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="078f8100-e10c-4b9b-a462-b1cfa19118c4" containerName="console"
Aug 05 19:04:15.743869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.743728    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="078f8100-e10c-4b9b-a462-b1cfa19118c4" containerName="console"
Aug 05 19:04:15.743869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.743750    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5255a6e-01c7-453d-b437-c793ddea28fd" containerName="console"
Aug 05 19:04:15.743869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.743756    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5255a6e-01c7-453d-b437-c793ddea28fd" containerName="console"
Aug 05 19:04:15.743869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.743801    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="078f8100-e10c-4b9b-a462-b1cfa19118c4" containerName="console"
Aug 05 19:04:15.743869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.743810    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5255a6e-01c7-453d-b437-c793ddea28fd" containerName="console"
Aug 05 19:04:15.745906 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.745886    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.759372 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.759350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-oauth-config\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.759487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.759380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-trusted-ca-bundle\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.759487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.759403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-config\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.759487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.759473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-oauth-serving-cert\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.759593 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.759554    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-serving-cert\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.759627 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.759611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrsv8\" (UniqueName: \"kubernetes.io/projected/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-kube-api-access-xrsv8\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.759682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.759668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-service-ca\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.764293 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.764272    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cf7684cc-jdksb"]
Aug 05 19:04:15.826130 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.826095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:15.860880 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.860841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-serving-cert\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.861059 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.860898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrsv8\" (UniqueName: \"kubernetes.io/projected/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-kube-api-access-xrsv8\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.861059 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.860937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-service-ca\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.861059 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.860978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-oauth-config\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.861059 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.861032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-trusted-ca-bundle\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.861302 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.861071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-config\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.861302 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.861116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-oauth-serving-cert\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.861930 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.861903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-service-ca\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.862051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.861903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-config\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.862051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.861958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-oauth-serving-cert\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.862164 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.862054    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-trusted-ca-bundle\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.863583 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.863562    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-oauth-config\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.863922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.863906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-serving-cert\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.869640 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.869586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrsv8\" (UniqueName: \"kubernetes.io/projected/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-kube-api-access-xrsv8\") pod \"console-58cf7684cc-jdksb\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") " pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:15.877698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.877674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:15.941106 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.941072    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:15.993100 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:15.993065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:16.054494 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:16.054460    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:16.183436 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:16.183409    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cf7684cc-jdksb"]
Aug 05 19:04:16.185709 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:04:16.185681    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6c5a1f_67d7_42df_a3e7_cdc8a2b2c7f2.slice/crio-b9927f730745bb6119e082d3962354fca4b74090058febb982676bb732bacab0 WatchSource:0}: Error finding container b9927f730745bb6119e082d3962354fca4b74090058febb982676bb732bacab0: Status 404 returned error can't find the container with id b9927f730745bb6119e082d3962354fca4b74090058febb982676bb732bacab0
Aug 05 19:04:16.540394 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:16.540362    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:16.642552 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:16.642511    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:17.152106 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:17.152066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf7684cc-jdksb" event={"ID":"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2","Type":"ContainerStarted","Data":"6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8"}
Aug 05 19:04:17.152503 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:17.152123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf7684cc-jdksb" event={"ID":"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2","Type":"ContainerStarted","Data":"b9927f730745bb6119e082d3962354fca4b74090058febb982676bb732bacab0"}
Aug 05 19:04:17.169169 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:17.169117    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58cf7684cc-jdksb" podStartSLOduration=2.169098009 podStartE2EDuration="2.169098009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:04:17.168755667 +0000 UTC m=+153.220243359" watchObservedRunningTime="2026-08-05 19:04:17.169098009 +0000 UTC m=+153.220585703"
Aug 05 19:04:17.962969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:17.962936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:22.720096 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:22.720056    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:22.782931 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:22.782894    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:26.055401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.055342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:26.055799 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.055426    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:26.060422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.060398    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:26.192665 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.192640    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:04:26.226921 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.226891    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86945ff565-wwl67"]
Aug 05 19:04:26.288692 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.288655    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f997f8ddc-lcxsh"]
Aug 05 19:04:26.291661 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.291641    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.300792 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.300760    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f997f8ddc-lcxsh"]
Aug 05 19:04:26.348453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.348371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-trusted-ca-bundle\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.348453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.348413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-oauth-config\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.348453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.348436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-oauth-serving-cert\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.348453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.348452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-serving-cert\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.348693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.348483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-console-config\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.348693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.348530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-service-ca\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.348693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.348544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct2xn\" (UniqueName: \"kubernetes.io/projected/f29c8f50-54bb-4386-891a-89fb067c6421-kube-api-access-ct2xn\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.449879 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.449846    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-oauth-serving-cert\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.449879 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.449884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-serving-cert\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450095 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.449912    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-console-config\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450095 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.449978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-service-ca\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450095 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.450001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct2xn\" (UniqueName: \"kubernetes.io/projected/f29c8f50-54bb-4386-891a-89fb067c6421-kube-api-access-ct2xn\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450095 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.450034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-trusted-ca-bundle\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450095 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.450077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-oauth-config\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450648 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.450624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-oauth-serving-cert\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450765 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.450745    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-console-config\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.450979 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.450961    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-trusted-ca-bundle\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.451020 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.450996    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-service-ca\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.452478 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.452462    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-serving-cert\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.452600 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.452583    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-oauth-config\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.457530 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.457502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct2xn\" (UniqueName: \"kubernetes.io/projected/f29c8f50-54bb-4386-891a-89fb067c6421-kube-api-access-ct2xn\") pod \"console-5f997f8ddc-lcxsh\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") " pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.602248 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.602146    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:26.681315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.681281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:26.731845 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.731752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f997f8ddc-lcxsh"]
Aug 05 19:04:26.734371 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:04:26.734338    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29c8f50_54bb_4386_891a_89fb067c6421.slice/crio-032b8d56a294ef2fe9b56ef10895cf829b8b66865546ba232c711fae2daa119e WatchSource:0}: Error finding container 032b8d56a294ef2fe9b56ef10895cf829b8b66865546ba232c711fae2daa119e: Status 404 returned error can't find the container with id 032b8d56a294ef2fe9b56ef10895cf829b8b66865546ba232c711fae2daa119e
Aug 05 19:04:26.781515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:26.781489    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:27.193323 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:27.193286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f997f8ddc-lcxsh" event={"ID":"f29c8f50-54bb-4386-891a-89fb067c6421","Type":"ContainerStarted","Data":"114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514"}
Aug 05 19:04:27.193770 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:27.193343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f997f8ddc-lcxsh" event={"ID":"f29c8f50-54bb-4386-891a-89fb067c6421","Type":"ContainerStarted","Data":"032b8d56a294ef2fe9b56ef10895cf829b8b66865546ba232c711fae2daa119e"}
Aug 05 19:04:27.209872 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:27.209826    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f997f8ddc-lcxsh" podStartSLOduration=1.209806857 podStartE2EDuration="1.209806857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:04:27.208739884 +0000 UTC m=+163.260227575" watchObservedRunningTime="2026-08-05 19:04:27.209806857 +0000 UTC m=+163.261294551"
Aug 05 19:04:27.293533 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:27.293498    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:27.394474 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:27.394435    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:33.760902 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:33.760857    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:34.668153 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:34.668115    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:34.718095 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:34.718061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:36.603219 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:36.603161    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:36.603607 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:36.603242    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:36.608061 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:36.608038    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:37.231861 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:37.231827    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:04:37.278559 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:37.278522    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cf7684cc-jdksb"]
Aug 05 19:04:37.398594 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:37.398556    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:37.450758 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:37.450726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:37.509646 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:37.509548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:40.547516 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:40.547474    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:40.606476 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:40.606431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:49.815302 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:49.815262    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:51.251784 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.251735    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86945ff565-wwl67" podUID="1f215703-c931-415c-a24e-ef15257ee40c" containerName="console" containerID="cri-o://1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74" gracePeriod=15
Aug 05 19:04:51.513351 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.513293    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:04:51.656425 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656392    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-console-config\") pod \"1f215703-c931-415c-a24e-ef15257ee40c\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") "
Aug 05 19:04:51.656624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656453    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-trusted-ca-bundle\") pod \"1f215703-c931-415c-a24e-ef15257ee40c\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") "
Aug 05 19:04:51.656624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656481    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68fhf\" (UniqueName: \"kubernetes.io/projected/1f215703-c931-415c-a24e-ef15257ee40c-kube-api-access-68fhf\") pod \"1f215703-c931-415c-a24e-ef15257ee40c\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") "
Aug 05 19:04:51.656624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656501    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-service-ca\") pod \"1f215703-c931-415c-a24e-ef15257ee40c\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") "
Aug 05 19:04:51.656624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656548    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-oauth-config\") pod \"1f215703-c931-415c-a24e-ef15257ee40c\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") "
Aug 05 19:04:51.656624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656573    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-serving-cert\") pod \"1f215703-c931-415c-a24e-ef15257ee40c\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") "
Aug 05 19:04:51.656624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656592    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-oauth-serving-cert\") pod \"1f215703-c931-415c-a24e-ef15257ee40c\" (UID: \"1f215703-c931-415c-a24e-ef15257ee40c\") "
Aug 05 19:04:51.656936 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656897    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-console-config" (OuterVolumeSpecName: "console-config") pod "1f215703-c931-415c-a24e-ef15257ee40c" (UID: "1f215703-c931-415c-a24e-ef15257ee40c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:04:51.656936 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.656913    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f215703-c931-415c-a24e-ef15257ee40c" (UID: "1f215703-c931-415c-a24e-ef15257ee40c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:04:51.657089 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.657054    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f215703-c931-415c-a24e-ef15257ee40c" (UID: "1f215703-c931-415c-a24e-ef15257ee40c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:04:51.657089 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.657085    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f215703-c931-415c-a24e-ef15257ee40c" (UID: "1f215703-c931-415c-a24e-ef15257ee40c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:04:51.658977 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.658946    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f215703-c931-415c-a24e-ef15257ee40c" (UID: "1f215703-c931-415c-a24e-ef15257ee40c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:04:51.658977 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.658949    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f215703-c931-415c-a24e-ef15257ee40c-kube-api-access-68fhf" (OuterVolumeSpecName: "kube-api-access-68fhf") pod "1f215703-c931-415c-a24e-ef15257ee40c" (UID: "1f215703-c931-415c-a24e-ef15257ee40c"). InnerVolumeSpecName "kube-api-access-68fhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:04:51.659128 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.658997    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f215703-c931-415c-a24e-ef15257ee40c" (UID: "1f215703-c931-415c-a24e-ef15257ee40c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:04:51.757376 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.757341    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:04:51.757376 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.757372    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f215703-c931-415c-a24e-ef15257ee40c-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:04:51.757376 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.757382    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:04:51.757376 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.757391    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:04:51.757654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.757400    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-trusted-ca-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:04:51.757654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.757408    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68fhf\" (UniqueName: \"kubernetes.io/projected/1f215703-c931-415c-a24e-ef15257ee40c-kube-api-access-68fhf\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:04:51.757654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:51.757418    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f215703-c931-415c-a24e-ef15257ee40c-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:04:52.281798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.281763    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f215703-c931-415c-a24e-ef15257ee40c" containerID="1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74" exitCode=0
Aug 05 19:04:52.281798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.281800    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86945ff565-wwl67" event={"ID":"1f215703-c931-415c-a24e-ef15257ee40c","Type":"ContainerDied","Data":"1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74"}
Aug 05 19:04:52.282333 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.281815    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86945ff565-wwl67"
Aug 05 19:04:52.282333 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.281868    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86945ff565-wwl67" event={"ID":"1f215703-c931-415c-a24e-ef15257ee40c","Type":"ContainerDied","Data":"40da6d0ee3d2b5b3fb232f9d2b38c49988ca2716c9e25324ee409c5946a149c6"}
Aug 05 19:04:52.282333 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.281889    2558 scope.go:117] "RemoveContainer" containerID="1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74"
Aug 05 19:04:52.290766 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.290750    2558 scope.go:117] "RemoveContainer" containerID="1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74"
Aug 05 19:04:52.291009 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:04:52.290988    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74\": container with ID starting with 1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74 not found: ID does not exist" containerID="1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74"
Aug 05 19:04:52.291069 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.291020    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74"} err="failed to get container status \"1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74\": rpc error: code = NotFound desc = could not find container \"1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74\": container with ID starting with 1890dcc183cbe96efc1f3fa18a9134e53a78252008809428fd6b3f86fa189d74 not found: ID does not exist"
Aug 05 19:04:52.301074 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.301053    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86945ff565-wwl67"]
Aug 05 19:04:52.302917 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.302897    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86945ff565-wwl67"]
Aug 05 19:04:52.475003 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:52.474973    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f215703-c931-415c-a24e-ef15257ee40c" path="/var/lib/kubelet/pods/1f215703-c931-415c-a24e-ef15257ee40c/volumes"
Aug 05 19:04:56.479740 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:56.479708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:04:56.534520 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:04:56.534491    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:02.299989 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.299942    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58cf7684cc-jdksb" podUID="fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" containerName="console" containerID="cri-o://6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8" gracePeriod=15
Aug 05 19:05:02.543756 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.543732    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:05:02.650438 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650339    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-oauth-serving-cert\") pod \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") "
Aug 05 19:05:02.650438 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650383    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-config\") pod \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") "
Aug 05 19:05:02.650438 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650407    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-service-ca\") pod \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") "
Aug 05 19:05:02.650713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650474    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-serving-cert\") pod \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") "
Aug 05 19:05:02.650713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650505    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-oauth-config\") pod \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") "
Aug 05 19:05:02.650713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650534    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrsv8\" (UniqueName: \"kubernetes.io/projected/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-kube-api-access-xrsv8\") pod \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") "
Aug 05 19:05:02.650713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650560    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-trusted-ca-bundle\") pod \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\" (UID: \"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2\") "
Aug 05 19:05:02.650904 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650862    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" (UID: "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:05:02.650904 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.650882    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-config" (OuterVolumeSpecName: "console-config") pod "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" (UID: "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:05:02.651062 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.651032    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" (UID: "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:05:02.651209 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.651139    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" (UID: "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:05:02.652799 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.652775    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-kube-api-access-xrsv8" (OuterVolumeSpecName: "kube-api-access-xrsv8") pod "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" (UID: "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2"). InnerVolumeSpecName "kube-api-access-xrsv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:05:02.652898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.652816    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" (UID: "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:05:02.652898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.652825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" (UID: "fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:05:02.751336 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.751297    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:05:02.751336 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.751326    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:05:02.751336 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.751337    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:05:02.751336 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.751346    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:05:02.751603 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.751355    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrsv8\" (UniqueName: \"kubernetes.io/projected/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-kube-api-access-xrsv8\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:05:02.751603 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.751364    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-trusted-ca-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:05:02.751603 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:02.751372    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:05:03.328900 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.328867    2558 generic.go:356] "Generic (PLEG): container finished" podID="fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" containerID="6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8" exitCode=0
Aug 05 19:05:03.329422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.328930    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf7684cc-jdksb"
Aug 05 19:05:03.329422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.328957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf7684cc-jdksb" event={"ID":"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2","Type":"ContainerDied","Data":"6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8"}
Aug 05 19:05:03.329422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.329048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf7684cc-jdksb" event={"ID":"fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2","Type":"ContainerDied","Data":"b9927f730745bb6119e082d3962354fca4b74090058febb982676bb732bacab0"}
Aug 05 19:05:03.329422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.329079    2558 scope.go:117] "RemoveContainer" containerID="6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8"
Aug 05 19:05:03.337699 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.337679    2558 scope.go:117] "RemoveContainer" containerID="6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8"
Aug 05 19:05:03.337985 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:05:03.337968    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8\": container with ID starting with 6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8 not found: ID does not exist" containerID="6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8"
Aug 05 19:05:03.338030 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.337994    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8"} err="failed to get container status \"6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8\": rpc error: code = NotFound desc = could not find container \"6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8\": container with ID starting with 6b21afe6313c5664d411b36c51554d51fb3ab3d70cdc872d28ff0ac2c741ddd8 not found: ID does not exist"
Aug 05 19:05:03.347995 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.347966    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cf7684cc-jdksb"]
Aug 05 19:05:03.349954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:03.349922    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58cf7684cc-jdksb"]
Aug 05 19:05:04.475015 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:04.474973    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" path="/var/lib/kubelet/pods/fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2/volumes"
Aug 05 19:05:13.565773 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:13.565723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:13.673257 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:13.673213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:40.185805 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:40.185758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:42.109369 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:42.109335    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:43.798292 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:43.798251    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:43.894761 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:43.894726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:45.327510 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:45.327476    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:46.631314 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:46.631287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:47.682346 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.682313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:47.888125 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.888095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:47.976559 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.976473    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"]
Aug 05 19:05:47.976819 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.976805    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f215703-c931-415c-a24e-ef15257ee40c" containerName="console"
Aug 05 19:05:47.976875 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.976822    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f215703-c931-415c-a24e-ef15257ee40c" containerName="console"
Aug 05 19:05:47.976875 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.976836    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" containerName="console"
Aug 05 19:05:47.976875 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.976845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" containerName="console"
Aug 05 19:05:47.977032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.976888    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6c5a1f-67d7-42df-a3e7-cdc8a2b2c7f2" containerName="console"
Aug 05 19:05:47.977032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.976896    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f215703-c931-415c-a24e-ef15257ee40c" containerName="console"
Aug 05 19:05:47.979811 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.979794    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:47.981982 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.981965    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 05 19:05:47.982786 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.982765    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l44jj\""
Aug 05 19:05:47.982882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.982807    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 05 19:05:47.987511 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:47.987453    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"]
Aug 05 19:05:48.084146 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.084106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gvxl\" (UniqueName: \"kubernetes.io/projected/ef83bc44-5a6b-4a71-b086-81c31ad2f0ef-kube-api-access-2gvxl\") pod \"cert-manager-cainjector-559cdd8c87-pb75c\" (UID: \"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:48.084146 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.084153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef83bc44-5a6b-4a71-b086-81c31ad2f0ef-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pb75c\" (UID: \"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:48.185494 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.185462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gvxl\" (UniqueName: \"kubernetes.io/projected/ef83bc44-5a6b-4a71-b086-81c31ad2f0ef-kube-api-access-2gvxl\") pod \"cert-manager-cainjector-559cdd8c87-pb75c\" (UID: \"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:48.185620 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.185503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef83bc44-5a6b-4a71-b086-81c31ad2f0ef-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pb75c\" (UID: \"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:48.195830 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.195795    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef83bc44-5a6b-4a71-b086-81c31ad2f0ef-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pb75c\" (UID: \"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:48.195830 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.195816    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gvxl\" (UniqueName: \"kubernetes.io/projected/ef83bc44-5a6b-4a71-b086-81c31ad2f0ef-kube-api-access-2gvxl\") pod \"cert-manager-cainjector-559cdd8c87-pb75c\" (UID: \"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:48.303154 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.303121    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"
Aug 05 19:05:48.432763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.432714    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pb75c"]
Aug 05 19:05:48.435427 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:05:48.435400    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef83bc44_5a6b_4a71_b086_81c31ad2f0ef.slice/crio-8f5116776ad239ccf3ff84fec42d3c1189bb74ca33db65792c5d64d442164102 WatchSource:0}: Error finding container 8f5116776ad239ccf3ff84fec42d3c1189bb74ca33db65792c5d64d442164102: Status 404 returned error can't find the container with id 8f5116776ad239ccf3ff84fec42d3c1189bb74ca33db65792c5d64d442164102
Aug 05 19:05:48.492294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:48.492258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c" event={"ID":"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef","Type":"ContainerStarted","Data":"8f5116776ad239ccf3ff84fec42d3c1189bb74ca33db65792c5d64d442164102"}
Aug 05 19:05:50.587710 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:50.587655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:50.668283 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:50.668245    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:53.514750 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:53.514704    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c" event={"ID":"ef83bc44-5a6b-4a71-b086-81c31ad2f0ef","Type":"ContainerStarted","Data":"8db364127701d5d51a82f5692e87e5efe63bdcfea5e9e3d9192d8a2415609e12"}
Aug 05 19:05:53.530051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:53.529995    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pb75c" podStartSLOduration=2.032250633 podStartE2EDuration="6.529975672s" totalImagesPullingTime="4.497725039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:05:53.528866338 +0000 UTC m=+249.580354043" watchObservedRunningTime="2026-08-05 19:05:53.529975672 +0000 UTC m=+249.581463366"
Aug 05 19:05:53.697080 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:53.697045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:53.755030 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:53.754988    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:05:55.290577 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:05:55.290536    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:02.005068 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:02.005024    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:02.098057 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:02.098023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:04.022978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.022939    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"]
Aug 05 19:06:04.025624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.025601    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.028668 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.028638    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-k9p65\""
Aug 05 19:06:04.028789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.028642    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 05 19:06:04.028789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.028691    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 05 19:06:04.034964 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.034942    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"]
Aug 05 19:06:04.126848 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.126808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24crz\" (UniqueName: \"kubernetes.io/projected/b2f6103b-a125-40d3-a547-7a1e09822d6b-kube-api-access-24crz\") pod \"openshift-lws-operator-fd8ccff4c-dh4x5\" (UID: \"b2f6103b-a125-40d3-a547-7a1e09822d6b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.127026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.126950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2f6103b-a125-40d3-a547-7a1e09822d6b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dh4x5\" (UID: \"b2f6103b-a125-40d3-a547-7a1e09822d6b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.228260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.228219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2f6103b-a125-40d3-a547-7a1e09822d6b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dh4x5\" (UID: \"b2f6103b-a125-40d3-a547-7a1e09822d6b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.228260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.228265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24crz\" (UniqueName: \"kubernetes.io/projected/b2f6103b-a125-40d3-a547-7a1e09822d6b-kube-api-access-24crz\") pod \"openshift-lws-operator-fd8ccff4c-dh4x5\" (UID: \"b2f6103b-a125-40d3-a547-7a1e09822d6b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.228619 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.228594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2f6103b-a125-40d3-a547-7a1e09822d6b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dh4x5\" (UID: \"b2f6103b-a125-40d3-a547-7a1e09822d6b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.235673 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.235650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24crz\" (UniqueName: \"kubernetes.io/projected/b2f6103b-a125-40d3-a547-7a1e09822d6b-kube-api-access-24crz\") pod \"openshift-lws-operator-fd8ccff4c-dh4x5\" (UID: \"b2f6103b-a125-40d3-a547-7a1e09822d6b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.335052 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.334977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"
Aug 05 19:06:04.459789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.459759    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5"]
Aug 05 19:06:04.463458 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:06:04.463429    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2f6103b_a125_40d3_a547_7a1e09822d6b.slice/crio-4515a926118ca3f48ee2ed9e13bc3d9148287a383728461f4a5c1ca20ae0f519 WatchSource:0}: Error finding container 4515a926118ca3f48ee2ed9e13bc3d9148287a383728461f4a5c1ca20ae0f519: Status 404 returned error can't find the container with id 4515a926118ca3f48ee2ed9e13bc3d9148287a383728461f4a5c1ca20ae0f519
Aug 05 19:06:04.554769 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:04.554731    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5" event={"ID":"b2f6103b-a125-40d3-a547-7a1e09822d6b","Type":"ContainerStarted","Data":"4515a926118ca3f48ee2ed9e13bc3d9148287a383728461f4a5c1ca20ae0f519"}
Aug 05 19:06:07.570250 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:07.570208    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5" event={"ID":"b2f6103b-a125-40d3-a547-7a1e09822d6b","Type":"ContainerStarted","Data":"f1f4c56744a816d2c2be40cb8b504b7007ec8409c969e7897ba38154249bee27"}
Aug 05 19:06:07.586776 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:07.586724    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dh4x5" podStartSLOduration=0.92366327 podStartE2EDuration="3.586710188s" totalImagesPullingTime="2.663046918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:07.58491959 +0000 UTC m=+263.636407288" watchObservedRunningTime="2026-08-05 19:06:07.586710188 +0000 UTC m=+263.638197883"
Aug 05 19:06:08.303515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:08.303483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:08.403860 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:08.403822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:10.061727 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:10.061696    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:22.267920 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.267880    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:22.311087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.311052    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"]
Aug 05 19:06:22.314600 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.314579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.316885 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.316866    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 05 19:06:22.317661 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.317638    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 05 19:06:22.317770 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.317667    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2m22n\""
Aug 05 19:06:22.317770 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.317689    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 05 19:06:22.323800 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.323777    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"]
Aug 05 19:06:22.474970 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.474939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ade799-4eba-4c0e-adff-456c5fee5e01-cert\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.475151 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.474976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fcj\" (UniqueName: \"kubernetes.io/projected/20ade799-4eba-4c0e-adff-456c5fee5e01-kube-api-access-j9fcj\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.475151 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.475001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20ade799-4eba-4c0e-adff-456c5fee5e01-metrics-cert\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.475151 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.475086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20ade799-4eba-4c0e-adff-456c5fee5e01-manager-config\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.575820 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.575789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20ade799-4eba-4c0e-adff-456c5fee5e01-manager-config\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.576025 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.575850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ade799-4eba-4c0e-adff-456c5fee5e01-cert\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.576025 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.575889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fcj\" (UniqueName: \"kubernetes.io/projected/20ade799-4eba-4c0e-adff-456c5fee5e01-kube-api-access-j9fcj\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.576025 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.575923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20ade799-4eba-4c0e-adff-456c5fee5e01-metrics-cert\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.576597 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.576572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20ade799-4eba-4c0e-adff-456c5fee5e01-manager-config\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.578555 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.578526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20ade799-4eba-4c0e-adff-456c5fee5e01-metrics-cert\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.578654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.578583    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ade799-4eba-4c0e-adff-456c5fee5e01-cert\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.583420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.583397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fcj\" (UniqueName: \"kubernetes.io/projected/20ade799-4eba-4c0e-adff-456c5fee5e01-kube-api-access-j9fcj\") pod \"lws-controller-manager-5bf99ddcb-8dczr\" (UID: \"20ade799-4eba-4c0e-adff-456c5fee5e01\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.624210 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.624166    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:22.754043 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:22.754018    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"]
Aug 05 19:06:22.755976 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:06:22.755950    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ade799_4eba_4c0e_adff_456c5fee5e01.slice/crio-52239cb4c6340f9f15d0e4bf7d7d9bf4fbd6993b4900016235869f8438e11247 WatchSource:0}: Error finding container 52239cb4c6340f9f15d0e4bf7d7d9bf4fbd6993b4900016235869f8438e11247: Status 404 returned error can't find the container with id 52239cb4c6340f9f15d0e4bf7d7d9bf4fbd6993b4900016235869f8438e11247
Aug 05 19:06:23.568318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:23.568279    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:23.628634 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:23.628600    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr" event={"ID":"20ade799-4eba-4c0e-adff-456c5fee5e01","Type":"ContainerStarted","Data":"52239cb4c6340f9f15d0e4bf7d7d9bf4fbd6993b4900016235869f8438e11247"}
Aug 05 19:06:25.640449 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:25.640407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr" event={"ID":"20ade799-4eba-4c0e-adff-456c5fee5e01","Type":"ContainerStarted","Data":"4c2cb999c10872c46e9da968e510874eb707c81c87f944331c158b963977d8f1"}
Aug 05 19:06:25.640897 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:25.640530    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:25.657035 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:25.656990    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr" podStartSLOduration=1.708415927 podStartE2EDuration="3.656974785s" totalImagesPullingTime="1.948558858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:25.655897434 +0000 UTC m=+281.707385128" watchObservedRunningTime="2026-08-05 19:06:25.656974785 +0000 UTC m=+281.708462476"
Aug 05 19:06:28.312086 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:28.312052    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:28.412691 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:28.412654    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:28.906501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:28.906463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.121556 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.121516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.227971 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.227890    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.263631 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.263597    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"]
Aug 05 19:06:29.268548 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.268522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.271098 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.271051    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 19:06:29.271272 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.271116    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rp8sm\""
Aug 05 19:06:29.271272 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.271229    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 19:06:29.271401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.271341    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 19:06:29.271401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.271381    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 19:06:29.291639 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.291610    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"]
Aug 05 19:06:29.321388 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.321360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/357fca42-3f1f-4a1f-889b-c93c893fd0e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.321697 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.321397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/357fca42-3f1f-4a1f-889b-c93c893fd0e8-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.321697 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.321417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/357fca42-3f1f-4a1f-889b-c93c893fd0e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.321697 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.321490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357fca42-3f1f-4a1f-889b-c93c893fd0e8-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.321697 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.321528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dddmv\" (UniqueName: \"kubernetes.io/projected/357fca42-3f1f-4a1f-889b-c93c893fd0e8-kube-api-access-dddmv\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.366843 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.366817    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.422654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.422627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/357fca42-3f1f-4a1f-889b-c93c893fd0e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.422835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.422665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/357fca42-3f1f-4a1f-889b-c93c893fd0e8-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.422835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.422685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/357fca42-3f1f-4a1f-889b-c93c893fd0e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.422835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.422727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357fca42-3f1f-4a1f-889b-c93c893fd0e8-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.422835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.422757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dddmv\" (UniqueName: \"kubernetes.io/projected/357fca42-3f1f-4a1f-889b-c93c893fd0e8-kube-api-access-dddmv\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.423077 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.423055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/357fca42-3f1f-4a1f-889b-c93c893fd0e8-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.425207 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.425156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357fca42-3f1f-4a1f-889b-c93c893fd0e8-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.425417 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.425395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/357fca42-3f1f-4a1f-889b-c93c893fd0e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.425483 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.425435    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/357fca42-3f1f-4a1f-889b-c93c893fd0e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.444898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.444874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dddmv\" (UniqueName: \"kubernetes.io/projected/357fca42-3f1f-4a1f-889b-c93c893fd0e8-kube-api-access-dddmv\") pod \"opendatahub-operator-controller-manager-74df9bd579-88dts\" (UID: \"357fca42-3f1f-4a1f-889b-c93c893fd0e8\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.473321 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.473287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.576633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.576595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.579477 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.579454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:29.674413 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.674384    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.711431 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.711401    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"]
Aug 05 19:06:29.714654 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:06:29.714629    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357fca42_3f1f_4a1f_889b_c93c893fd0e8.slice/crio-0ec5e7439f926848e126709996c6d4e2cb33d8b847cc29b333266a8e9ac14376 WatchSource:0}: Error finding container 0ec5e7439f926848e126709996c6d4e2cb33d8b847cc29b333266a8e9ac14376: Status 404 returned error can't find the container with id 0ec5e7439f926848e126709996c6d4e2cb33d8b847cc29b333266a8e9ac14376
Aug 05 19:06:29.778524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.778493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:29.875307 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:29.875229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:30.663167 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:30.663132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts" event={"ID":"357fca42-3f1f-4a1f-889b-c93c893fd0e8","Type":"ContainerStarted","Data":"0ec5e7439f926848e126709996c6d4e2cb33d8b847cc29b333266a8e9ac14376"}
Aug 05 19:06:33.680941 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:33.680904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts" event={"ID":"357fca42-3f1f-4a1f-889b-c93c893fd0e8","Type":"ContainerStarted","Data":"ed13eed478ba2a44063a4e65beee6643a4eb5d5bef0f8cc43d4f801e3ad017b4"}
Aug 05 19:06:34.686066 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:34.686035    2558 generic.go:356] "Generic (PLEG): container finished" podID="357fca42-3f1f-4a1f-889b-c93c893fd0e8" containerID="ed13eed478ba2a44063a4e65beee6643a4eb5d5bef0f8cc43d4f801e3ad017b4" exitCode=0
Aug 05 19:06:34.686464 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:34.686079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts" event={"ID":"357fca42-3f1f-4a1f-889b-c93c893fd0e8","Type":"ContainerDied","Data":"ed13eed478ba2a44063a4e65beee6643a4eb5d5bef0f8cc43d4f801e3ad017b4"}
Aug 05 19:06:35.692031 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:35.691983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts" event={"ID":"357fca42-3f1f-4a1f-889b-c93c893fd0e8","Type":"ContainerStarted","Data":"1a792b56563af31ed889bcd4e25c3c3d91d9fe5023603b04422e4e219d6327c5"}
Aug 05 19:06:35.692446 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:35.692130    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:35.713345 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:35.713302    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts" podStartSLOduration=2.370209536 podStartE2EDuration="6.713287819s" totalImagesPullingTime="3.305139065s" totalInitContainerRuntime="1.037939218s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:35.710853887 +0000 UTC m=+291.762341580" watchObservedRunningTime="2026-08-05 19:06:35.713287819 +0000 UTC m=+291.764775512"
Aug 05 19:06:36.646977 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:36.646948    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-8dczr"
Aug 05 19:06:40.820243 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:40.820205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:40.920835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:40.920803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:44.321774 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:44.321747    2558 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 19:06:46.699378 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:46.699350    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-88dts"
Aug 05 19:06:48.314735 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:48.314696    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:48.435999 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:48.435958    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:49.067259 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:49.067230    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:49.148076 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:49.148038    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:49.256455 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:49.256426    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:49.538966 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:49.538931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:49.610657 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:49.610618    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:49.823236 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:49.823130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:58.220802 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:58.220753    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:59.148461 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.148424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:59.241168 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.241122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:59.384420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.384361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:59.480934 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.480854    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"]
Aug 05 19:06:59.483274 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.483249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.486827 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.486805    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 05 19:06:59.488114 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.488095    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 05 19:06:59.488538 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.488519    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 19:06:59.489318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.489299    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 19:06:59.490063 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.490047    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9mvw6\""
Aug 05 19:06:59.504063 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.504034    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"]
Aug 05 19:06:59.575554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.575516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tmp\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.575741 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.575562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.575741 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.575635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rphfv\" (UniqueName: \"kubernetes.io/projected/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-kube-api-access-rphfv\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.600896 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.600860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:06:59.677102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.677067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tmp\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.677102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.677103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.677372 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.677157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rphfv\" (UniqueName: \"kubernetes.io/projected/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-kube-api-access-rphfv\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.677372 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:06:59.677304    2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Aug 05 19:06:59.677478 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:06:59.677394    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs podName:24a0cf82-dc5c-44a9-9ce1-077a7438bac8 nodeName:}" failed. No retries permitted until 2026-08-05 19:07:00.177371446 +0000 UTC m=+316.228859120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs") pod "kube-auth-proxy-5556bf7c7c-r4xkj" (UID: "24a0cf82-dc5c-44a9-9ce1-077a7438bac8") : secret "kube-auth-proxy-tls" not found
Aug 05 19:06:59.679476 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.679457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tmp\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.688389 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.688364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rphfv\" (UniqueName: \"kubernetes.io/projected/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-kube-api-access-rphfv\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:06:59.699140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:06:59.699114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:00.181890 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:00.181851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:07:00.182103 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:07:00.182080    2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Aug 05 19:07:00.182223 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:07:00.182168    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs podName:24a0cf82-dc5c-44a9-9ce1-077a7438bac8 nodeName:}" failed. No retries permitted until 2026-08-05 19:07:01.182145167 +0000 UTC m=+317.233632837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs") pod "kube-auth-proxy-5556bf7c7c-r4xkj" (UID: "24a0cf82-dc5c-44a9-9ce1-077a7438bac8") : secret "kube-auth-proxy-tls" not found
Aug 05 19:07:00.434051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:00.433960    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:00.528290 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:00.528243    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:00.624917 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:00.624879    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:00.724394 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:00.724299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:01.191589 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.191538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:07:01.194254 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.194232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a0cf82-dc5c-44a9-9ce1-077a7438bac8-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-r4xkj\" (UID: \"24a0cf82-dc5c-44a9-9ce1-077a7438bac8\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:07:01.295111 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.295072    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"
Aug 05 19:07:01.397839 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.397808    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:01.499329 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.499256    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj"]
Aug 05 19:07:01.502770 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:07:01.502743    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a0cf82_dc5c_44a9_9ce1_077a7438bac8.slice/crio-a8ef80fa68c765b7ed919f2d4368b42c389d63ca7cddeb2a8fe9b840cc732b21 WatchSource:0}: Error finding container a8ef80fa68c765b7ed919f2d4368b42c389d63ca7cddeb2a8fe9b840cc732b21: Status 404 returned error can't find the container with id a8ef80fa68c765b7ed919f2d4368b42c389d63ca7cddeb2a8fe9b840cc732b21
Aug 05 19:07:01.504812 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.504792    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:07:01.537695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.537666    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:01.802066 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:01.802031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj" event={"ID":"24a0cf82-dc5c-44a9-9ce1-077a7438bac8","Type":"ContainerStarted","Data":"a8ef80fa68c765b7ed919f2d4368b42c389d63ca7cddeb2a8fe9b840cc732b21"}
Aug 05 19:07:02.706481 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:02.706390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:04.816139 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:04.816104    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj" event={"ID":"24a0cf82-dc5c-44a9-9ce1-077a7438bac8","Type":"ContainerStarted","Data":"9b826743b924efeb589941c04b969bb5264d820c6ef533c8f59acf63908ef05d"}
Aug 05 19:07:04.832744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:04.832658    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-r4xkj" podStartSLOduration=2.76525222 podStartE2EDuration="5.832642361s" totalImagesPullingTime="3.067390141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:07:04.831115895 +0000 UTC m=+320.882603586" watchObservedRunningTime="2026-08-05 19:07:04.832642361 +0000 UTC m=+320.884130053"
Aug 05 19:07:05.859659 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:05.859620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:05.943288 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:05.943246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:06.034934 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:06.034897    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:06.156576 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:06.156485    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:06.430906 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:06.430828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:06.531414 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:06.531375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:22.005587 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:22.005548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:22.061988 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:22.061959    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:23.936689 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:23.936656    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:24.037497 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:24.037460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:49.887828 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:49.887798    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:07:49.996550 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:07:49.996514    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:06.844074 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.844036    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4b88f4d5-gg627"]
Aug 05 19:08:06.846496 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.846476    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.861715 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.861692    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4b88f4d5-gg627"]
Aug 05 19:08:06.903368 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.903329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:06.950258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.950219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-oauth-config\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.950258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.950265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-trusted-ca-bundle\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.950501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.950283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn265\" (UniqueName: \"kubernetes.io/projected/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-kube-api-access-zn265\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.950501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.950304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-service-ca\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.950501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.950385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-serving-cert\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.950501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.950452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-config\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.950666 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.950538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-oauth-serving-cert\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:06.954152 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:06.954128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:07.043607 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.043561    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:07.051559 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.051530    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-service-ca\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.051559 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.051560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-serving-cert\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.051713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.051584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-config\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.051713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.051652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-oauth-serving-cert\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.051713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.051693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-oauth-config\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.051857 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.051722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-trusted-ca-bundle\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.051857 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.051747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn265\" (UniqueName: \"kubernetes.io/projected/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-kube-api-access-zn265\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.052363 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.052332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-service-ca\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.052639 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.052473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-oauth-serving-cert\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.052639 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.052492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-config\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.052985 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.052960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-trusted-ca-bundle\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.054277 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.054254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-oauth-config\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.054469 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.054450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-console-serving-cert\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.060118 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.060096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn265\" (UniqueName: \"kubernetes.io/projected/3b29ef4c-fa02-4f47-a94f-f7e8e79f7743-kube-api-access-zn265\") pod \"console-6f4b88f4d5-gg627\" (UID: \"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743\") " pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.106530 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.106441    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:07.155461 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.155433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:07.287832 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.287710    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4b88f4d5-gg627"]
Aug 05 19:08:07.290576 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:08:07.290541    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b29ef4c_fa02_4f47_a94f_f7e8e79f7743.slice/crio-41611af502a2ae8074c70b8368901ea95fcea9db8f064375d011680484b70f61 WatchSource:0}: Error finding container 41611af502a2ae8074c70b8368901ea95fcea9db8f064375d011680484b70f61: Status 404 returned error can't find the container with id 41611af502a2ae8074c70b8368901ea95fcea9db8f064375d011680484b70f61
Aug 05 19:08:07.656549 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.656505    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:07.757789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:07.757758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:08.075832 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:08.075803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4b88f4d5-gg627" event={"ID":"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743","Type":"ContainerStarted","Data":"b7b15f5a864c0e288de432f564e5f9f2ee84fd53944e140b1ccc4ab8458d06af"}
Aug 05 19:08:08.076204 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:08.075849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4b88f4d5-gg627" event={"ID":"3b29ef4c-fa02-4f47-a94f-f7e8e79f7743","Type":"ContainerStarted","Data":"41611af502a2ae8074c70b8368901ea95fcea9db8f064375d011680484b70f61"}
Aug 05 19:08:08.092675 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:08.092622    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4b88f4d5-gg627" podStartSLOduration=2.092607062 podStartE2EDuration="2.092607062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:08.091087271 +0000 UTC m=+384.142574962" watchObservedRunningTime="2026-08-05 19:08:08.092607062 +0000 UTC m=+384.144094754"
Aug 05 19:08:09.141471 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:09.141439    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:11.935793 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:11.935755    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:13.523364 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:13.523328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:13.934390 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:13.934302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:14.225871 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:14.225787    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:15.555592 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:15.555551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:16.524636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:16.524596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:16.630310 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:16.630275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:16.951367 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:16.951286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:17.057347 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:17.057310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:17.156196 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:17.156159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:17.156353 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:17.156249    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:17.161347 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:17.161323    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:17.355241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:17.355200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:17.455110 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:17.455073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:17.983174 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:17.983143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:18.108385 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:18.108350    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:18.121512 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:18.121491    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4b88f4d5-gg627"
Aug 05 19:08:18.181220 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:18.181168    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f997f8ddc-lcxsh"]
Aug 05 19:08:18.312383 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:18.312332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:18.406836 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:18.406792    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:18.507744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:18.507709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:20.537016 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.536981    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"]
Aug 05 19:08:20.539329 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.539313    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.541580 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.541563    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 19:08:20.541580 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.541571    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 19:08:20.541711 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.541619    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kfct5\""
Aug 05 19:08:20.554061 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.554039    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"]
Aug 05 19:08:20.564700 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.564678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b39f0ce4-38b7-466a-b89b-f52275cdda42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.564830 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.564775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjp55\" (UniqueName: \"kubernetes.io/projected/b39f0ce4-38b7-466a-b89b-f52275cdda42-kube-api-access-fjp55\") pod \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.665418 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.665386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b39f0ce4-38b7-466a-b89b-f52275cdda42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.665592 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.665447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjp55\" (UniqueName: \"kubernetes.io/projected/b39f0ce4-38b7-466a-b89b-f52275cdda42-kube-api-access-fjp55\") pod \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.665858 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.665840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b39f0ce4-38b7-466a-b89b-f52275cdda42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.676422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.676392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjp55\" (UniqueName: \"kubernetes.io/projected/b39f0ce4-38b7-466a-b89b-f52275cdda42-kube-api-access-fjp55\") pod \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.849767 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.849675    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:20.980251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:20.980224    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"]
Aug 05 19:08:20.983938 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:08:20.983913    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39f0ce4_38b7_466a_b89b_f52275cdda42.slice/crio-7a13d147a2820bfbc71c1c3c1a46ae5aa5b08f33217c8e43def0810f5ff8fa44 WatchSource:0}: Error finding container 7a13d147a2820bfbc71c1c3c1a46ae5aa5b08f33217c8e43def0810f5ff8fa44: Status 404 returned error can't find the container with id 7a13d147a2820bfbc71c1c3c1a46ae5aa5b08f33217c8e43def0810f5ff8fa44
Aug 05 19:08:21.130562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:21.130477    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4" event={"ID":"b39f0ce4-38b7-466a-b89b-f52275cdda42","Type":"ContainerStarted","Data":"7a13d147a2820bfbc71c1c3c1a46ae5aa5b08f33217c8e43def0810f5ff8fa44"}
Aug 05 19:08:21.752553 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:21.752518    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:21.856333 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:21.856304    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:25.125695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:25.125661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:25.239359 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:25.239309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:26.155672 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:26.155634    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4" event={"ID":"b39f0ce4-38b7-466a-b89b-f52275cdda42","Type":"ContainerStarted","Data":"624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16"}
Aug 05 19:08:26.156099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:26.155760    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:26.176561 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:26.176517    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4" podStartSLOduration=1.126743027 podStartE2EDuration="6.176498546s" totalImagesPullingTime="5.049755519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:26.175844919 +0000 UTC m=+402.227332610" watchObservedRunningTime="2026-08-05 19:08:26.176498546 +0000 UTC m=+402.227986232"
Aug 05 19:08:28.599633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:28.599589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:29.006926 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:29.006821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:29.547327 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:29.547293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:29.648925 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:29.648897    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:34.269564 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:34.269527    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:34.369845 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:34.369811    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:34.425741 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:34.425703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:37.162218 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:37.162171    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:38.736690 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.736653    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"]
Aug 05 19:08:38.737135 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.736854    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" containerName="manager" containerID="cri-o://624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16" gracePeriod=2
Aug 05 19:08:38.745930 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.745905    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"]
Aug 05 19:08:38.748309 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:38.748265    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b39f0ce4-38b7-466a-b89b-f52275cdda42\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-hfnr4\": pods \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:38.758343 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.758322    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"]
Aug 05 19:08:38.758635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.758622    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" containerName="manager"
Aug 05 19:08:38.758635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.758634    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" containerName="manager"
Aug 05 19:08:38.758773 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.758695    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" containerName="manager"
Aug 05 19:08:38.761614 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.761595    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:38.763487 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:38.763465    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:38.774941 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.774908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"]
Aug 05 19:08:38.829580 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.829553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kh28\" (UniqueName: \"kubernetes.io/projected/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-kube-api-access-2kh28\") pod \"kuadrant-operator-controller-manager-58fc56757c-g92p2\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:38.829748 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.829639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-g92p2\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:38.930770 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.930727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-g92p2\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:38.930950 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.930786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kh28\" (UniqueName: \"kubernetes.io/projected/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-kube-api-access-2kh28\") pod \"kuadrant-operator-controller-manager-58fc56757c-g92p2\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:38.931105 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.931079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-g92p2\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:38.943465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.943435    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kh28\" (UniqueName: \"kubernetes.io/projected/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-kube-api-access-2kh28\") pod \"kuadrant-operator-controller-manager-58fc56757c-g92p2\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:38.977232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:38.977171    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:38.979273 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:38.979234    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:39.120656 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.120623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:39.132145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.132123    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b39f0ce4-38b7-466a-b89b-f52275cdda42-extensions-socket-volume\") pod \"b39f0ce4-38b7-466a-b89b-f52275cdda42\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") "
Aug 05 19:08:39.132241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.132192    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjp55\" (UniqueName: \"kubernetes.io/projected/b39f0ce4-38b7-466a-b89b-f52275cdda42-kube-api-access-fjp55\") pod \"b39f0ce4-38b7-466a-b89b-f52275cdda42\" (UID: \"b39f0ce4-38b7-466a-b89b-f52275cdda42\") "
Aug 05 19:08:39.132809 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.132777    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b39f0ce4-38b7-466a-b89b-f52275cdda42-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b39f0ce4-38b7-466a-b89b-f52275cdda42" (UID: "b39f0ce4-38b7-466a-b89b-f52275cdda42"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:08:39.134604 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.134573    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b39f0ce4-38b7-466a-b89b-f52275cdda42-kube-api-access-fjp55" (OuterVolumeSpecName: "kube-api-access-fjp55") pod "b39f0ce4-38b7-466a-b89b-f52275cdda42" (UID: "b39f0ce4-38b7-466a-b89b-f52275cdda42"). InnerVolumeSpecName "kube-api-access-fjp55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:08:39.217833 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.217798    2558 generic.go:356] "Generic (PLEG): container finished" podID="b39f0ce4-38b7-466a-b89b-f52275cdda42" containerID="624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16" exitCode=0
Aug 05 19:08:39.218003 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.217855    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:39.218003 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.217904    2558 scope.go:117] "RemoveContainer" containerID="624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16"
Aug 05 19:08:39.220092 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:39.220057    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:39.228615 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.228585    2558 scope.go:117] "RemoveContainer" containerID="624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16"
Aug 05 19:08:39.228974 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:39.228941    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16\": container with ID starting with 624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16 not found: ID does not exist" containerID="624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16"
Aug 05 19:08:39.229057 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.228980    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16"} err="failed to get container status \"624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16\": rpc error: code = NotFound desc = could not find container \"624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16\": container with ID starting with 624e6ba627f42ac60e07fd153160b88fd15360f7b7a68c77716726c6b8b14e16 not found: ID does not exist"
Aug 05 19:08:39.230962 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:39.230937    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:39.233392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.233373    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b39f0ce4-38b7-466a-b89b-f52275cdda42-extensions-socket-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:39.233486 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.233401    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjp55\" (UniqueName: \"kubernetes.io/projected/b39f0ce4-38b7-466a-b89b-f52275cdda42-kube-api-access-fjp55\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:39.256898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:39.256845    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"]
Aug 05 19:08:39.259885 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:08:39.259845    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9376f4fa_dcc4_478d_9ba8_63c478da7a3a.slice/crio-ff7d13961bdd17ea06d7222ec771cef0d2ebcfd24184a59592d261dd72d36bd7 WatchSource:0}: Error finding container ff7d13961bdd17ea06d7222ec771cef0d2ebcfd24184a59592d261dd72d36bd7: Status 404 returned error can't find the container with id ff7d13961bdd17ea06d7222ec771cef0d2ebcfd24184a59592d261dd72d36bd7
Aug 05 19:08:40.224731 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:40.224695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2" event={"ID":"9376f4fa-dcc4-478d-9ba8-63c478da7a3a","Type":"ContainerStarted","Data":"7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548"}
Aug 05 19:08:40.225211 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:40.224743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2" event={"ID":"9376f4fa-dcc4-478d-9ba8-63c478da7a3a","Type":"ContainerStarted","Data":"ff7d13961bdd17ea06d7222ec771cef0d2ebcfd24184a59592d261dd72d36bd7"}
Aug 05 19:08:40.225211 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:40.224783    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:40.245413 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:40.245365    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2" podStartSLOduration=2.245350557 podStartE2EDuration="2.245350557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:40.243938211 +0000 UTC m=+416.295425934" watchObservedRunningTime="2026-08-05 19:08:40.245350557 +0000 UTC m=+416.296838249"
Aug 05 19:08:40.246044 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:40.246018    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-hfnr4\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-hfnr4"
Aug 05 19:08:40.475195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:40.475103    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b39f0ce4-38b7-466a-b89b-f52275cdda42" path="/var/lib/kubelet/pods/b39f0ce4-38b7-466a-b89b-f52275cdda42/volumes"
Aug 05 19:08:40.958828 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:40.958793    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:41.055174 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:41.055137    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:43.201267 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.201224    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f997f8ddc-lcxsh" podUID="f29c8f50-54bb-4386-891a-89fb067c6421" containerName="console" containerID="cri-o://114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514" gracePeriod=15
Aug 05 19:08:43.470704 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.470682    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:08:43.576349 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576315    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-oauth-serving-cert\") pod \"f29c8f50-54bb-4386-891a-89fb067c6421\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") "
Aug 05 19:08:43.576349 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576347    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-console-config\") pod \"f29c8f50-54bb-4386-891a-89fb067c6421\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") "
Aug 05 19:08:43.576562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576366    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-service-ca\") pod \"f29c8f50-54bb-4386-891a-89fb067c6421\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") "
Aug 05 19:08:43.576562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576467    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-trusted-ca-bundle\") pod \"f29c8f50-54bb-4386-891a-89fb067c6421\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") "
Aug 05 19:08:43.576562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576494    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-serving-cert\") pod \"f29c8f50-54bb-4386-891a-89fb067c6421\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") "
Aug 05 19:08:43.576562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576525    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-oauth-config\") pod \"f29c8f50-54bb-4386-891a-89fb067c6421\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") "
Aug 05 19:08:43.576758 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576567    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct2xn\" (UniqueName: \"kubernetes.io/projected/f29c8f50-54bb-4386-891a-89fb067c6421-kube-api-access-ct2xn\") pod \"f29c8f50-54bb-4386-891a-89fb067c6421\" (UID: \"f29c8f50-54bb-4386-891a-89fb067c6421\") "
Aug 05 19:08:43.576812 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576746    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f29c8f50-54bb-4386-891a-89fb067c6421" (UID: "f29c8f50-54bb-4386-891a-89fb067c6421"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:08:43.576872 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576830    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-console-config" (OuterVolumeSpecName: "console-config") pod "f29c8f50-54bb-4386-891a-89fb067c6421" (UID: "f29c8f50-54bb-4386-891a-89fb067c6421"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:08:43.577001 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.576958    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f29c8f50-54bb-4386-891a-89fb067c6421" (UID: "f29c8f50-54bb-4386-891a-89fb067c6421"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:08:43.577141 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.577044    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:43.577141 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.577062    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:43.577141 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.577076    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-trusted-ca-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:43.577141 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.577128    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-service-ca" (OuterVolumeSpecName: "service-ca") pod "f29c8f50-54bb-4386-891a-89fb067c6421" (UID: "f29c8f50-54bb-4386-891a-89fb067c6421"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:08:43.579014 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.578993    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f29c8f50-54bb-4386-891a-89fb067c6421-kube-api-access-ct2xn" (OuterVolumeSpecName: "kube-api-access-ct2xn") pod "f29c8f50-54bb-4386-891a-89fb067c6421" (UID: "f29c8f50-54bb-4386-891a-89fb067c6421"). InnerVolumeSpecName "kube-api-access-ct2xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:08:43.579318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.579299    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f29c8f50-54bb-4386-891a-89fb067c6421" (UID: "f29c8f50-54bb-4386-891a-89fb067c6421"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:08:43.579374 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.579325    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f29c8f50-54bb-4386-891a-89fb067c6421" (UID: "f29c8f50-54bb-4386-891a-89fb067c6421"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:08:43.677635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.677595    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct2xn\" (UniqueName: \"kubernetes.io/projected/f29c8f50-54bb-4386-891a-89fb067c6421-kube-api-access-ct2xn\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:43.677635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.677627    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f29c8f50-54bb-4386-891a-89fb067c6421-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:43.677635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.677637    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:43.677635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:43.677645    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f29c8f50-54bb-4386-891a-89fb067c6421-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:44.142241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.142202    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:44.242057 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.242020    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:44.244719 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.244691    2558 generic.go:356] "Generic (PLEG): container finished" podID="f29c8f50-54bb-4386-891a-89fb067c6421" containerID="114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514" exitCode=0
Aug 05 19:08:44.244859 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.244733    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f997f8ddc-lcxsh"
Aug 05 19:08:44.244859 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.244771    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f997f8ddc-lcxsh" event={"ID":"f29c8f50-54bb-4386-891a-89fb067c6421","Type":"ContainerDied","Data":"114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514"}
Aug 05 19:08:44.244859 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.244817    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f997f8ddc-lcxsh" event={"ID":"f29c8f50-54bb-4386-891a-89fb067c6421","Type":"ContainerDied","Data":"032b8d56a294ef2fe9b56ef10895cf829b8b66865546ba232c711fae2daa119e"}
Aug 05 19:08:44.244859 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.244837    2558 scope.go:117] "RemoveContainer" containerID="114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514"
Aug 05 19:08:44.253721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.253706    2558 scope.go:117] "RemoveContainer" containerID="114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514"
Aug 05 19:08:44.253955 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:44.253938    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514\": container with ID starting with 114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514 not found: ID does not exist" containerID="114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514"
Aug 05 19:08:44.254002 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.253963    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514"} err="failed to get container status \"114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514\": rpc error: code = NotFound desc = could not find container \"114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514\": container with ID starting with 114950f2159e3661286b92588e7e3105a2bbd7a18f92e826af0924d924bc8514 not found: ID does not exist"
Aug 05 19:08:44.263987 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.263965    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f997f8ddc-lcxsh"]
Aug 05 19:08:44.269678 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.269658    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f997f8ddc-lcxsh"]
Aug 05 19:08:44.475215 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:44.475097    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f29c8f50-54bb-4386-891a-89fb067c6421" path="/var/lib/kubelet/pods/f29c8f50-54bb-4386-891a-89fb067c6421/volumes"
Aug 05 19:08:48.568535 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:48.568488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:48.626019 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:48.625991    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:48.736649 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:48.736612    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:48.837373 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:48.837284    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:51.232898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:51.232864    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:53.685377 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:53.685331    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:53.946882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:53.946783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:54.215691 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:54.215604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:08:54.960736 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:54.960696    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"]
Aug 05 19:08:54.961226 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:54.960906    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2" podUID="9376f4fa-dcc4-478d-9ba8-63c478da7a3a" containerName="manager" containerID="cri-o://7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548" gracePeriod=10
Aug 05 19:08:55.206227 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.206208    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:55.208822 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.208801    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"]
Aug 05 19:08:55.209117 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.209103    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f29c8f50-54bb-4386-891a-89fb067c6421" containerName="console"
Aug 05 19:08:55.209170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.209118    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f29c8f50-54bb-4386-891a-89fb067c6421" containerName="console"
Aug 05 19:08:55.209170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.209127    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9376f4fa-dcc4-478d-9ba8-63c478da7a3a" containerName="manager"
Aug 05 19:08:55.209170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.209137    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9376f4fa-dcc4-478d-9ba8-63c478da7a3a" containerName="manager"
Aug 05 19:08:55.209309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.209206    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f29c8f50-54bb-4386-891a-89fb067c6421" containerName="console"
Aug 05 19:08:55.209309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.209214    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9376f4fa-dcc4-478d-9ba8-63c478da7a3a" containerName="manager"
Aug 05 19:08:55.211563 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.211525    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.225216 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.225169    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"]
Aug 05 19:08:55.284520 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.284482    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-extensions-socket-volume\") pod \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") "
Aug 05 19:08:55.284520 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.284516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kh28\" (UniqueName: \"kubernetes.io/projected/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-kube-api-access-2kh28\") pod \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\" (UID: \"9376f4fa-dcc4-478d-9ba8-63c478da7a3a\") "
Aug 05 19:08:55.284762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.284605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-wzzvw\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.284762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.284648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b464p\" (UniqueName: \"kubernetes.io/projected/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-kube-api-access-b464p\") pod \"kuadrant-operator-controller-manager-68cf589589-wzzvw\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.284870 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.284831    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9376f4fa-dcc4-478d-9ba8-63c478da7a3a" (UID: "9376f4fa-dcc4-478d-9ba8-63c478da7a3a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:08:55.286725 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.286698    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-kube-api-access-2kh28" (OuterVolumeSpecName: "kube-api-access-2kh28") pod "9376f4fa-dcc4-478d-9ba8-63c478da7a3a" (UID: "9376f4fa-dcc4-478d-9ba8-63c478da7a3a"). InnerVolumeSpecName "kube-api-access-2kh28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:08:55.294844 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.294819    2558 generic.go:356] "Generic (PLEG): container finished" podID="9376f4fa-dcc4-478d-9ba8-63c478da7a3a" containerID="7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548" exitCode=0
Aug 05 19:08:55.294952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.294863    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"
Aug 05 19:08:55.294952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.294869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2" event={"ID":"9376f4fa-dcc4-478d-9ba8-63c478da7a3a","Type":"ContainerDied","Data":"7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548"}
Aug 05 19:08:55.294952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.294923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2" event={"ID":"9376f4fa-dcc4-478d-9ba8-63c478da7a3a","Type":"ContainerDied","Data":"ff7d13961bdd17ea06d7222ec771cef0d2ebcfd24184a59592d261dd72d36bd7"}
Aug 05 19:08:55.295078 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.294953    2558 scope.go:117] "RemoveContainer" containerID="7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548"
Aug 05 19:08:55.302989 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.302975    2558 scope.go:117] "RemoveContainer" containerID="7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548"
Aug 05 19:08:55.303260 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:08:55.303243    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548\": container with ID starting with 7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548 not found: ID does not exist" containerID="7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548"
Aug 05 19:08:55.303318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.303269    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548"} err="failed to get container status \"7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548\": rpc error: code = NotFound desc = could not find container \"7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548\": container with ID starting with 7919859c1c78f7fcf0c2dde42331299802cadaeee73eef0f285936d4155ae548 not found: ID does not exist"
Aug 05 19:08:55.323662 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.323635    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"]
Aug 05 19:08:55.329014 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.328994    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-g92p2"]
Aug 05 19:08:55.384992 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.384963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b464p\" (UniqueName: \"kubernetes.io/projected/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-kube-api-access-b464p\") pod \"kuadrant-operator-controller-manager-68cf589589-wzzvw\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.385129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.385046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-wzzvw\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.385129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.385103    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-extensions-socket-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:55.385129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.385119    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kh28\" (UniqueName: \"kubernetes.io/projected/9376f4fa-dcc4-478d-9ba8-63c478da7a3a-kube-api-access-2kh28\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:08:55.385488 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.385466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-wzzvw\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.393239 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.393219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b464p\" (UniqueName: \"kubernetes.io/projected/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-kube-api-access-b464p\") pod \"kuadrant-operator-controller-manager-68cf589589-wzzvw\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.520485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.520451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:55.654271 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:55.654237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"]
Aug 05 19:08:55.657310 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:08:55.657284    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94252fbb_0a74_4ac1_bbf4_f4daf094ef05.slice/crio-da79691524741eec6a45b01dc060988e73e0d2f86ad418cd54a81b905bfc5267 WatchSource:0}: Error finding container da79691524741eec6a45b01dc060988e73e0d2f86ad418cd54a81b905bfc5267: Status 404 returned error can't find the container with id da79691524741eec6a45b01dc060988e73e0d2f86ad418cd54a81b905bfc5267
Aug 05 19:08:56.301087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:56.301049    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw" event={"ID":"94252fbb-0a74-4ac1-bbf4-f4daf094ef05","Type":"ContainerStarted","Data":"0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c"}
Aug 05 19:08:56.301587 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:56.301119    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw" event={"ID":"94252fbb-0a74-4ac1-bbf4-f4daf094ef05","Type":"ContainerStarted","Data":"da79691524741eec6a45b01dc060988e73e0d2f86ad418cd54a81b905bfc5267"}
Aug 05 19:08:56.301587 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:56.301209    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:08:56.318923 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:56.318872    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw" podStartSLOduration=1.318854444 podStartE2EDuration="1.318854444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:56.318030091 +0000 UTC m=+432.369517798" watchObservedRunningTime="2026-08-05 19:08:56.318854444 +0000 UTC m=+432.370342244"
Aug 05 19:08:56.475075 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:08:56.475046    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9376f4fa-dcc4-478d-9ba8-63c478da7a3a" path="/var/lib/kubelet/pods/9376f4fa-dcc4-478d-9ba8-63c478da7a3a/volumes"
Aug 05 19:09:07.309049 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:07.308964    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:09:11.213796 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:11.213750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:11.335289 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:11.335252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:22.030925 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:22.030879    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:24.832652 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:24.832603    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:24.895630 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:24.895594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:24.947458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:24.947420    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:25.074978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.074947    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:09:25.078423 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.078402    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.080584 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.080564    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 19:09:25.080683 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.080660    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfhfh\""
Aug 05 19:09:25.084925 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.084863    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:09:25.102476 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.102455    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:09:25.236845 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.236811    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9d9r\" (UniqueName: \"kubernetes.io/projected/953cfa8e-62e2-4d3b-8b18-58335776a9cf-kube-api-access-f9d9r\") pod \"limitador-limitador-85d9db4d5d-cf95j\" (UID: \"953cfa8e-62e2-4d3b-8b18-58335776a9cf\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.237017 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.236867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/953cfa8e-62e2-4d3b-8b18-58335776a9cf-config-file\") pod \"limitador-limitador-85d9db4d5d-cf95j\" (UID: \"953cfa8e-62e2-4d3b-8b18-58335776a9cf\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.338028 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.337941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9d9r\" (UniqueName: \"kubernetes.io/projected/953cfa8e-62e2-4d3b-8b18-58335776a9cf-kube-api-access-f9d9r\") pod \"limitador-limitador-85d9db4d5d-cf95j\" (UID: \"953cfa8e-62e2-4d3b-8b18-58335776a9cf\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.338028 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.338006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/953cfa8e-62e2-4d3b-8b18-58335776a9cf-config-file\") pod \"limitador-limitador-85d9db4d5d-cf95j\" (UID: \"953cfa8e-62e2-4d3b-8b18-58335776a9cf\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.338596 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.338579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/953cfa8e-62e2-4d3b-8b18-58335776a9cf-config-file\") pod \"limitador-limitador-85d9db4d5d-cf95j\" (UID: \"953cfa8e-62e2-4d3b-8b18-58335776a9cf\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.345693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.345671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9d9r\" (UniqueName: \"kubernetes.io/projected/953cfa8e-62e2-4d3b-8b18-58335776a9cf-kube-api-access-f9d9r\") pod \"limitador-limitador-85d9db4d5d-cf95j\" (UID: \"953cfa8e-62e2-4d3b-8b18-58335776a9cf\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.390699 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.390659    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:25.521594 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.521570    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:09:25.524319 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:09:25.524275    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953cfa8e_62e2_4d3b_8b18_58335776a9cf.slice/crio-766b73aa7fb709bebeb26602bb174bec54f0a2691d34346214d9822aa72f9201 WatchSource:0}: Error finding container 766b73aa7fb709bebeb26602bb174bec54f0a2691d34346214d9822aa72f9201: Status 404 returned error can't find the container with id 766b73aa7fb709bebeb26602bb174bec54f0a2691d34346214d9822aa72f9201
Aug 05 19:09:25.563324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.563287    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-rp2v2"]
Aug 05 19:09:25.567931 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.567908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-rp2v2"
Aug 05 19:09:25.569920 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.569898    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kbdmn\""
Aug 05 19:09:25.572549 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.572527    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-rp2v2"]
Aug 05 19:09:25.592840 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.592758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:25.640475 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.640447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rk4z\" (UniqueName: \"kubernetes.io/projected/ee04de99-6f52-41bb-93be-7ad9dac73ce5-kube-api-access-6rk4z\") pod \"authorino-b54df94b4-rp2v2\" (UID: \"ee04de99-6f52-41bb-93be-7ad9dac73ce5\") " pod="kuadrant-system/authorino-b54df94b4-rp2v2"
Aug 05 19:09:25.682280 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.682219    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:25.741417 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.741371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rk4z\" (UniqueName: \"kubernetes.io/projected/ee04de99-6f52-41bb-93be-7ad9dac73ce5-kube-api-access-6rk4z\") pod \"authorino-b54df94b4-rp2v2\" (UID: \"ee04de99-6f52-41bb-93be-7ad9dac73ce5\") " pod="kuadrant-system/authorino-b54df94b4-rp2v2"
Aug 05 19:09:25.755047 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.755017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rk4z\" (UniqueName: \"kubernetes.io/projected/ee04de99-6f52-41bb-93be-7ad9dac73ce5-kube-api-access-6rk4z\") pod \"authorino-b54df94b4-rp2v2\" (UID: \"ee04de99-6f52-41bb-93be-7ad9dac73ce5\") " pod="kuadrant-system/authorino-b54df94b4-rp2v2"
Aug 05 19:09:25.878807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:25.878725    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-rp2v2"
Aug 05 19:09:26.003599 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:26.003574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-rp2v2"]
Aug 05 19:09:26.005883 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:09:26.005853    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee04de99_6f52_41bb_93be_7ad9dac73ce5.slice/crio-2ba2c8c27e235cd0a655d20c643c3f389dba075004ce9be67701924519905260 WatchSource:0}: Error finding container 2ba2c8c27e235cd0a655d20c643c3f389dba075004ce9be67701924519905260: Status 404 returned error can't find the container with id 2ba2c8c27e235cd0a655d20c643c3f389dba075004ce9be67701924519905260
Aug 05 19:09:26.436903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:26.436862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j" event={"ID":"953cfa8e-62e2-4d3b-8b18-58335776a9cf","Type":"ContainerStarted","Data":"766b73aa7fb709bebeb26602bb174bec54f0a2691d34346214d9822aa72f9201"}
Aug 05 19:09:26.438128 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:26.438094    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-rp2v2" event={"ID":"ee04de99-6f52-41bb-93be-7ad9dac73ce5","Type":"ContainerStarted","Data":"2ba2c8c27e235cd0a655d20c643c3f389dba075004ce9be67701924519905260"}
Aug 05 19:09:27.453595 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:27.453291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j" event={"ID":"953cfa8e-62e2-4d3b-8b18-58335776a9cf","Type":"ContainerStarted","Data":"a3cabb6c77ef779f851e8f8ed00a4ce4d47a6d44e1bde928fc2bd0e3c7674e17"}
Aug 05 19:09:27.453595 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:27.453522    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:27.471023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:27.470959    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j" podStartSLOduration=1.355065688 podStartE2EDuration="2.47093883s" totalImagesPullingTime="1.115873142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:09:27.468471825 +0000 UTC m=+463.519959529" watchObservedRunningTime="2026-08-05 19:09:27.47093883 +0000 UTC m=+463.522426525"
Aug 05 19:09:28.438962 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:28.438919    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:28.458630 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:28.458552    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-rp2v2" event={"ID":"ee04de99-6f52-41bb-93be-7ad9dac73ce5","Type":"ContainerStarted","Data":"e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6"}
Aug 05 19:09:28.475844 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:28.475799    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-rp2v2" podStartSLOduration=1.281476506 podStartE2EDuration="3.475784977s" totalImagesPullingTime="2.194308471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:09:28.474316251 +0000 UTC m=+464.525803945" watchObservedRunningTime="2026-08-05 19:09:28.475784977 +0000 UTC m=+464.527272668"
Aug 05 19:09:28.539621 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:28.539578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:29.183392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:29.183360    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-rp2v2"]
Aug 05 19:09:30.468690 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:30.468653    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-rp2v2" podUID="ee04de99-6f52-41bb-93be-7ad9dac73ce5" containerName="authorino" containerID="cri-o://e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6" gracePeriod=30
Aug 05 19:09:30.703522 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:30.703496    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-rp2v2"
Aug 05 19:09:30.782893 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:30.782865    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rk4z\" (UniqueName: \"kubernetes.io/projected/ee04de99-6f52-41bb-93be-7ad9dac73ce5-kube-api-access-6rk4z\") pod \"ee04de99-6f52-41bb-93be-7ad9dac73ce5\" (UID: \"ee04de99-6f52-41bb-93be-7ad9dac73ce5\") "
Aug 05 19:09:30.784956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:30.784922    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee04de99-6f52-41bb-93be-7ad9dac73ce5-kube-api-access-6rk4z" (OuterVolumeSpecName: "kube-api-access-6rk4z") pod "ee04de99-6f52-41bb-93be-7ad9dac73ce5" (UID: "ee04de99-6f52-41bb-93be-7ad9dac73ce5"). InnerVolumeSpecName "kube-api-access-6rk4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:09:30.884103 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:30.884068    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rk4z\" (UniqueName: \"kubernetes.io/projected/ee04de99-6f52-41bb-93be-7ad9dac73ce5-kube-api-access-6rk4z\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:09:31.473900 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.473872    2558 generic.go:356] "Generic (PLEG): container finished" podID="ee04de99-6f52-41bb-93be-7ad9dac73ce5" containerID="e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6" exitCode=0
Aug 05 19:09:31.474338 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.473905    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-rp2v2"
Aug 05 19:09:31.474338 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.473917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-rp2v2" event={"ID":"ee04de99-6f52-41bb-93be-7ad9dac73ce5","Type":"ContainerDied","Data":"e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6"}
Aug 05 19:09:31.474338 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.473940    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-rp2v2" event={"ID":"ee04de99-6f52-41bb-93be-7ad9dac73ce5","Type":"ContainerDied","Data":"2ba2c8c27e235cd0a655d20c643c3f389dba075004ce9be67701924519905260"}
Aug 05 19:09:31.474338 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.473957    2558 scope.go:117] "RemoveContainer" containerID="e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6"
Aug 05 19:09:31.482392 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.482374    2558 scope.go:117] "RemoveContainer" containerID="e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6"
Aug 05 19:09:31.482630 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:09:31.482610    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6\": container with ID starting with e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6 not found: ID does not exist" containerID="e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6"
Aug 05 19:09:31.482679 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.482639    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6"} err="failed to get container status \"e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6\": rpc error: code = NotFound desc = could not find container \"e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6\": container with ID starting with e7218967893f4a9a9db56dfe09b09e55d250bb26579757e3787ffdeeabda0dc6 not found: ID does not exist"
Aug 05 19:09:31.493954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.493929    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-rp2v2"]
Aug 05 19:09:31.496689 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:31.496667    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-rp2v2"]
Aug 05 19:09:32.477217 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:32.477163    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee04de99-6f52-41bb-93be-7ad9dac73ce5" path="/var/lib/kubelet/pods/ee04de99-6f52-41bb-93be-7ad9dac73ce5/volumes"
Aug 05 19:09:38.460007 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:38.459978    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"
Aug 05 19:09:44.270145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:44.270099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:44.365374 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:44.365349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:44.702287 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:44.702165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:56.588561 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.588527    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:56.688961 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.688932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:09:56.815240 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.815201    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6hgxh"]
Aug 05 19:09:56.815585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.815567    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee04de99-6f52-41bb-93be-7ad9dac73ce5" containerName="authorino"
Aug 05 19:09:56.815629 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.815588    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee04de99-6f52-41bb-93be-7ad9dac73ce5" containerName="authorino"
Aug 05 19:09:56.815663 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.815636    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee04de99-6f52-41bb-93be-7ad9dac73ce5" containerName="authorino"
Aug 05 19:09:56.818786 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.818770    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh"
Aug 05 19:09:56.820967 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.820946    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kbdmn\""
Aug 05 19:09:56.824922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.824902    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6hgxh"]
Aug 05 19:09:56.856652 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.856580    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6hgxh"]
Aug 05 19:09:56.856856 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:09:56.856837    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2cjq6], unattached volumes=[], failed to process volumes=[kube-api-access-2cjq6]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh" podUID="168ae4c7-0368-440e-9672-e56b897fbc8c"
Aug 05 19:09:56.877259 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.877227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cjq6\" (UniqueName: \"kubernetes.io/projected/168ae4c7-0368-440e-9672-e56b897fbc8c-kube-api-access-2cjq6\") pod \"authorino-5dc7ccb5f-6hgxh\" (UID: \"168ae4c7-0368-440e-9672-e56b897fbc8c\") " pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh"
Aug 05 19:09:56.882265 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.882245    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-x44sp"]
Aug 05 19:09:56.885465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.885442    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:56.887683 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.887665    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 05 19:09:56.892305 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.892285    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-x44sp"]
Aug 05 19:09:56.978272 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.978237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cjq6\" (UniqueName: \"kubernetes.io/projected/168ae4c7-0368-440e-9672-e56b897fbc8c-kube-api-access-2cjq6\") pod \"authorino-5dc7ccb5f-6hgxh\" (UID: \"168ae4c7-0368-440e-9672-e56b897fbc8c\") " pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh"
Aug 05 19:09:56.978272 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.978276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85968271-1880-4100-8a7a-9fe484d9c641-tls-cert\") pod \"authorino-687bd45585-x44sp\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") " pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:56.978477 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.978357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq6cr\" (UniqueName: \"kubernetes.io/projected/85968271-1880-4100-8a7a-9fe484d9c641-kube-api-access-pq6cr\") pod \"authorino-687bd45585-x44sp\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") " pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:56.985698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:56.985673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cjq6\" (UniqueName: \"kubernetes.io/projected/168ae4c7-0368-440e-9672-e56b897fbc8c-kube-api-access-2cjq6\") pod \"authorino-5dc7ccb5f-6hgxh\" (UID: \"168ae4c7-0368-440e-9672-e56b897fbc8c\") " pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh"
Aug 05 19:09:57.040741 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.040711    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-x44sp"]
Aug 05 19:09:57.040984 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:09:57.040966    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pq6cr tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-x44sp" podUID="85968271-1880-4100-8a7a-9fe484d9c641"
Aug 05 19:09:57.078890 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.078861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85968271-1880-4100-8a7a-9fe484d9c641-tls-cert\") pod \"authorino-687bd45585-x44sp\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") " pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:57.079033 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.078930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq6cr\" (UniqueName: \"kubernetes.io/projected/85968271-1880-4100-8a7a-9fe484d9c641-kube-api-access-pq6cr\") pod \"authorino-687bd45585-x44sp\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") " pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:57.081398 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.081376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85968271-1880-4100-8a7a-9fe484d9c641-tls-cert\") pod \"authorino-687bd45585-x44sp\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") " pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:57.086192 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.086155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq6cr\" (UniqueName: \"kubernetes.io/projected/85968271-1880-4100-8a7a-9fe484d9c641-kube-api-access-pq6cr\") pod \"authorino-687bd45585-x44sp\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") " pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:57.590075 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.590047    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:57.590518 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.590051    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh"
Aug 05 19:09:57.597288 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.597266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:57.599922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.599908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh"
Aug 05 19:09:57.682455 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.682421    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cjq6\" (UniqueName: \"kubernetes.io/projected/168ae4c7-0368-440e-9672-e56b897fbc8c-kube-api-access-2cjq6\") pod \"168ae4c7-0368-440e-9672-e56b897fbc8c\" (UID: \"168ae4c7-0368-440e-9672-e56b897fbc8c\") "
Aug 05 19:09:57.682455 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.682456    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq6cr\" (UniqueName: \"kubernetes.io/projected/85968271-1880-4100-8a7a-9fe484d9c641-kube-api-access-pq6cr\") pod \"85968271-1880-4100-8a7a-9fe484d9c641\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") "
Aug 05 19:09:57.682732 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.682511    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85968271-1880-4100-8a7a-9fe484d9c641-tls-cert\") pod \"85968271-1880-4100-8a7a-9fe484d9c641\" (UID: \"85968271-1880-4100-8a7a-9fe484d9c641\") "
Aug 05 19:09:57.684711 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.684682    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85968271-1880-4100-8a7a-9fe484d9c641-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "85968271-1880-4100-8a7a-9fe484d9c641" (UID: "85968271-1880-4100-8a7a-9fe484d9c641"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:09:57.684711 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.684697    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/168ae4c7-0368-440e-9672-e56b897fbc8c-kube-api-access-2cjq6" (OuterVolumeSpecName: "kube-api-access-2cjq6") pod "168ae4c7-0368-440e-9672-e56b897fbc8c" (UID: "168ae4c7-0368-440e-9672-e56b897fbc8c"). InnerVolumeSpecName "kube-api-access-2cjq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:09:57.684855 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.684774    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85968271-1880-4100-8a7a-9fe484d9c641-kube-api-access-pq6cr" (OuterVolumeSpecName: "kube-api-access-pq6cr") pod "85968271-1880-4100-8a7a-9fe484d9c641" (UID: "85968271-1880-4100-8a7a-9fe484d9c641"). InnerVolumeSpecName "kube-api-access-pq6cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:09:57.783015 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.782969    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cjq6\" (UniqueName: \"kubernetes.io/projected/168ae4c7-0368-440e-9672-e56b897fbc8c-kube-api-access-2cjq6\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:09:57.783015 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.783009    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq6cr\" (UniqueName: \"kubernetes.io/projected/85968271-1880-4100-8a7a-9fe484d9c641-kube-api-access-pq6cr\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:09:57.783015 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:57.783018    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85968271-1880-4100-8a7a-9fe484d9c641-tls-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:09:58.594137 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:58.594114    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-x44sp"
Aug 05 19:09:58.594540 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:58.594114    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6hgxh"
Aug 05 19:09:58.618208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:58.618153    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6hgxh"]
Aug 05 19:09:58.620553 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:58.620531    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6hgxh"]
Aug 05 19:09:58.638690 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:58.638663    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-x44sp"]
Aug 05 19:09:58.640694 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:09:58.640674    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-x44sp"]
Aug 05 19:10:00.475707 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:00.475667    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168ae4c7-0368-440e-9672-e56b897fbc8c" path="/var/lib/kubelet/pods/168ae4c7-0368-440e-9672-e56b897fbc8c/volumes"
Aug 05 19:10:00.476226 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:00.475943    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85968271-1880-4100-8a7a-9fe484d9c641" path="/var/lib/kubelet/pods/85968271-1880-4100-8a7a-9fe484d9c641/volumes"
Aug 05 19:10:03.811251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:03.811214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:03.911256 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:03.911219    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:03.989246 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:03.989200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:04.061366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:04.061276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:07.052616 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:07.052571    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:07.255111 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:07.255074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:19.092102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:19.092065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:38.436991 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:38.436904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:38.577324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:38.577294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:40.096401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:40.096367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:40.519819 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:40.519740    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:40.622482 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:40.622449    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:40.699864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:40.699829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:40.762726 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:40.762695    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:10:50.509455 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:50.509405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:50.598939 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:50.598902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:54.247801 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:54.247765    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:54.308723 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:54.308676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:56.609869 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:56.609831    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:10:57.243485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:10:57.243450    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:11:05.104945 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:11:05.104915    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:11:05.705272 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:11:05.705242    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:11:25.409657 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:11:25.409612    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:11:32.712113 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:11:32.712074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:11:33.598130 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:11:33.598087    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:11:39.559994 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:11:39.559954    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:11:39.618593 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:11:39.618549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:12:01.413563 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:01.413526    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:12:02.497715 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:02.497681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:12:11.775221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:11.774977    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:12:13.995608 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:13.995574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:12:28.981864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:28.981825    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"]
Aug 05 19:12:28.985265 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:28.985242    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:28.987407 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:28.987380    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 19:12:28.987519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:28.987435    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 19:12:28.988303 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:28.988284    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8tm4f\""
Aug 05 19:12:28.988380 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:28.988301    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Aug 05 19:12:28.992668 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:28.992644    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"]
Aug 05 19:12:29.089657 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.089620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:12:29.140986 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.140950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.141147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.141011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.141147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.141031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec7600b4-ad88-414e-adae-6ec5d0f4a823-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.141147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.141086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.141147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.141131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.141401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.141162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ng2j\" (UniqueName: \"kubernetes.io/projected/ec7600b4-ad88-414e-adae-6ec5d0f4a823-kube-api-access-6ng2j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.241943 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.241863    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.241943 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.241901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.241943 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.241930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ng2j\" (UniqueName: \"kubernetes.io/projected/ec7600b4-ad88-414e-adae-6ec5d0f4a823-kube-api-access-6ng2j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.242251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.241990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.242251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.242039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.242251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.242061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec7600b4-ad88-414e-adae-6ec5d0f4a823-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.242409 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.242363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.242519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.242481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.242606 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.242500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.244451 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.244428    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec7600b4-ad88-414e-adae-6ec5d0f4a823-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.244658 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.244638    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec7600b4-ad88-414e-adae-6ec5d0f4a823-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.248879 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.248857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ng2j\" (UniqueName: \"kubernetes.io/projected/ec7600b4-ad88-414e-adae-6ec5d0f4a823-kube-api-access-6ng2j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n966p\" (UID: \"ec7600b4-ad88-414e-adae-6ec5d0f4a823\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.295683 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.295657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:29.426448 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.426384    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"]
Aug 05 19:12:29.429247 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:12:29.429221    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec7600b4_ad88_414e_adae_6ec5d0f4a823.slice/crio-e82024a5539011a7cefcfcb0b2390e6e193e0ea7d2cbd3a782f65925558a2a89 WatchSource:0}: Error finding container e82024a5539011a7cefcfcb0b2390e6e193e0ea7d2cbd3a782f65925558a2a89: Status 404 returned error can't find the container with id e82024a5539011a7cefcfcb0b2390e6e193e0ea7d2cbd3a782f65925558a2a89
Aug 05 19:12:29.430926 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:29.430906    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:12:30.249622 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:30.249582    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p" event={"ID":"ec7600b4-ad88-414e-adae-6ec5d0f4a823","Type":"ContainerStarted","Data":"e82024a5539011a7cefcfcb0b2390e6e193e0ea7d2cbd3a782f65925558a2a89"}
Aug 05 19:12:31.100724 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:31.100687    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:12:31.256010 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:31.255972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p" event={"ID":"ec7600b4-ad88-414e-adae-6ec5d0f4a823","Type":"ContainerStarted","Data":"56c303acffea3ab764417139cdfcfe4dc0012e4504f73009a60bc200fbf58f17"}
Aug 05 19:12:31.273978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:31.273930    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p" podStartSLOduration=2.219361468 podStartE2EDuration="3.273914746s" totalImagesPullingTime="1.054553278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:12:31.272647413 +0000 UTC m=+647.324135118" watchObservedRunningTime="2026-08-05 19:12:31.273914746 +0000 UTC m=+647.325402438"
Aug 05 19:12:39.296784 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:39.296747    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:39.297252 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:39.296799    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:39.309385 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:39.309353    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:40.305954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:40.305920    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n966p"
Aug 05 19:12:42.096323 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:42.096287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:12:42.498573 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:12:42.498487    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:22.259364 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:22.259318    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:22.305804 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:22.305766    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:24.003894 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:24.003857    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:33.315454 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.315416    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68955bc4bc-m4gfh"]
Aug 05 19:13:33.318737 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.318715    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.321646 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.321623    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 05 19:13:33.321762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.321668    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kbdmn\""
Aug 05 19:13:33.327345 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.327322    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68955bc4bc-m4gfh"]
Aug 05 19:13:33.498397 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.498358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b525l\" (UniqueName: \"kubernetes.io/projected/c9ecc895-05c8-4302-9d3a-cb75c2c22d07-kube-api-access-b525l\") pod \"authorino-68955bc4bc-m4gfh\" (UID: \"c9ecc895-05c8-4302-9d3a-cb75c2c22d07\") " pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.498572 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.498401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9ecc895-05c8-4302-9d3a-cb75c2c22d07-tls-cert\") pod \"authorino-68955bc4bc-m4gfh\" (UID: \"c9ecc895-05c8-4302-9d3a-cb75c2c22d07\") " pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.599324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.599244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b525l\" (UniqueName: \"kubernetes.io/projected/c9ecc895-05c8-4302-9d3a-cb75c2c22d07-kube-api-access-b525l\") pod \"authorino-68955bc4bc-m4gfh\" (UID: \"c9ecc895-05c8-4302-9d3a-cb75c2c22d07\") " pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.599324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.599286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9ecc895-05c8-4302-9d3a-cb75c2c22d07-tls-cert\") pod \"authorino-68955bc4bc-m4gfh\" (UID: \"c9ecc895-05c8-4302-9d3a-cb75c2c22d07\") " pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.601947 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.601925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9ecc895-05c8-4302-9d3a-cb75c2c22d07-tls-cert\") pod \"authorino-68955bc4bc-m4gfh\" (UID: \"c9ecc895-05c8-4302-9d3a-cb75c2c22d07\") " pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.606732 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.606704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b525l\" (UniqueName: \"kubernetes.io/projected/c9ecc895-05c8-4302-9d3a-cb75c2c22d07-kube-api-access-b525l\") pod \"authorino-68955bc4bc-m4gfh\" (UID: \"c9ecc895-05c8-4302-9d3a-cb75c2c22d07\") " pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.628587 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.628554    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68955bc4bc-m4gfh"
Aug 05 19:13:33.757928 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:33.757902    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68955bc4bc-m4gfh"]
Aug 05 19:13:33.759897 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:13:33.759870    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9ecc895_05c8_4302_9d3a_cb75c2c22d07.slice/crio-efe70a6c1d65a11ec8a003420569357047c622a9aa7aac1ced8bf1bcb6657458 WatchSource:0}: Error finding container efe70a6c1d65a11ec8a003420569357047c622a9aa7aac1ced8bf1bcb6657458: Status 404 returned error can't find the container with id efe70a6c1d65a11ec8a003420569357047c622a9aa7aac1ced8bf1bcb6657458
Aug 05 19:13:34.527440 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:34.527403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68955bc4bc-m4gfh" event={"ID":"c9ecc895-05c8-4302-9d3a-cb75c2c22d07","Type":"ContainerStarted","Data":"efe70a6c1d65a11ec8a003420569357047c622a9aa7aac1ced8bf1bcb6657458"}
Aug 05 19:13:35.535436 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:35.535395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68955bc4bc-m4gfh" event={"ID":"c9ecc895-05c8-4302-9d3a-cb75c2c22d07","Type":"ContainerStarted","Data":"37e8c1f62c992dbd40c5ba42f1fbfafffb9869444da1aaa6d1f29344c4698bda"}
Aug 05 19:13:35.557888 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:35.557829    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68955bc4bc-m4gfh" podStartSLOduration=1.523878083 podStartE2EDuration="2.557810561s" totalImagesPullingTime="1.033932478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:13:35.556386564 +0000 UTC m=+711.607874263" watchObservedRunningTime="2026-08-05 19:13:35.557810561 +0000 UTC m=+711.609298304"
Aug 05 19:13:35.616069 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:35.615935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:36.129671 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:36.129635    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:36.234655 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:36.234624    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:37.254977 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:37.254928    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:13:37.351144 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:13:37.351105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:14:03.402686 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:14:03.402644    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:14:13.297708 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:14:13.297667    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:14:26.297658 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:14:26.297620    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:15:40.568064 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:15:40.568027    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:15:41.766207 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:15:41.766130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:02.509284 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:02.509249    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:16:13.105676 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:13.105635    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:16:42.289955 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:42.289858    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:47.786520 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:47.786491    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:48.453834 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:48.453778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:48.566058 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:48.566021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:48.683668 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:48.683635    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:48.879539 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:48.879506    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:54.552296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:54.552260    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:16:54.654758 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:16:54.654716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:17:10.396842 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:17:10.396811    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:17:17.209848 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:17:17.209810    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:17:32.694165 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:17:32.694132    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:17:38.598657 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:17:38.598624    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:17:48.000880 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:17:48.000835    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:17:54.890814 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:17:54.890780    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:18:08.590522 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:08.590447    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:18:13.603274 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:13.603239    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:18:18.893802 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:18.893765    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:18:25.590977 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:25.590943    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:18:28.890699 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:28.890651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:18:31.105150 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:31.105117    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:18:31.434584 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:31.434471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:18:43.594585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:43.594489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:18:54.396723 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:18:54.396687    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:19:16.497599 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:19:16.497562    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:19:26.795755 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:19:26.795722    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:19:32.499226 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:19:32.499192    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:19:37.496141 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:19:37.496030    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:19:41.095701 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:19:41.095660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:19:52.195931 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:19:52.195898    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:19:57.901886 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:19:57.901849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:20:05.592167 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:20:05.592136    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:20:17.199252 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:20:17.199216    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:20:23.997119 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:20:23.997083    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:20:34.899484 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:20:34.899447    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:20:40.093503 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:20:40.093468    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:20:46.701315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:20:46.701280    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:20:55.196967 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:20:55.196935    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:21:00.103874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:21:00.103838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:21:10.898129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:21:10.898037    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:22:05.854220 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:05.854164    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"]
Aug 05 19:22:05.854766 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:05.854381    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw" podUID="94252fbb-0a74-4ac1-bbf4-f4daf094ef05" containerName="manager" containerID="cri-o://0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c" gracePeriod=10
Aug 05 19:22:06.101914 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.101891    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:22:06.213893 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.213807    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-extensions-socket-volume\") pod \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") "
Aug 05 19:22:06.214059 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.213914    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b464p\" (UniqueName: \"kubernetes.io/projected/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-kube-api-access-b464p\") pod \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\" (UID: \"94252fbb-0a74-4ac1-bbf4-f4daf094ef05\") "
Aug 05 19:22:06.214209 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.214161    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94252fbb-0a74-4ac1-bbf4-f4daf094ef05" (UID: "94252fbb-0a74-4ac1-bbf4-f4daf094ef05"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:22:06.216125 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.216096    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-kube-api-access-b464p" (OuterVolumeSpecName: "kube-api-access-b464p") pod "94252fbb-0a74-4ac1-bbf4-f4daf094ef05" (UID: "94252fbb-0a74-4ac1-bbf4-f4daf094ef05"). InnerVolumeSpecName "kube-api-access-b464p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:22:06.314807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.314773    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b464p\" (UniqueName: \"kubernetes.io/projected/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-kube-api-access-b464p\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:22:06.314807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.314801    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94252fbb-0a74-4ac1-bbf4-f4daf094ef05-extensions-socket-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:22:06.821095 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.821055    2558 generic.go:356] "Generic (PLEG): container finished" podID="94252fbb-0a74-4ac1-bbf4-f4daf094ef05" containerID="0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c" exitCode=0
Aug 05 19:22:06.821277 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.821113    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"
Aug 05 19:22:06.821277 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.821146    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw" event={"ID":"94252fbb-0a74-4ac1-bbf4-f4daf094ef05","Type":"ContainerDied","Data":"0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c"}
Aug 05 19:22:06.821277 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.821227    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw" event={"ID":"94252fbb-0a74-4ac1-bbf4-f4daf094ef05","Type":"ContainerDied","Data":"da79691524741eec6a45b01dc060988e73e0d2f86ad418cd54a81b905bfc5267"}
Aug 05 19:22:06.821277 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.821255    2558 scope.go:117] "RemoveContainer" containerID="0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c"
Aug 05 19:22:06.830518 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.830496    2558 scope.go:117] "RemoveContainer" containerID="0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c"
Aug 05 19:22:06.830760 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:22:06.830739    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c\": container with ID starting with 0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c not found: ID does not exist" containerID="0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c"
Aug 05 19:22:06.830811 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.830768    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c"} err="failed to get container status \"0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c\": rpc error: code = NotFound desc = could not find container \"0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c\": container with ID starting with 0d3b3409c31f4b846b934b13191d2240ae04b2a5111f87608085406baefa966c not found: ID does not exist"
Aug 05 19:22:06.837908 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.837889    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"]
Aug 05 19:22:06.841575 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:06.841556    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wzzvw"]
Aug 05 19:22:08.475033 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:22:08.474986    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94252fbb-0a74-4ac1-bbf4-f4daf094ef05" path="/var/lib/kubelet/pods/94252fbb-0a74-4ac1-bbf4-f4daf094ef05/volumes"
Aug 05 19:23:06.533548 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.528460    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"]
Aug 05 19:23:06.533548 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.529207    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94252fbb-0a74-4ac1-bbf4-f4daf094ef05" containerName="manager"
Aug 05 19:23:06.533548 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.529227    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94252fbb-0a74-4ac1-bbf4-f4daf094ef05" containerName="manager"
Aug 05 19:23:06.533548 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.529425    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="94252fbb-0a74-4ac1-bbf4-f4daf094ef05" containerName="manager"
Aug 05 19:23:06.534554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.534536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.537014 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.536988    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kfct5\""
Aug 05 19:23:06.541399 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.541376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"]
Aug 05 19:23:06.634874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.634841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgmv\" (UniqueName: \"kubernetes.io/projected/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-kube-api-access-tcgmv\") pod \"kuadrant-operator-controller-manager-68cf589589-xm59l\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.635023 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.634918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xm59l\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.736049 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.736014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgmv\" (UniqueName: \"kubernetes.io/projected/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-kube-api-access-tcgmv\") pod \"kuadrant-operator-controller-manager-68cf589589-xm59l\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.736234 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.736077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xm59l\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.736420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.736402    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xm59l\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.747563 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.747532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgmv\" (UniqueName: \"kubernetes.io/projected/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-kube-api-access-tcgmv\") pod \"kuadrant-operator-controller-manager-68cf589589-xm59l\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.846785 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.846717    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:06.984230 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:06.984168    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"]
Aug 05 19:23:06.986837 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:23:06.986812    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6475d3af_c48d_4dc4_9d56_81df5c0a4fc3.slice/crio-d28b528161d87a5595bb781e461b73dce90762b93a8c0e678e5ea669c252822b WatchSource:0}: Error finding container d28b528161d87a5595bb781e461b73dce90762b93a8c0e678e5ea669c252822b: Status 404 returned error can't find the container with id d28b528161d87a5595bb781e461b73dce90762b93a8c0e678e5ea669c252822b
Aug 05 19:23:07.081694 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:07.081654    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l" event={"ID":"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3","Type":"ContainerStarted","Data":"66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415"}
Aug 05 19:23:07.081895 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:07.081716    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l" event={"ID":"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3","Type":"ContainerStarted","Data":"d28b528161d87a5595bb781e461b73dce90762b93a8c0e678e5ea669c252822b"}
Aug 05 19:23:07.081895 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:07.081781    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:07.106223 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:07.106098    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l" podStartSLOduration=1.106082434 podStartE2EDuration="1.106082434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:23:07.104067 +0000 UTC m=+1283.155554692" watchObservedRunningTime="2026-08-05 19:23:07.106082434 +0000 UTC m=+1283.157570103"
Aug 05 19:23:18.089902 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:18.089869    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:23:25.798081 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:25.798047    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:23:32.702476 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:32.702437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:23:54.609735 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:23:54.609696    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:24:01.976195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:24:01.976149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:24:34.208999 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:24:34.208961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:24:41.899129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:24:41.899099    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:24:49.886163 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:24:49.886118    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:24:55.701275 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:24:55.701235    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:25:05.299254 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:05.299219    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:25:11.804322 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:11.804281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:25:20.507153 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:20.507107    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:25:25.397937 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:25.397902    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:25:29.550547 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:29.550508    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:25:36.404016 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:36.403935    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:25:46.703600 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:46.703568    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:25:53.402318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:25:53.402271    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:26:13.504839 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:13.504800    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:26:20.195005 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:20.194970    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:26:31.194048 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.194017    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"]
Aug 05 19:26:31.196822 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.196805    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.199065 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.199047    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-ca6ab1d3-kserve-self-signed-certs\""
Aug 05 19:26:31.210123 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.210100    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"]
Aug 05 19:26:31.235075 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.235049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fed3ddd-13e9-4fa9-994a-c40878604b11-tls-certs\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.235172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.235083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-home\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.235172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.235114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-dshm\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.235262 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.235238    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cds7g\" (UniqueName: \"kubernetes.io/projected/7fed3ddd-13e9-4fa9-994a-c40878604b11-kube-api-access-cds7g\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.235296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.235263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-model-cache\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.235296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.235278    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-tmp-dir\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.335860 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.335826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cds7g\" (UniqueName: \"kubernetes.io/projected/7fed3ddd-13e9-4fa9-994a-c40878604b11-kube-api-access-cds7g\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336056 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.335869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-model-cache\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336056 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.335889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-tmp-dir\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336056 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.335910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fed3ddd-13e9-4fa9-994a-c40878604b11-tls-certs\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336460 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.336108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-home\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336460 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.336161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-dshm\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336460 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.336228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-model-cache\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336460 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.336326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-tmp-dir\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.336460 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.336439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-home\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.338453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.338427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-dshm\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.338683 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.338665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fed3ddd-13e9-4fa9-994a-c40878604b11-tls-certs\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.342985 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.342965    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cds7g\" (UniqueName: \"kubernetes.io/projected/7fed3ddd-13e9-4fa9-994a-c40878604b11-kube-api-access-cds7g\") pod \"e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") " pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.505623 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.505544    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:31.640933 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.640911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"]
Aug 05 19:26:31.643499 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:26:31.643464    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fed3ddd_13e9_4fa9_994a_c40878604b11.slice/crio-95591f5ae5ee0dff452f10554382a475540b4cfe6ce3545dd3c34b6061cae028 WatchSource:0}: Error finding container 95591f5ae5ee0dff452f10554382a475540b4cfe6ce3545dd3c34b6061cae028: Status 404 returned error can't find the container with id 95591f5ae5ee0dff452f10554382a475540b4cfe6ce3545dd3c34b6061cae028
Aug 05 19:26:31.887504 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:31.887469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:26:32.005663 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:32.005616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m" event={"ID":"7fed3ddd-13e9-4fa9-994a-c40878604b11","Type":"ContainerStarted","Data":"852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85"}
Aug 05 19:26:32.005828 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:32.005671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m" event={"ID":"7fed3ddd-13e9-4fa9-994a-c40878604b11","Type":"ContainerStarted","Data":"95591f5ae5ee0dff452f10554382a475540b4cfe6ce3545dd3c34b6061cae028"}
Aug 05 19:26:32.021976 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:32.021929    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m" podStartSLOduration=1.021907943 podStartE2EDuration="1.021907943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:26:32.020512824 +0000 UTC m=+1488.072000509" watchObservedRunningTime="2026-08-05 19:26:32.021907943 +0000 UTC m=+1488.073395634"
Aug 05 19:26:33.394906 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:33.394866    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:26:37.896354 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:37.896317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:26:41.506157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:41.506079    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:41.506157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:41.506155    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:41.518778 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:41.518757    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:42.068410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:42.068380    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:26:48.683322 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:48.683285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:26:51.134501 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:26:51.134454    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:27:11.152472 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:11.152384    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"]
Aug 05 19:27:11.173539 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:11.173502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:27:11.703195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:11.703150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:27:14.008864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:14.008819    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:27:23.696697 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:23.696662    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:27:26.172954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.172908    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m" podUID="7fed3ddd-13e9-4fa9-994a-c40878604b11" containerName="main" containerID="cri-o://852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85" gracePeriod=45
Aug 05 19:27:26.418525 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.418494    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:27:26.524881 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.524857    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cds7g\" (UniqueName: \"kubernetes.io/projected/7fed3ddd-13e9-4fa9-994a-c40878604b11-kube-api-access-cds7g\") pod \"7fed3ddd-13e9-4fa9-994a-c40878604b11\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") "
Aug 05 19:27:26.525026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.524918    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-dshm\") pod \"7fed3ddd-13e9-4fa9-994a-c40878604b11\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") "
Aug 05 19:27:26.525111 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525089    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-model-cache\") pod \"7fed3ddd-13e9-4fa9-994a-c40878604b11\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") "
Aug 05 19:27:26.525156 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525142    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fed3ddd-13e9-4fa9-994a-c40878604b11-tls-certs\") pod \"7fed3ddd-13e9-4fa9-994a-c40878604b11\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") "
Aug 05 19:27:26.525229 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525199    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-home\") pod \"7fed3ddd-13e9-4fa9-994a-c40878604b11\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") "
Aug 05 19:27:26.525269 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-tmp-dir\") pod \"7fed3ddd-13e9-4fa9-994a-c40878604b11\" (UID: \"7fed3ddd-13e9-4fa9-994a-c40878604b11\") "
Aug 05 19:27:26.525365 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525341    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-model-cache" (OuterVolumeSpecName: "model-cache") pod "7fed3ddd-13e9-4fa9-994a-c40878604b11" (UID: "7fed3ddd-13e9-4fa9-994a-c40878604b11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:26.525505 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-home" (OuterVolumeSpecName: "home") pod "7fed3ddd-13e9-4fa9-994a-c40878604b11" (UID: "7fed3ddd-13e9-4fa9-994a-c40878604b11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:26.525789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525533    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:27:26.525789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.525591    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7fed3ddd-13e9-4fa9-994a-c40878604b11" (UID: "7fed3ddd-13e9-4fa9-994a-c40878604b11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:26.527306 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.527279    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-dshm" (OuterVolumeSpecName: "dshm") pod "7fed3ddd-13e9-4fa9-994a-c40878604b11" (UID: "7fed3ddd-13e9-4fa9-994a-c40878604b11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:26.527405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.527316    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fed3ddd-13e9-4fa9-994a-c40878604b11-kube-api-access-cds7g" (OuterVolumeSpecName: "kube-api-access-cds7g") pod "7fed3ddd-13e9-4fa9-994a-c40878604b11" (UID: "7fed3ddd-13e9-4fa9-994a-c40878604b11"). InnerVolumeSpecName "kube-api-access-cds7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:27:26.527405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.527360    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fed3ddd-13e9-4fa9-994a-c40878604b11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7fed3ddd-13e9-4fa9-994a-c40878604b11" (UID: "7fed3ddd-13e9-4fa9-994a-c40878604b11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:27:26.626894 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.626858    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:27:26.626894 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.626892    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fed3ddd-13e9-4fa9-994a-c40878604b11-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:27:26.626894 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.626903    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:27:26.627080 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.626910    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fed3ddd-13e9-4fa9-994a-c40878604b11-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:27:26.627080 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:26.626920    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cds7g\" (UniqueName: \"kubernetes.io/projected/7fed3ddd-13e9-4fa9-994a-c40878604b11-kube-api-access-cds7g\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:27:27.253994 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.253952    2558 generic.go:356] "Generic (PLEG): container finished" podID="7fed3ddd-13e9-4fa9-994a-c40878604b11" containerID="852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85" exitCode=0
Aug 05 19:27:27.254486 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.254007    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"
Aug 05 19:27:27.254486 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.254030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m" event={"ID":"7fed3ddd-13e9-4fa9-994a-c40878604b11","Type":"ContainerDied","Data":"852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85"}
Aug 05 19:27:27.254486 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.254085    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m" event={"ID":"7fed3ddd-13e9-4fa9-994a-c40878604b11","Type":"ContainerDied","Data":"95591f5ae5ee0dff452f10554382a475540b4cfe6ce3545dd3c34b6061cae028"}
Aug 05 19:27:27.254486 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.254112    2558 scope.go:117] "RemoveContainer" containerID="852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85"
Aug 05 19:27:27.263613 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.263597    2558 scope.go:117] "RemoveContainer" containerID="852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85"
Aug 05 19:27:27.263884 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:27:27.263867    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85\": container with ID starting with 852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85 not found: ID does not exist" containerID="852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85"
Aug 05 19:27:27.263960 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.263891    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85"} err="failed to get container status \"852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85\": rpc error: code = NotFound desc = could not find container \"852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85\": container with ID starting with 852c3764c14a8c25ec0d768587a44b54e2903f066db7ac957e42fbf1f9c83c85 not found: ID does not exist"
Aug 05 19:27:27.275749 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.275726    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"]
Aug 05 19:27:27.279541 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:27.279519    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-ca6ab1d3-kserve-7d9d9ddc5-ltx8m"]
Aug 05 19:27:28.475771 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:28.475738    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fed3ddd-13e9-4fa9-994a-c40878604b11" path="/var/lib/kubelet/pods/7fed3ddd-13e9-4fa9-994a-c40878604b11/volumes"
Aug 05 19:27:28.599475 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:28.599435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:27:35.101087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:35.101056    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:27:45.600300 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:45.600264    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:27:53.001308 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:27:53.001267    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:28:03.000280 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:03.000246    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:28:09.702338 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:09.702299    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:28:19.899126 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:19.899089    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:28:28.706541 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:28.706502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:28:30.861938 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:30.861898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:28:30.962816 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:30.962781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:28:36.802174 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:36.802089    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:28:42.498790 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:42.498752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:28:49.097159 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:28:49.097122    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:00.797120 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:00.797081    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:08.690274 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:08.690238    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:14.395767 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:14.395723    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:21.391596 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:21.391558    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:28.608109 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:28.608076    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:37.699374 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:37.699338    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:44.995405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:44.995368    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:29:54.604124 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:29:54.604088    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:00.999019 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:00.998982    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:10.699313 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:10.699281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:16.497831 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:16.497793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:26.599232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:26.599170    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:32.501738 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:32.501700    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:36.046967 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:36.046929    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:30:39.300882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:39.300844    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:50.206019 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:50.205978    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:30:58.500592 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:30:58.500556    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:31:01.706880 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:01.706838    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:04.203401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:04.203364    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:31:04.626528 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:04.626487    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:04.786347 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:04.786302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:05.094547 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:05.094516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:11.416326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:11.416292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:11.545425 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:11.545393    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:11.654340 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:11.654313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:12.015148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:12.015117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:12.133300 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:12.133258    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:14.228259 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:14.228229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:14.334975 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:14.334941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:15.413077 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:15.413044    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:15.747468 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:15.747384    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:16.121393 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:16.121362    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:16.223560 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:16.223526    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:18.303288 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:18.303251    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:31:46.013661 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.013628    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:46.091245 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.091174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:46.163046 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.163009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:46.279437 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.279410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:46.371317 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.371279    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:46.565567 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.565488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:46.814069 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.814039    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:46.915982 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:46.915887    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:47.034601 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:47.034568    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:47.387575 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:47.387546    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:47.677553 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:47.677468    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:49.115896 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:49.115858    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:31:49.584592 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:49.584564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:49.896806 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:49.896730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:50.086982 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:50.086956    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:50.712486 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:50.712454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:50.879631 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:50.879597    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:51.137262 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.137231    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"]
Aug 05 19:31:51.137575 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.137563    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fed3ddd-13e9-4fa9-994a-c40878604b11" containerName="main"
Aug 05 19:31:51.137623 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.137579    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fed3ddd-13e9-4fa9-994a-c40878604b11" containerName="main"
Aug 05 19:31:51.137657 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.137638    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fed3ddd-13e9-4fa9-994a-c40878604b11" containerName="main"
Aug 05 19:31:51.140083 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.140068    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.143231 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.143207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-bf1161af-dockercfg-9hzvn\""
Aug 05 19:31:51.143346 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.143261    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-bf1161af\""
Aug 05 19:31:51.156936 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.156908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"]
Aug 05 19:31:51.244062 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.244031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c6b4e7-1335-4688-af01-c0c67b2997c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.244270 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.244076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh2xm\" (UniqueName: \"kubernetes.io/projected/96c6b4e7-1335-4688-af01-c0c67b2997c5-kube-api-access-bh2xm\") pod \"payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.344864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.344820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c6b4e7-1335-4688-af01-c0c67b2997c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.345054 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.344885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh2xm\" (UniqueName: \"kubernetes.io/projected/96c6b4e7-1335-4688-af01-c0c67b2997c5-kube-api-access-bh2xm\") pod \"payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.345595 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.345576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c6b4e7-1335-4688-af01-c0c67b2997c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.371387 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.371362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh2xm\" (UniqueName: \"kubernetes.io/projected/96c6b4e7-1335-4688-af01-c0c67b2997c5-kube-api-access-bh2xm\") pod \"payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.450532 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.450440    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:51.614990 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.614966    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"]
Aug 05 19:31:51.616762 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:31:51.616733    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c6b4e7_1335_4688_af01_c0c67b2997c5.slice/crio-b68993256359cd9b0d6ae3897780846a39e537f394e2476ad99a85ddfb31f8af WatchSource:0}: Error finding container b68993256359cd9b0d6ae3897780846a39e537f394e2476ad99a85ddfb31f8af: Status 404 returned error can't find the container with id b68993256359cd9b0d6ae3897780846a39e537f394e2476ad99a85ddfb31f8af
Aug 05 19:31:51.618700 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:51.618682    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:31:52.437100 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:52.437020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6" event={"ID":"96c6b4e7-1335-4688-af01-c0c67b2997c5","Type":"ContainerStarted","Data":"b68993256359cd9b0d6ae3897780846a39e537f394e2476ad99a85ddfb31f8af"}
Aug 05 19:31:54.450981 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:54.450937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6" event={"ID":"96c6b4e7-1335-4688-af01-c0c67b2997c5","Type":"ContainerStarted","Data":"83737f4116c093e53eefe92d4d3f5bb847f28f749e10b6f7b4bc3e53a45d293c"}
Aug 05 19:31:54.451481 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:54.451144    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:31:54.482149 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:54.482046    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6" podStartSLOduration=0.888943356 podStartE2EDuration="3.482032975s" totalImagesPullingTime="2.593089619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:54.481743297 +0000 UTC m=+1810.533230988" watchObservedRunningTime="2026-08-05 19:31:54.482032975 +0000 UTC m=+1810.533520710"
Aug 05 19:31:54.814445 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:54.814414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:31:57.936556 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:31:57.936524    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:32:05.457693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:05.457658    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:32:21.361625 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.361586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:21.407242 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.407205    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"]
Aug 05 19:32:21.407526 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.407472    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6" podUID="96c6b4e7-1335-4688-af01-c0c67b2997c5" containerName="payload-pre-processing" containerID="cri-o://83737f4116c093e53eefe92d4d3f5bb847f28f749e10b6f7b4bc3e53a45d293c" gracePeriod=30
Aug 05 19:32:21.463400 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.463369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:21.564752 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.564714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:21.571751 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.571722    2558 generic.go:356] "Generic (PLEG): container finished" podID="96c6b4e7-1335-4688-af01-c0c67b2997c5" containerID="83737f4116c093e53eefe92d4d3f5bb847f28f749e10b6f7b4bc3e53a45d293c" exitCode=0
Aug 05 19:32:21.571901 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.571803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6" event={"ID":"96c6b4e7-1335-4688-af01-c0c67b2997c5","Type":"ContainerDied","Data":"83737f4116c093e53eefe92d4d3f5bb847f28f749e10b6f7b4bc3e53a45d293c"}
Aug 05 19:32:21.654502 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.654478    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:32:21.660630 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.660604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:21.710508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.710476    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh2xm\" (UniqueName: \"kubernetes.io/projected/96c6b4e7-1335-4688-af01-c0c67b2997c5-kube-api-access-bh2xm\") pod \"96c6b4e7-1335-4688-af01-c0c67b2997c5\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") "
Aug 05 19:32:21.710673 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.710586    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c6b4e7-1335-4688-af01-c0c67b2997c5-plugins-config-volume\") pod \"96c6b4e7-1335-4688-af01-c0c67b2997c5\" (UID: \"96c6b4e7-1335-4688-af01-c0c67b2997c5\") "
Aug 05 19:32:21.710952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.710927    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c6b4e7-1335-4688-af01-c0c67b2997c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96c6b4e7-1335-4688-af01-c0c67b2997c5" (UID: "96c6b4e7-1335-4688-af01-c0c67b2997c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:32:21.712789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.712765    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c6b4e7-1335-4688-af01-c0c67b2997c5-kube-api-access-bh2xm" (OuterVolumeSpecName: "kube-api-access-bh2xm") pod "96c6b4e7-1335-4688-af01-c0c67b2997c5" (UID: "96c6b4e7-1335-4688-af01-c0c67b2997c5"). InnerVolumeSpecName "kube-api-access-bh2xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:32:21.784163 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.784125    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:21.811519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.811492    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96c6b4e7-1335-4688-af01-c0c67b2997c5-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:32:21.811519 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:21.811520    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh2xm\" (UniqueName: \"kubernetes.io/projected/96c6b4e7-1335-4688-af01-c0c67b2997c5-kube-api-access-bh2xm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:32:22.002212 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.002154    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:22.277243 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.277210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:22.577808 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.577720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6" event={"ID":"96c6b4e7-1335-4688-af01-c0c67b2997c5","Type":"ContainerDied","Data":"b68993256359cd9b0d6ae3897780846a39e537f394e2476ad99a85ddfb31f8af"}
Aug 05 19:32:22.577808 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.577786    2558 scope.go:117] "RemoveContainer" containerID="83737f4116c093e53eefe92d4d3f5bb847f28f749e10b6f7b4bc3e53a45d293c"
Aug 05 19:32:22.578285 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.577732    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"
Aug 05 19:32:22.579212 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.579086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:22.610550 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.610520    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"]
Aug 05 19:32:22.612929 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.612908    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bf1161af-75cd74d56-52vg6"]
Aug 05 19:32:22.882341 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:22.882248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:24.406919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:24.406884    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:32:24.475773 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:24.475740    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c6b4e7-1335-4688-af01-c0c67b2997c5" path="/var/lib/kubelet/pods/96c6b4e7-1335-4688-af01-c0c67b2997c5/volumes"
Aug 05 19:32:24.635804 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:24.635748    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:24.729440 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:24.729360    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:25.815647 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:25.815613    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:26.123323 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.123235    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:26.324576 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.324547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:26.423343 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.423275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:26.443736 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.443701    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"]
Aug 05 19:32:26.444086 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.444069    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c6b4e7-1335-4688-af01-c0c67b2997c5" containerName="payload-pre-processing"
Aug 05 19:32:26.444163 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.444089    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c6b4e7-1335-4688-af01-c0c67b2997c5" containerName="payload-pre-processing"
Aug 05 19:32:26.444738 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.444711    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c6b4e7-1335-4688-af01-c0c67b2997c5" containerName="payload-pre-processing"
Aug 05 19:32:26.449265 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.449246    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.453251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.453228    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e3501887\""
Aug 05 19:32:26.461276 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.461254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"]
Aug 05 19:32:26.500675 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.500645    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"]
Aug 05 19:32:26.503811 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.503797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.507042 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.507015    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e3501887-dockercfg-tnkvd\""
Aug 05 19:32:26.519685 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.519661    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"]
Aug 05 19:32:26.551496 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.551469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed801d8-1bfb-4808-afaf-52e451e21e84-plugins-config-volume\") pod \"payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") " pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.551656 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.551541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30454ce1-d9de-4564-96f7-5779a2a49ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.551656 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.551571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q74h9\" (UniqueName: \"kubernetes.io/projected/3ed801d8-1bfb-4808-afaf-52e451e21e84-kube-api-access-q74h9\") pod \"payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") " pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.551656 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.551606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9ks\" (UniqueName: \"kubernetes.io/projected/30454ce1-d9de-4564-96f7-5779a2a49ac9-kube-api-access-7m9ks\") pod \"payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.652099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.652072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed801d8-1bfb-4808-afaf-52e451e21e84-plugins-config-volume\") pod \"payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") " pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.652310 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.652130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30454ce1-d9de-4564-96f7-5779a2a49ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.652310 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.652162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q74h9\" (UniqueName: \"kubernetes.io/projected/3ed801d8-1bfb-4808-afaf-52e451e21e84-kube-api-access-q74h9\") pod \"payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") " pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.652310 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.652209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9ks\" (UniqueName: \"kubernetes.io/projected/30454ce1-d9de-4564-96f7-5779a2a49ac9-kube-api-access-7m9ks\") pod \"payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.652859 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.652840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed801d8-1bfb-4808-afaf-52e451e21e84-plugins-config-volume\") pod \"payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") " pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.652901 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.652889    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30454ce1-d9de-4564-96f7-5779a2a49ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.662114 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.662083    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q74h9\" (UniqueName: \"kubernetes.io/projected/3ed801d8-1bfb-4808-afaf-52e451e21e84-kube-api-access-q74h9\") pod \"payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") " pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.662263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.662126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9ks\" (UniqueName: \"kubernetes.io/projected/30454ce1-d9de-4564-96f7-5779a2a49ac9-kube-api-access-7m9ks\") pod \"payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.760962 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.760869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:26.813676 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.813650    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:26.908725 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.908652    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"]
Aug 05 19:32:26.961331 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:26.961301    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"]
Aug 05 19:32:26.964358 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:32:26.964332    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30454ce1_d9de_4564_96f7_5779a2a49ac9.slice/crio-8cdc88443b29dac28b921c606c4be616f94a9da574dc0e1d8b359c143bacff1e WatchSource:0}: Error finding container 8cdc88443b29dac28b921c606c4be616f94a9da574dc0e1d8b359c143bacff1e: Status 404 returned error can't find the container with id 8cdc88443b29dac28b921c606c4be616f94a9da574dc0e1d8b359c143bacff1e
Aug 05 19:32:27.603816 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.603782    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5" event={"ID":"30454ce1-d9de-4564-96f7-5779a2a49ac9","Type":"ContainerStarted","Data":"52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a"}
Aug 05 19:32:27.604001 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.603947    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:27.604052 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.604008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5" event={"ID":"30454ce1-d9de-4564-96f7-5779a2a49ac9","Type":"ContainerStarted","Data":"8cdc88443b29dac28b921c606c4be616f94a9da574dc0e1d8b359c143bacff1e"}
Aug 05 19:32:27.605223 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.605172    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6" event={"ID":"3ed801d8-1bfb-4808-afaf-52e451e21e84","Type":"ContainerStarted","Data":"63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498"}
Aug 05 19:32:27.605470 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.605237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6" event={"ID":"3ed801d8-1bfb-4808-afaf-52e451e21e84","Type":"ContainerStarted","Data":"93c140febd54eee2674d8f9f36e57e1bd443027266f251a72dc4be03c325394a"}
Aug 05 19:32:27.605470 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.605266    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:27.621022 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.620981    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5" podStartSLOduration=1.620967869 podStartE2EDuration="1.620967869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:32:27.619779888 +0000 UTC m=+1843.671267581" watchObservedRunningTime="2026-08-05 19:32:27.620967869 +0000 UTC m=+1843.672455561"
Aug 05 19:32:27.639856 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:27.639809    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6" podStartSLOduration=1.6397965490000002 podStartE2EDuration="1.639796549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:32:27.637133031 +0000 UTC m=+1843.688620724" watchObservedRunningTime="2026-08-05 19:32:27.639796549 +0000 UTC m=+1843.691284241"
Aug 05 19:32:33.010402 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:33.010362    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:32:38.611856 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:38.611825    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:38.612303 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:38.611892    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:56.754972 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:56.754933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:56.790982 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:56.790946    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"]
Aug 05 19:32:56.791256 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:56.791226    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6" podUID="3ed801d8-1bfb-4808-afaf-52e451e21e84" containerName="payload-processing" containerID="cri-o://63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498" gracePeriod=30
Aug 05 19:32:56.800595 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:56.800568    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"]
Aug 05 19:32:56.800815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:56.800786    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5" podUID="30454ce1-d9de-4564-96f7-5779a2a49ac9" containerName="payload-pre-processing" containerID="cri-o://52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a" gracePeriod=30
Aug 05 19:32:56.881088 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:56.881059    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:57.026254 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.026222    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:57.043670 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.043643    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:57.076537 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.076514    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:57.128708 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.128674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:57.228753 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.228716    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m9ks\" (UniqueName: \"kubernetes.io/projected/30454ce1-d9de-4564-96f7-5779a2a49ac9-kube-api-access-7m9ks\") pod \"30454ce1-d9de-4564-96f7-5779a2a49ac9\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") "
Aug 05 19:32:57.228927 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.228781    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30454ce1-d9de-4564-96f7-5779a2a49ac9-plugins-config-volume\") pod \"30454ce1-d9de-4564-96f7-5779a2a49ac9\" (UID: \"30454ce1-d9de-4564-96f7-5779a2a49ac9\") "
Aug 05 19:32:57.228927 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.228817    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q74h9\" (UniqueName: \"kubernetes.io/projected/3ed801d8-1bfb-4808-afaf-52e451e21e84-kube-api-access-q74h9\") pod \"3ed801d8-1bfb-4808-afaf-52e451e21e84\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") "
Aug 05 19:32:57.228927 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.228882    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed801d8-1bfb-4808-afaf-52e451e21e84-plugins-config-volume\") pod \"3ed801d8-1bfb-4808-afaf-52e451e21e84\" (UID: \"3ed801d8-1bfb-4808-afaf-52e451e21e84\") "
Aug 05 19:32:57.229249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.229219    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30454ce1-d9de-4564-96f7-5779a2a49ac9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30454ce1-d9de-4564-96f7-5779a2a49ac9" (UID: "30454ce1-d9de-4564-96f7-5779a2a49ac9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:32:57.229398 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.229370    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed801d8-1bfb-4808-afaf-52e451e21e84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ed801d8-1bfb-4808-afaf-52e451e21e84" (UID: "3ed801d8-1bfb-4808-afaf-52e451e21e84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:32:57.231075 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.231057    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ed801d8-1bfb-4808-afaf-52e451e21e84-kube-api-access-q74h9" (OuterVolumeSpecName: "kube-api-access-q74h9") pod "3ed801d8-1bfb-4808-afaf-52e451e21e84" (UID: "3ed801d8-1bfb-4808-afaf-52e451e21e84"). InnerVolumeSpecName "kube-api-access-q74h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:32:57.231142 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.231109    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30454ce1-d9de-4564-96f7-5779a2a49ac9-kube-api-access-7m9ks" (OuterVolumeSpecName: "kube-api-access-7m9ks") pod "30454ce1-d9de-4564-96f7-5779a2a49ac9" (UID: "30454ce1-d9de-4564-96f7-5779a2a49ac9"). InnerVolumeSpecName "kube-api-access-7m9ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:32:57.329942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.329842    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed801d8-1bfb-4808-afaf-52e451e21e84-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:32:57.329942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.329880    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m9ks\" (UniqueName: \"kubernetes.io/projected/30454ce1-d9de-4564-96f7-5779a2a49ac9-kube-api-access-7m9ks\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:32:57.329942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.329900    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30454ce1-d9de-4564-96f7-5779a2a49ac9-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:32:57.329942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.329909    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q74h9\" (UniqueName: \"kubernetes.io/projected/3ed801d8-1bfb-4808-afaf-52e451e21e84-kube-api-access-q74h9\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:32:57.742958 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.742869    2558 generic.go:356] "Generic (PLEG): container finished" podID="3ed801d8-1bfb-4808-afaf-52e451e21e84" containerID="63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498" exitCode=0
Aug 05 19:32:57.742958 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.742934    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"
Aug 05 19:32:57.743219 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.742958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6" event={"ID":"3ed801d8-1bfb-4808-afaf-52e451e21e84","Type":"ContainerDied","Data":"63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498"}
Aug 05 19:32:57.743219 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.743041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6" event={"ID":"3ed801d8-1bfb-4808-afaf-52e451e21e84","Type":"ContainerDied","Data":"93c140febd54eee2674d8f9f36e57e1bd443027266f251a72dc4be03c325394a"}
Aug 05 19:32:57.743219 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.743065    2558 scope.go:117] "RemoveContainer" containerID="63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498"
Aug 05 19:32:57.744377 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.744351    2558 generic.go:356] "Generic (PLEG): container finished" podID="30454ce1-d9de-4564-96f7-5779a2a49ac9" containerID="52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a" exitCode=0
Aug 05 19:32:57.744512 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.744379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5" event={"ID":"30454ce1-d9de-4564-96f7-5779a2a49ac9","Type":"ContainerDied","Data":"52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a"}
Aug 05 19:32:57.744512 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.744410    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"
Aug 05 19:32:57.744512 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.744420    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5" event={"ID":"30454ce1-d9de-4564-96f7-5779a2a49ac9","Type":"ContainerDied","Data":"8cdc88443b29dac28b921c606c4be616f94a9da574dc0e1d8b359c143bacff1e"}
Aug 05 19:32:57.752490 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.752456    2558 scope.go:117] "RemoveContainer" containerID="63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498"
Aug 05 19:32:57.752778 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:32:57.752758    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498\": container with ID starting with 63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498 not found: ID does not exist" containerID="63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498"
Aug 05 19:32:57.752861 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.752784    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498"} err="failed to get container status \"63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498\": rpc error: code = NotFound desc = could not find container \"63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498\": container with ID starting with 63fb3580a12b7b6652c0bd76c6a0f5c09c5483deb63d81d7fcd526cca1c28498 not found: ID does not exist"
Aug 05 19:32:57.752861 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.752801    2558 scope.go:117] "RemoveContainer" containerID="52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a"
Aug 05 19:32:57.760850 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.760834    2558 scope.go:117] "RemoveContainer" containerID="52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a"
Aug 05 19:32:57.761140 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:32:57.761068    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a\": container with ID starting with 52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a not found: ID does not exist" containerID="52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a"
Aug 05 19:32:57.761140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.761092    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a"} err="failed to get container status \"52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a\": rpc error: code = NotFound desc = could not find container \"52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a\": container with ID starting with 52dd566bee34ef70bc0e329114d99d11a8c48a4b0b6867c3321a85f45583f78a not found: ID does not exist"
Aug 05 19:32:57.774370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.774347    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"]
Aug 05 19:32:57.779403 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.779384    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3501887-cd8fcfcf4-srgv6"]
Aug 05 19:32:57.791527 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.791508    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"]
Aug 05 19:32:57.798473 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:57.798453    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3501887-54d85dc9dd-mnbv5"]
Aug 05 19:32:58.217090 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:58.217057    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:58.428070 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:58.428040    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:58.475495 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:58.475408    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30454ce1-d9de-4564-96f7-5779a2a49ac9" path="/var/lib/kubelet/pods/30454ce1-d9de-4564-96f7-5779a2a49ac9/volumes"
Aug 05 19:32:58.475876 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:58.475855    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ed801d8-1bfb-4808-afaf-52e451e21e84" path="/var/lib/kubelet/pods/3ed801d8-1bfb-4808-afaf-52e451e21e84/volumes"
Aug 05 19:32:58.665685 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:58.665644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:59.059086 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:59.059058    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:59.448919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:59.448833    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:32:59.737782 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:32:59.737701    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:33:01.881168 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:01.881133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:02.003352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:02.003320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:03.041462 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.041432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:03.372870 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.372784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:03.634988 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.634904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:03.736383 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.736350    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:03.856208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.854288    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"]
Aug 05 19:33:03.856208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.855014    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30454ce1-d9de-4564-96f7-5779a2a49ac9" containerName="payload-pre-processing"
Aug 05 19:33:03.856208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.855036    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="30454ce1-d9de-4564-96f7-5779a2a49ac9" containerName="payload-pre-processing"
Aug 05 19:33:03.856208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.855053    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed801d8-1bfb-4808-afaf-52e451e21e84" containerName="payload-processing"
Aug 05 19:33:03.856208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.855064    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed801d8-1bfb-4808-afaf-52e451e21e84" containerName="payload-processing"
Aug 05 19:33:03.856208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.855229    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="30454ce1-d9de-4564-96f7-5779a2a49ac9" containerName="payload-pre-processing"
Aug 05 19:33:03.856208 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.855251    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed801d8-1bfb-4808-afaf-52e451e21e84" containerName="payload-processing"
Aug 05 19:33:03.861375 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.861349    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:03.865054 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.865027    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-61891be0-dockercfg-xd7js\""
Aug 05 19:33:03.865220 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.865075    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-61891be0\""
Aug 05 19:33:03.869971 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.869937    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"]
Aug 05 19:33:03.882495 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.882470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:03.882644 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.882544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6br9\" (UniqueName: \"kubernetes.io/projected/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-kube-api-access-m6br9\") pod \"payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:03.983777 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.983692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6br9\" (UniqueName: \"kubernetes.io/projected/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-kube-api-access-m6br9\") pod \"payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:03.983925 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.983775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:03.984505 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.984485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:03.992434 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:03.992412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6br9\" (UniqueName: \"kubernetes.io/projected/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-kube-api-access-m6br9\") pod \"payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:04.175985 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:04.175945    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:04.324684 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:04.324650    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"]
Aug 05 19:33:04.328210 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:33:04.328156    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee15ab94_d4c9_4728_87f9_ac3976d2f0a1.slice/crio-be529b2173bd8c98d7df58800e7bf8a6370cbd707ad44f6bad183c85ec0627c6 WatchSource:0}: Error finding container be529b2173bd8c98d7df58800e7bf8a6370cbd707ad44f6bad183c85ec0627c6: Status 404 returned error can't find the container with id be529b2173bd8c98d7df58800e7bf8a6370cbd707ad44f6bad183c85ec0627c6
Aug 05 19:33:04.779385 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:04.779351    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc" event={"ID":"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1","Type":"ContainerStarted","Data":"ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb"}
Aug 05 19:33:04.779593 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:04.779406    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc" event={"ID":"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1","Type":"ContainerStarted","Data":"be529b2173bd8c98d7df58800e7bf8a6370cbd707ad44f6bad183c85ec0627c6"}
Aug 05 19:33:04.779593 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:04.779437    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:04.803855 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:04.803801    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc" podStartSLOduration=1.8037838819999998 podStartE2EDuration="1.803783882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:33:04.802917542 +0000 UTC m=+1880.854405226" watchObservedRunningTime="2026-08-05 19:33:04.803783882 +0000 UTC m=+1880.855271621"
Aug 05 19:33:05.926540 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:05.926499    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:33:15.785611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:15.785581    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:33.989446 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:33.989408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:34.104211 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.104167    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"]
Aug 05 19:33:34.104411 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.104386    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc" podUID="ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" containerName="payload-pre-processing" containerID="cri-o://ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb" gracePeriod=30
Aug 05 19:33:34.144652 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.144613    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:34.278285 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.278256    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:34.345822 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.345794    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:34.419232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.419204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:34.436217 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.436168    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-plugins-config-volume\") pod \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") "
Aug 05 19:33:34.436367 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.436251    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6br9\" (UniqueName: \"kubernetes.io/projected/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-kube-api-access-m6br9\") pod \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\" (UID: \"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1\") "
Aug 05 19:33:34.436552 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.436526    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" (UID: "ee15ab94-d4c9-4728-87f9-ac3976d2f0a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:33:34.438614 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.438585    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-kube-api-access-m6br9" (OuterVolumeSpecName: "kube-api-access-m6br9") pod "ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" (UID: "ee15ab94-d4c9-4728-87f9-ac3976d2f0a1"). InnerVolumeSpecName "kube-api-access-m6br9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:33:34.537672 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.537580    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:33:34.537672 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.537610    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6br9\" (UniqueName: \"kubernetes.io/projected/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1-kube-api-access-m6br9\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:33:34.684365 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.684337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:34.914306 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.914220    2558 generic.go:356] "Generic (PLEG): container finished" podID="ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" containerID="ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb" exitCode=0
Aug 05 19:33:34.914306 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.914272    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"
Aug 05 19:33:34.914306 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.914299    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc" event={"ID":"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1","Type":"ContainerDied","Data":"ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb"}
Aug 05 19:33:34.914576 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.914354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc" event={"ID":"ee15ab94-d4c9-4728-87f9-ac3976d2f0a1","Type":"ContainerDied","Data":"be529b2173bd8c98d7df58800e7bf8a6370cbd707ad44f6bad183c85ec0627c6"}
Aug 05 19:33:34.914576 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.914376    2558 scope.go:117] "RemoveContainer" containerID="ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb"
Aug 05 19:33:34.922891 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.922874    2558 scope.go:117] "RemoveContainer" containerID="ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb"
Aug 05 19:33:34.923166 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:33:34.923149    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb\": container with ID starting with ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb not found: ID does not exist" containerID="ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb"
Aug 05 19:33:34.923299 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.923174    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb"} err="failed to get container status \"ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb\": rpc error: code = NotFound desc = could not find container \"ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb\": container with ID starting with ec9e77463c6c2f65996809b4b056ed56bee52c4d003098fd4a0d9c617c5b93cb not found: ID does not exist"
Aug 05 19:33:34.944413 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.944382    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"]
Aug 05 19:33:34.952361 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:34.952337    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61891be0-5bf9594676-gmpjc"]
Aug 05 19:33:35.137960 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:35.137927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:36.040055 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:36.040017    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:36.163815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:36.163781    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:33:36.204073 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:36.204044    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:36.318035 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:36.317947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:36.475596 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:36.475550    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" path="/var/lib/kubelet/pods/ee15ab94-d4c9-4728-87f9-ac3976d2f0a1/volumes"
Aug 05 19:33:43.508514 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:43.508478    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:33:48.075318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:48.075264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:49.610566 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:49.610525    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:33:54.690462 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:54.690426    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:54.862596 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:54.862560    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:55.010791 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:55.010695    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:33:55.573045 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:33:55.573009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:21.396051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:21.396016    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:27.902669 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:27.902635    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:28.020217 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:28.020168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:28.184001 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:28.183913    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:41.395038 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:41.394962    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:41.471792 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:41.471761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:44.005502 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:44.005464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:44.754148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:44.754113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:49.951528 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:49.951493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:50.065309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:50.065267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:34:50.152721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:34:50.152686    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:00.647036 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:00.646997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:11.636562 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:11.636531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:17.824031 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:17.823999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:17.892303 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:17.892272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:17.980310 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:17.980274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:18.077080 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:18.077000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:18.177678 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:18.177645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:18.742044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:18.742005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:18.841590 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:18.841559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:18.942204 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:18.942143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:19.604623 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:19.604582    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:35:19.646224 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:19.646175    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:19.746479 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:19.746438    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:20.351849 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:20.351814    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:26.377860 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:26.377827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:26.478904 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:26.478873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:27.021727 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:27.021691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:27.909513 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:27.906202    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:35:33.039303 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:33.039263    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:33.138964 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:33.138932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:33.261678 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:33.261618    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:33.559855 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:33.559819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:33.938696 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:33.938613    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:36.191835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:36.191806    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:36.287349 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:36.287314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:37.412577 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:37.412544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:37.910499 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:37.910467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:38.030690 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.030655    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"]
Aug 05 19:35:38.031017 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.031003    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" containerName="payload-pre-processing"
Aug 05 19:35:38.031017 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.031017    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" containerName="payload-pre-processing"
Aug 05 19:35:38.031101 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.031085    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee15ab94-d4c9-4728-87f9-ac3976d2f0a1" containerName="payload-pre-processing"
Aug 05 19:35:38.034391 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.034375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.036924 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.036892    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-82a4c5b4\""
Aug 05 19:35:38.036924 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.036898    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-82a4c5b4-dockercfg-gnx8k\""
Aug 05 19:35:38.042570 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.042545    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"]
Aug 05 19:35:38.131375 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.131333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b4fd-d595-4c22-a277-ddac1025ffea-plugins-config-volume\") pod \"payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") " pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.131538 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.131425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smmz\" (UniqueName: \"kubernetes.io/projected/1733b4fd-d595-4c22-a277-ddac1025ffea-kube-api-access-7smmz\") pod \"payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") " pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.232789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.232697    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smmz\" (UniqueName: \"kubernetes.io/projected/1733b4fd-d595-4c22-a277-ddac1025ffea-kube-api-access-7smmz\") pod \"payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") " pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.232789 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.232755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b4fd-d595-4c22-a277-ddac1025ffea-plugins-config-volume\") pod \"payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") " pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.233502 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.233478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b4fd-d595-4c22-a277-ddac1025ffea-plugins-config-volume\") pod \"payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") " pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.241202 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.241158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smmz\" (UniqueName: \"kubernetes.io/projected/1733b4fd-d595-4c22-a277-ddac1025ffea-kube-api-access-7smmz\") pod \"payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") " pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.345346 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.345317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:38.482676 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.482653    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"]
Aug 05 19:35:38.485289 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:35:38.485252    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1733b4fd_d595_4c22_a277_ddac1025ffea.slice/crio-735eaf60fd1fe355d4304343171007f2b492723cc5d66be8eaf06eaf3e50cd8f WatchSource:0}: Error finding container 735eaf60fd1fe355d4304343171007f2b492723cc5d66be8eaf06eaf3e50cd8f: Status 404 returned error can't find the container with id 735eaf60fd1fe355d4304343171007f2b492723cc5d66be8eaf06eaf3e50cd8f
Aug 05 19:35:38.495448 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:38.495425    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk" event={"ID":"1733b4fd-d595-4c22-a277-ddac1025ffea","Type":"ContainerStarted","Data":"735eaf60fd1fe355d4304343171007f2b492723cc5d66be8eaf06eaf3e50cd8f"}
Aug 05 19:35:39.501457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:39.501420    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk" event={"ID":"1733b4fd-d595-4c22-a277-ddac1025ffea","Type":"ContainerStarted","Data":"7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556"}
Aug 05 19:35:39.501837 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:39.501481    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:35:39.516411 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:39.516358    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk" podStartSLOduration=1.516339816 podStartE2EDuration="1.516339816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:35:39.515843036 +0000 UTC m=+2035.567330727" watchObservedRunningTime="2026-08-05 19:35:39.516339816 +0000 UTC m=+2035.567827509"
Aug 05 19:35:39.536097 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:39.536068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:35:40.399230 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:40.399169    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:35:50.508607 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:35:50.508574    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:36:01.131743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:01.131709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:01.788157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:01.788110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:01.886743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:01.886704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:02.196436 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:02.196349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:08.038816 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:08.038734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:08.138385 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:08.138345    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:18.864440 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:18.864401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:18.895405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:18.895371    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"]
Aug 05 19:36:18.896165 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:18.896128    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk" podUID="1733b4fd-d595-4c22-a277-ddac1025ffea" containerName="payload-processing" containerID="cri-o://7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556" gracePeriod=30
Aug 05 19:36:18.964823 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:18.964794    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:19.065840 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.065799    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:19.137961 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.137936    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:36:19.155296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.155265    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:19.282983 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.282945    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b4fd-d595-4c22-a277-ddac1025ffea-plugins-config-volume\") pod \"1733b4fd-d595-4c22-a277-ddac1025ffea\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") "
Aug 05 19:36:19.283226 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.283009    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7smmz\" (UniqueName: \"kubernetes.io/projected/1733b4fd-d595-4c22-a277-ddac1025ffea-kube-api-access-7smmz\") pod \"1733b4fd-d595-4c22-a277-ddac1025ffea\" (UID: \"1733b4fd-d595-4c22-a277-ddac1025ffea\") "
Aug 05 19:36:19.283424 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.283394    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1733b4fd-d595-4c22-a277-ddac1025ffea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1733b4fd-d595-4c22-a277-ddac1025ffea" (UID: "1733b4fd-d595-4c22-a277-ddac1025ffea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:36:19.285237 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.285216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1733b4fd-d595-4c22-a277-ddac1025ffea-kube-api-access-7smmz" (OuterVolumeSpecName: "kube-api-access-7smmz") pod "1733b4fd-d595-4c22-a277-ddac1025ffea" (UID: "1733b4fd-d595-4c22-a277-ddac1025ffea"). InnerVolumeSpecName "kube-api-access-7smmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:36:19.383962 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.383873    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b4fd-d595-4c22-a277-ddac1025ffea-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:36:19.383962 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.383901    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7smmz\" (UniqueName: \"kubernetes.io/projected/1733b4fd-d595-4c22-a277-ddac1025ffea-kube-api-access-7smmz\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:36:19.428189 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.428156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:19.674168 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.674081    2558 generic.go:356] "Generic (PLEG): container finished" podID="1733b4fd-d595-4c22-a277-ddac1025ffea" containerID="7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556" exitCode=0
Aug 05 19:36:19.674168 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.674129    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"
Aug 05 19:36:19.674168 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.674141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk" event={"ID":"1733b4fd-d595-4c22-a277-ddac1025ffea","Type":"ContainerDied","Data":"7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556"}
Aug 05 19:36:19.674474 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.674206    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk" event={"ID":"1733b4fd-d595-4c22-a277-ddac1025ffea","Type":"ContainerDied","Data":"735eaf60fd1fe355d4304343171007f2b492723cc5d66be8eaf06eaf3e50cd8f"}
Aug 05 19:36:19.674474 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.674242    2558 scope.go:117] "RemoveContainer" containerID="7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556"
Aug 05 19:36:19.683858 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.683837    2558 scope.go:117] "RemoveContainer" containerID="7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556"
Aug 05 19:36:19.684219 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:36:19.684169    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556\": container with ID starting with 7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556 not found: ID does not exist" containerID="7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556"
Aug 05 19:36:19.684299 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.684231    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556"} err="failed to get container status \"7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556\": rpc error: code = NotFound desc = could not find container \"7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556\": container with ID starting with 7ad3e73ca2e21e008a3c929ed36c5990d8a8dde344f4d21e37b61878c159c556 not found: ID does not exist"
Aug 05 19:36:19.697440 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.697415    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"]
Aug 05 19:36:19.700932 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:19.700906    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-82a4c5b4-76b955f5bb-j9psk"]
Aug 05 19:36:20.476640 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:20.476605    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1733b4fd-d595-4c22-a277-ddac1025ffea" path="/var/lib/kubelet/pods/1733b4fd-d595-4c22-a277-ddac1025ffea/volumes"
Aug 05 19:36:21.000441 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:21.000399    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:36:25.625207 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:25.625141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:25.723072 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:25.723037    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:25.884684 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:25.884602    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:26.090525 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:26.090489    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:26.220427 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:26.220344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:26.321152 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:26.321119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:26.427143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:26.427099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:32.234227 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:32.234166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:32.339906 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:32.339873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:32.435083 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:32.435048    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:32.585101 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:32.585064    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:38.394516 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:38.394476    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:38.462298 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:38.462263    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:36:57.412989 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:36:57.412948    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:37:06.610089 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.610052    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"]
Aug 05 19:37:06.610531 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.610262    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l" podUID="6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" containerName="manager" containerID="cri-o://66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415" gracePeriod=10
Aug 05 19:37:06.858435 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.858408    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:37:06.882293 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.882167    2558 generic.go:356] "Generic (PLEG): container finished" podID="6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" containerID="66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415" exitCode=0
Aug 05 19:37:06.882293 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.882236    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"
Aug 05 19:37:06.882293 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.882259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l" event={"ID":"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3","Type":"ContainerDied","Data":"66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415"}
Aug 05 19:37:06.882555 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.882348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l" event={"ID":"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3","Type":"ContainerDied","Data":"d28b528161d87a5595bb781e461b73dce90762b93a8c0e678e5ea669c252822b"}
Aug 05 19:37:06.882555 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.882384    2558 scope.go:117] "RemoveContainer" containerID="66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415"
Aug 05 19:37:06.896736 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.896711    2558 scope.go:117] "RemoveContainer" containerID="66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415"
Aug 05 19:37:06.897103 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:37:06.897078    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415\": container with ID starting with 66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415 not found: ID does not exist" containerID="66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415"
Aug 05 19:37:06.897173 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:06.897120    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415"} err="failed to get container status \"66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415\": rpc error: code = NotFound desc = could not find container \"66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415\": container with ID starting with 66006f9acfac1766402d496a1b5de409ddbf4364d6c61f67ee825090337eb415 not found: ID does not exist"
Aug 05 19:37:07.007856 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.007827    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcgmv\" (UniqueName: \"kubernetes.io/projected/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-kube-api-access-tcgmv\") pod \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") "
Aug 05 19:37:07.008025 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.007899    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-extensions-socket-volume\") pod \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\" (UID: \"6475d3af-c48d-4dc4-9d56-81df5c0a4fc3\") "
Aug 05 19:37:07.008248 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.008219    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" (UID: "6475d3af-c48d-4dc4-9d56-81df5c0a4fc3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:37:07.010230 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.010154    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-kube-api-access-tcgmv" (OuterVolumeSpecName: "kube-api-access-tcgmv") pod "6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" (UID: "6475d3af-c48d-4dc4-9d56-81df5c0a4fc3"). InnerVolumeSpecName "kube-api-access-tcgmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:37:07.109515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.109475    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-extensions-socket-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:37:07.109515 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.109508    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcgmv\" (UniqueName: \"kubernetes.io/projected/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3-kube-api-access-tcgmv\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:37:07.208805 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.208771    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"]
Aug 05 19:37:07.210115 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:07.210096    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xm59l"]
Aug 05 19:37:08.475084 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:08.475053    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" path="/var/lib/kubelet/pods/6475d3af-c48d-4dc4-9d56-81df5c0a4fc3/volumes"
Aug 05 19:37:56.891618 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:37:56.891585    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:22.219604 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.219570    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"]
Aug 05 19:38:22.220047 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.219866    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" containerName="manager"
Aug 05 19:38:22.220047 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.219877    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" containerName="manager"
Aug 05 19:38:22.220047 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.219890    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1733b4fd-d595-4c22-a277-ddac1025ffea" containerName="payload-processing"
Aug 05 19:38:22.220047 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.219897    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1733b4fd-d595-4c22-a277-ddac1025ffea" containerName="payload-processing"
Aug 05 19:38:22.220047 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.219952    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1733b4fd-d595-4c22-a277-ddac1025ffea" containerName="payload-processing"
Aug 05 19:38:22.220047 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.219965    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6475d3af-c48d-4dc4-9d56-81df5c0a4fc3" containerName="manager"
Aug 05 19:38:22.222757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.222740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.225117 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.225090    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kfct5\""
Aug 05 19:38:22.235126 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.235105    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"]
Aug 05 19:38:22.251718 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.251687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hm9c\" (UniqueName: \"kubernetes.io/projected/b0be61f5-fa79-4d68-ad27-8cf611120bd3-kube-api-access-5hm9c\") pod \"kuadrant-operator-controller-manager-68cf589589-snnzx\" (UID: \"b0be61f5-fa79-4d68-ad27-8cf611120bd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.251813 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.251765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0be61f5-fa79-4d68-ad27-8cf611120bd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-snnzx\" (UID: \"b0be61f5-fa79-4d68-ad27-8cf611120bd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.352394 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.352360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0be61f5-fa79-4d68-ad27-8cf611120bd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-snnzx\" (UID: \"b0be61f5-fa79-4d68-ad27-8cf611120bd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.352561 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.352416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hm9c\" (UniqueName: \"kubernetes.io/projected/b0be61f5-fa79-4d68-ad27-8cf611120bd3-kube-api-access-5hm9c\") pod \"kuadrant-operator-controller-manager-68cf589589-snnzx\" (UID: \"b0be61f5-fa79-4d68-ad27-8cf611120bd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.352739 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.352718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0be61f5-fa79-4d68-ad27-8cf611120bd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-snnzx\" (UID: \"b0be61f5-fa79-4d68-ad27-8cf611120bd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.361268 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.361231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hm9c\" (UniqueName: \"kubernetes.io/projected/b0be61f5-fa79-4d68-ad27-8cf611120bd3-kube-api-access-5hm9c\") pod \"kuadrant-operator-controller-manager-68cf589589-snnzx\" (UID: \"b0be61f5-fa79-4d68-ad27-8cf611120bd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.532684 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.532658    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:22.672811 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:22.672758    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"]
Aug 05 19:38:22.679693 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:38:22.679655    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0be61f5_fa79_4d68_ad27_8cf611120bd3.slice/crio-372f6d2ab8502c00a6c978c304263b589a2087be08719d4906691f652bd7f1ef WatchSource:0}: Error finding container 372f6d2ab8502c00a6c978c304263b589a2087be08719d4906691f652bd7f1ef: Status 404 returned error can't find the container with id 372f6d2ab8502c00a6c978c304263b589a2087be08719d4906691f652bd7f1ef
Aug 05 19:38:23.215320 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:23.215286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx" event={"ID":"b0be61f5-fa79-4d68-ad27-8cf611120bd3","Type":"ContainerStarted","Data":"7c64ce2e6032ec57e6d3182dd967e3fa0e5f207781bd37dd17b6f4e180c154cd"}
Aug 05 19:38:23.215491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:23.215334    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx" event={"ID":"b0be61f5-fa79-4d68-ad27-8cf611120bd3","Type":"ContainerStarted","Data":"372f6d2ab8502c00a6c978c304263b589a2087be08719d4906691f652bd7f1ef"}
Aug 05 19:38:23.215491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:23.215369    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:23.237987 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:23.237938    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx" podStartSLOduration=1.237919173 podStartE2EDuration="1.237919173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:38:23.23667466 +0000 UTC m=+2199.288162352" watchObservedRunningTime="2026-08-05 19:38:23.237919173 +0000 UTC m=+2199.289406862"
Aug 05 19:38:34.222638 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:34.222599    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-snnzx"
Aug 05 19:38:40.564593 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:40.564550    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:40.668397 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:40.668363    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:40.965767 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:40.965669    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:41.442198 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:41.442151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:44.168523 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:44.168479    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:44.268487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:44.268457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:45.099143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:45.099110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:38:45.308385 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:45.308350    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:45.642763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:45.642716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:45.918405 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:45.918316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:46.017762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.017720    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:38:46.030487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.030450    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"]
Aug 05 19:38:46.034618 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.034591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.036835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.036815    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b2d0ff34\""
Aug 05 19:38:46.046566 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.046540    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"]
Aug 05 19:38:46.162784 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.162749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbaafbb3-ff25-4089-9f52-09029aa9f857-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.162986 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.162804    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4nf4\" (UniqueName: \"kubernetes.io/projected/cbaafbb3-ff25-4089-9f52-09029aa9f857-kube-api-access-t4nf4\") pod \"payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.264239 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.264123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbaafbb3-ff25-4089-9f52-09029aa9f857-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.264414 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.264247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4nf4\" (UniqueName: \"kubernetes.io/projected/cbaafbb3-ff25-4089-9f52-09029aa9f857-kube-api-access-t4nf4\") pod \"payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.265093 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.265063    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbaafbb3-ff25-4089-9f52-09029aa9f857-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.273270 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.273236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4nf4\" (UniqueName: \"kubernetes.io/projected/cbaafbb3-ff25-4089-9f52-09029aa9f857-kube-api-access-t4nf4\") pod \"payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.348643 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.348606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:46.494124 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:46.494085    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"]
Aug 05 19:38:46.497551 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:38:46.497505    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbaafbb3_ff25_4089_9f52_09029aa9f857.slice/crio-71cbdc3051eb27db532fddc83b8256eff9361446b21dab4bdaf0a926f6dc9eb3 WatchSource:0}: Error finding container 71cbdc3051eb27db532fddc83b8256eff9361446b21dab4bdaf0a926f6dc9eb3: Status 404 returned error can't find the container with id 71cbdc3051eb27db532fddc83b8256eff9361446b21dab4bdaf0a926f6dc9eb3
Aug 05 19:38:47.322467 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:47.322430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl" event={"ID":"cbaafbb3-ff25-4089-9f52-09029aa9f857","Type":"ContainerStarted","Data":"524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258"}
Aug 05 19:38:47.322686 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:47.322511    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl" event={"ID":"cbaafbb3-ff25-4089-9f52-09029aa9f857","Type":"ContainerStarted","Data":"71cbdc3051eb27db532fddc83b8256eff9361446b21dab4bdaf0a926f6dc9eb3"}
Aug 05 19:38:47.322686 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:47.322582    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:38:47.338822 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:47.338758    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl" podStartSLOduration=1.338739458 podStartE2EDuration="1.338739458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:38:47.337989244 +0000 UTC m=+2223.389476937" watchObservedRunningTime="2026-08-05 19:38:47.338739458 +0000 UTC m=+2223.390227150"
Aug 05 19:38:52.002865 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:52.002829    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:38:58.330258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:38:58.330225    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:39:09.086302 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:09.086206    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:39:21.078907 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.078869    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"]
Aug 05 19:39:21.082151 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.082132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.085290 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.085270    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b2d0ff34\"/\"kube-root-ca.crt\""
Aug 05 19:39:21.085414 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.085271    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b2d0ff34\"/\"default-dockercfg-5bhjb\""
Aug 05 19:39:21.085414 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.085271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b2d0ff34\"/\"openshift-service-ca.crt\""
Aug 05 19:39:21.085414 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.085274    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b2d0ff34\"/\"e2e-lifecycle-model-b2d0ff34-kserve-self-signed-certs\""
Aug 05 19:39:21.090575 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.090545    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"]
Aug 05 19:39:21.109980 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.109949    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:39:21.162324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.162286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-tmp-dir\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.162503 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.162336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bd0506-afbd-467a-be3d-59461080e2c7-tls-certs\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.162503 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.162399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcc9t\" (UniqueName: \"kubernetes.io/projected/80bd0506-afbd-467a-be3d-59461080e2c7-kube-api-access-tcc9t\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.162503 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.162423    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-dshm\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.162503 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.162461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-model-cache\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.162503 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.162476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-home\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.263748 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.263711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-model-cache\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.263748 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.263749    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-home\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.263969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.263804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-tmp-dir\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.263969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.263844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bd0506-afbd-467a-be3d-59461080e2c7-tls-certs\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.263969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.263903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc9t\" (UniqueName: \"kubernetes.io/projected/80bd0506-afbd-467a-be3d-59461080e2c7-kube-api-access-tcc9t\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.263969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.263941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-dshm\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.264257 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.264231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-model-cache\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.264420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.264268    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-home\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.264420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.264326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-tmp-dir\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.266458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.266434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-dshm\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.266616 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.266593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bd0506-afbd-467a-be3d-59461080e2c7-tls-certs\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.280397 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.280368    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcc9t\" (UniqueName: \"kubernetes.io/projected/80bd0506-afbd-467a-be3d-59461080e2c7-kube-api-access-tcc9t\") pod \"e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") " pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.392320 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.392226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:21.532262 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:21.532236    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"]
Aug 05 19:39:21.534817 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:39:21.534784    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80bd0506_afbd_467a_be3d_59461080e2c7.slice/crio-3de0ff2c84efb1e8b50ea03716a01c57b45d83c9873293a2e7abb62771e3d9b6 WatchSource:0}: Error finding container 3de0ff2c84efb1e8b50ea03716a01c57b45d83c9873293a2e7abb62771e3d9b6: Status 404 returned error can't find the container with id 3de0ff2c84efb1e8b50ea03716a01c57b45d83c9873293a2e7abb62771e3d9b6
Aug 05 19:39:22.479588 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:22.479549    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j" event={"ID":"80bd0506-afbd-467a-be3d-59461080e2c7","Type":"ContainerStarted","Data":"9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245"}
Aug 05 19:39:22.479588 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:22.479594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j" event={"ID":"80bd0506-afbd-467a-be3d-59461080e2c7","Type":"ContainerStarted","Data":"3de0ff2c84efb1e8b50ea03716a01c57b45d83c9873293a2e7abb62771e3d9b6"}
Aug 05 19:39:22.497169 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:22.497119    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j" podStartSLOduration=1.497104752 podStartE2EDuration="1.497104752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:39:22.494629012 +0000 UTC m=+2258.546116704" watchObservedRunningTime="2026-08-05 19:39:22.497104752 +0000 UTC m=+2258.548592444"
Aug 05 19:39:23.397783 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:23.397748    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:39:31.392375 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:31.392332    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:31.392809 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:31.392406    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:31.405264 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:31.405230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:31.529544 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:31.529515    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:39:37.196874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:37.196829    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:39:50.098251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:39:50.098173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:01.402864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:01.402825    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:40:02.425323 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:02.425289    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:03.855778 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:03.855723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:03.899436 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:03.899402    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"]
Aug 05 19:40:03.899760 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:03.899720    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl" podUID="cbaafbb3-ff25-4089-9f52-09029aa9f857" containerName="payload-pre-processing" containerID="cri-o://524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258" gracePeriod=30
Aug 05 19:40:03.958351 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:03.958315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:04.042678 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.042632    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:04.107063 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.106978    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:04.153640 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.153616    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:40:04.240539 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.240504    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbaafbb3-ff25-4089-9f52-09029aa9f857-plugins-config-volume\") pod \"cbaafbb3-ff25-4089-9f52-09029aa9f857\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") "
Aug 05 19:40:04.240715 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.240571    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4nf4\" (UniqueName: \"kubernetes.io/projected/cbaafbb3-ff25-4089-9f52-09029aa9f857-kube-api-access-t4nf4\") pod \"cbaafbb3-ff25-4089-9f52-09029aa9f857\" (UID: \"cbaafbb3-ff25-4089-9f52-09029aa9f857\") "
Aug 05 19:40:04.240939 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.240919    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbaafbb3-ff25-4089-9f52-09029aa9f857-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbaafbb3-ff25-4089-9f52-09029aa9f857" (UID: "cbaafbb3-ff25-4089-9f52-09029aa9f857"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:40:04.242860 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.242833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbaafbb3-ff25-4089-9f52-09029aa9f857-kube-api-access-t4nf4" (OuterVolumeSpecName: "kube-api-access-t4nf4") pod "cbaafbb3-ff25-4089-9f52-09029aa9f857" (UID: "cbaafbb3-ff25-4089-9f52-09029aa9f857"). InnerVolumeSpecName "kube-api-access-t4nf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:40:04.341743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.341699    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbaafbb3-ff25-4089-9f52-09029aa9f857-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:04.341743 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.341733    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4nf4\" (UniqueName: \"kubernetes.io/projected/cbaafbb3-ff25-4089-9f52-09029aa9f857-kube-api-access-t4nf4\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:04.670159 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.670119    2558 generic.go:356] "Generic (PLEG): container finished" podID="cbaafbb3-ff25-4089-9f52-09029aa9f857" containerID="524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258" exitCode=0
Aug 05 19:40:04.670159 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.670159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl" event={"ID":"cbaafbb3-ff25-4089-9f52-09029aa9f857","Type":"ContainerDied","Data":"524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258"}
Aug 05 19:40:04.670400 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.670167    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"
Aug 05 19:40:04.670400 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.670219    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl" event={"ID":"cbaafbb3-ff25-4089-9f52-09029aa9f857","Type":"ContainerDied","Data":"71cbdc3051eb27db532fddc83b8256eff9361446b21dab4bdaf0a926f6dc9eb3"}
Aug 05 19:40:04.670400 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.670243    2558 scope.go:117] "RemoveContainer" containerID="524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258"
Aug 05 19:40:04.679055 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.679034    2558 scope.go:117] "RemoveContainer" containerID="524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258"
Aug 05 19:40:04.679414 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:40:04.679391    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258\": container with ID starting with 524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258 not found: ID does not exist" containerID="524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258"
Aug 05 19:40:04.679520 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.679422    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258"} err="failed to get container status \"524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258\": rpc error: code = NotFound desc = could not find container \"524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258\": container with ID starting with 524affcd022c322a5f0c7e0640a9b798a2dad8104b8ecff5dc48b7782436c258 not found: ID does not exist"
Aug 05 19:40:04.685731 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.685697    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"]
Aug 05 19:40:04.688881 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:04.688856    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2d0ff34-7c9d5b58b4-jdjsl"]
Aug 05 19:40:06.480488 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:06.480455    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbaafbb3-ff25-4089-9f52-09029aa9f857" path="/var/lib/kubelet/pods/cbaafbb3-ff25-4089-9f52-09029aa9f857/volumes"
Aug 05 19:40:07.000791 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:07.000751    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:09.799010 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:09.798975    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:40:11.001252 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:11.001210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:11.995833 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:11.995794    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"]
Aug 05 19:40:12.072133 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:12.072092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:27.015813 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.015747    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j" podUID="80bd0506-afbd-467a-be3d-59461080e2c7" containerName="main" containerID="cri-o://9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245" gracePeriod=45
Aug 05 19:40:27.265542 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.265517    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:40:27.356987 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.356959    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-model-cache\") pod \"80bd0506-afbd-467a-be3d-59461080e2c7\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") "
Aug 05 19:40:27.357172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.356999    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-dshm\") pod \"80bd0506-afbd-467a-be3d-59461080e2c7\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") "
Aug 05 19:40:27.357172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357020    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-tmp-dir\") pod \"80bd0506-afbd-467a-be3d-59461080e2c7\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") "
Aug 05 19:40:27.357172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357063    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcc9t\" (UniqueName: \"kubernetes.io/projected/80bd0506-afbd-467a-be3d-59461080e2c7-kube-api-access-tcc9t\") pod \"80bd0506-afbd-467a-be3d-59461080e2c7\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") "
Aug 05 19:40:27.357172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357124    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-home\") pod \"80bd0506-afbd-467a-be3d-59461080e2c7\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") "
Aug 05 19:40:27.357172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357157    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bd0506-afbd-467a-be3d-59461080e2c7-tls-certs\") pod \"80bd0506-afbd-467a-be3d-59461080e2c7\" (UID: \"80bd0506-afbd-467a-be3d-59461080e2c7\") "
Aug 05 19:40:27.357497 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357328    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "80bd0506-afbd-467a-be3d-59461080e2c7" (UID: "80bd0506-afbd-467a-be3d-59461080e2c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:40:27.357497 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357370    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "80bd0506-afbd-467a-be3d-59461080e2c7" (UID: "80bd0506-afbd-467a-be3d-59461080e2c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:40:27.357595 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357516    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-home" (OuterVolumeSpecName: "home") pod "80bd0506-afbd-467a-be3d-59461080e2c7" (UID: "80bd0506-afbd-467a-be3d-59461080e2c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:40:27.357648 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357592    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:27.357648 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.357611    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:27.359535 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.359506    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80bd0506-afbd-467a-be3d-59461080e2c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "80bd0506-afbd-467a-be3d-59461080e2c7" (UID: "80bd0506-afbd-467a-be3d-59461080e2c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:40:27.359535 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.359514    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80bd0506-afbd-467a-be3d-59461080e2c7-kube-api-access-tcc9t" (OuterVolumeSpecName: "kube-api-access-tcc9t") pod "80bd0506-afbd-467a-be3d-59461080e2c7" (UID: "80bd0506-afbd-467a-be3d-59461080e2c7"). InnerVolumeSpecName "kube-api-access-tcc9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:40:27.359535 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.359509    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-dshm" (OuterVolumeSpecName: "dshm") pod "80bd0506-afbd-467a-be3d-59461080e2c7" (UID: "80bd0506-afbd-467a-be3d-59461080e2c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:40:27.458099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.458047    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:27.458099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.458093    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcc9t\" (UniqueName: \"kubernetes.io/projected/80bd0506-afbd-467a-be3d-59461080e2c7-kube-api-access-tcc9t\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:27.458099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.458103    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80bd0506-afbd-467a-be3d-59461080e2c7-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:27.458099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.458111    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bd0506-afbd-467a-be3d-59461080e2c7-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:40:27.771592 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.771560    2558 generic.go:356] "Generic (PLEG): container finished" podID="80bd0506-afbd-467a-be3d-59461080e2c7" containerID="9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245" exitCode=0
Aug 05 19:40:27.771745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.771598    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"
Aug 05 19:40:27.771745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.771648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j" event={"ID":"80bd0506-afbd-467a-be3d-59461080e2c7","Type":"ContainerDied","Data":"9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245"}
Aug 05 19:40:27.771745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.771692    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j" event={"ID":"80bd0506-afbd-467a-be3d-59461080e2c7","Type":"ContainerDied","Data":"3de0ff2c84efb1e8b50ea03716a01c57b45d83c9873293a2e7abb62771e3d9b6"}
Aug 05 19:40:27.771745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.771710    2558 scope.go:117] "RemoveContainer" containerID="9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245"
Aug 05 19:40:27.780733 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.780716    2558 scope.go:117] "RemoveContainer" containerID="9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245"
Aug 05 19:40:27.780974 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:40:27.780953    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245\": container with ID starting with 9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245 not found: ID does not exist" containerID="9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245"
Aug 05 19:40:27.781032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.780988    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245"} err="failed to get container status \"9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245\": rpc error: code = NotFound desc = could not find container \"9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245\": container with ID starting with 9df93c2a26cc6a606619ad87c4096e8e9dc57d0e5673fd331456973fcff4e245 not found: ID does not exist"
Aug 05 19:40:27.792745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.792724    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"]
Aug 05 19:40:27.796389 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:27.796370    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b2d0ff34/e2e-lifecycle-model-b2d0ff34-kserve-6655b7bff9-8z85j"]
Aug 05 19:40:28.475757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:28.475727    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80bd0506-afbd-467a-be3d-59461080e2c7" path="/var/lib/kubelet/pods/80bd0506-afbd-467a-be3d-59461080e2c7/volumes"
Aug 05 19:40:49.247485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:49.247444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:50.382154 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:50.382121    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:55.459421 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:55.459380    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:55.556226 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:55.556163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:55.757751 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:55.757659    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:55.979388 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:55.979356    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:40:57.706243 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:40:57.706215    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:41:07.216550 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:07.216514    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:07.314467 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:07.314429    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:07.413588 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:07.413547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:08.002252 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:08.002222    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:08.100953 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:08.100918    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:08.203089 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:08.203056    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:09.393069 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:09.393039    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:09.710331 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:09.710252    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:41:15.817980 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:15.817945    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:15.929414 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:15.929377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:16.404130 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:16.404086    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:41:16.479764 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:16.479733    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:22.254237 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:22.254201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:22.366086 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:22.366051    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:22.456132 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:22.456095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:24.806729 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:24.806691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:41:32.945607 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:32.945569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:33.170203 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:33.170150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:41:54.086876 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:41:54.086816    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:00.013425 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:00.013386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:00.113480 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:00.113444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:00.329440 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:00.329403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:00.647357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:00.647274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:01.004498 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:01.004411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:03.238093 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:03.238047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:03.336507 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:03.336471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:04.526644 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:04.526611    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:05.025358 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.025322    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:05.122874 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.122843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:05.162957 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.162919    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"]
Aug 05 19:42:05.163264 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.163251    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80bd0506-afbd-467a-be3d-59461080e2c7" containerName="main"
Aug 05 19:42:05.163324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.163265    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="80bd0506-afbd-467a-be3d-59461080e2c7" containerName="main"
Aug 05 19:42:05.163324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.163283    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbaafbb3-ff25-4089-9f52-09029aa9f857" containerName="payload-pre-processing"
Aug 05 19:42:05.163324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.163290    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbaafbb3-ff25-4089-9f52-09029aa9f857" containerName="payload-pre-processing"
Aug 05 19:42:05.163437 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.163343    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="80bd0506-afbd-467a-be3d-59461080e2c7" containerName="main"
Aug 05 19:42:05.163437 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.163351    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbaafbb3-ff25-4089-9f52-09029aa9f857" containerName="payload-pre-processing"
Aug 05 19:42:05.166497 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.166478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.168806 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.168784    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-8dc955-dockercfg-q4n2x\""
Aug 05 19:42:05.168919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.168785    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-8dc955\""
Aug 05 19:42:05.175557 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.175493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"]
Aug 05 19:42:05.205805 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.205776    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"]
Aug 05 19:42:05.209082 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.209064    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.220449 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.220421    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"]
Aug 05 19:42:05.312146 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.312059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvbzm\" (UniqueName: \"kubernetes.io/projected/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-kube-api-access-qvbzm\") pod \"payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.312146 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.312111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzxzf\" (UniqueName: \"kubernetes.io/projected/81d03786-2740-409b-9ab4-dd921d7c8f49-kube-api-access-lzxzf\") pod \"payload-processing-e2e-inf-a-8dc955-698977466-7k2zc\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.312146 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.312145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.312431 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.312235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d03786-2740-409b-9ab4-dd921d7c8f49-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8dc955-698977466-7k2zc\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.413697 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.413662    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzxzf\" (UniqueName: \"kubernetes.io/projected/81d03786-2740-409b-9ab4-dd921d7c8f49-kube-api-access-lzxzf\") pod \"payload-processing-e2e-inf-a-8dc955-698977466-7k2zc\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.413922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.413726    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.413922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.413768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d03786-2740-409b-9ab4-dd921d7c8f49-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8dc955-698977466-7k2zc\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.413922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.413829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbzm\" (UniqueName: \"kubernetes.io/projected/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-kube-api-access-qvbzm\") pod \"payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.414560 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.414540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.414615 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.414543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d03786-2740-409b-9ab4-dd921d7c8f49-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8dc955-698977466-7k2zc\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.425337 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.425306    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzxzf\" (UniqueName: \"kubernetes.io/projected/81d03786-2740-409b-9ab4-dd921d7c8f49-kube-api-access-lzxzf\") pod \"payload-processing-e2e-inf-a-8dc955-698977466-7k2zc\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.425648 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.425631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvbzm\" (UniqueName: \"kubernetes.io/projected/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-kube-api-access-qvbzm\") pod \"payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.477471 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.477431    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:05.520034 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.519997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:05.623069 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.622944    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"]
Aug 05 19:42:05.625404 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:42:05.625374    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d03786_2740_409b_9ab4_dd921d7c8f49.slice/crio-74c00ed32c88a2450f212f10c2c19f3ecbfcb6968bdc2d965bfc94b12385ef20 WatchSource:0}: Error finding container 74c00ed32c88a2450f212f10c2c19f3ecbfcb6968bdc2d965bfc94b12385ef20: Status 404 returned error can't find the container with id 74c00ed32c88a2450f212f10c2c19f3ecbfcb6968bdc2d965bfc94b12385ef20
Aug 05 19:42:05.676525 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:05.676494    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"]
Aug 05 19:42:05.680271 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:42:05.680244    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c3f183_ef6d_46ec_86c1_fa04a0be2876.slice/crio-0fe591b8fd6264f9901412ccf67ca28aee58f22b19c7b0d760d12bd8b3a28fbe WatchSource:0}: Error finding container 0fe591b8fd6264f9901412ccf67ca28aee58f22b19c7b0d760d12bd8b3a28fbe: Status 404 returned error can't find the container with id 0fe591b8fd6264f9901412ccf67ca28aee58f22b19c7b0d760d12bd8b3a28fbe
Aug 05 19:42:06.208569 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.208535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z" event={"ID":"b7c3f183-ef6d-46ec-86c1-fa04a0be2876","Type":"ContainerStarted","Data":"0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b"}
Aug 05 19:42:06.208771 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.208584    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z" event={"ID":"b7c3f183-ef6d-46ec-86c1-fa04a0be2876","Type":"ContainerStarted","Data":"0fe591b8fd6264f9901412ccf67ca28aee58f22b19c7b0d760d12bd8b3a28fbe"}
Aug 05 19:42:06.208771 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.208647    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:06.210033 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.210009    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc" event={"ID":"81d03786-2740-409b-9ab4-dd921d7c8f49","Type":"ContainerStarted","Data":"63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c"}
Aug 05 19:42:06.210153 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.210047    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc" event={"ID":"81d03786-2740-409b-9ab4-dd921d7c8f49","Type":"ContainerStarted","Data":"74c00ed32c88a2450f212f10c2c19f3ecbfcb6968bdc2d965bfc94b12385ef20"}
Aug 05 19:42:06.210153 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.210137    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:06.225131 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.225066    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z" podStartSLOduration=1.22504912 podStartE2EDuration="1.22504912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:06.224254554 +0000 UTC m=+2422.275742250" watchObservedRunningTime="2026-08-05 19:42:06.22504912 +0000 UTC m=+2422.276536803"
Aug 05 19:42:06.240191 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:06.240143    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc" podStartSLOduration=1.240128298 podStartE2EDuration="1.240128298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:06.23877252 +0000 UTC m=+2422.290260213" watchObservedRunningTime="2026-08-05 19:42:06.240128298 +0000 UTC m=+2422.291615989"
Aug 05 19:42:07.597677 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:07.597636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:42:09.248332 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:09.248294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:09.348347 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:09.348312    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:17.217093 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:17.217057    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:42:17.217729 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:17.217140    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:42:28.184782 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:28.184749    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:28.496145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:28.496061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:28.820103 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:28.820066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:29.203261 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:29.203140    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:31.401294 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:31.401261    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:31.492085 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:31.492053    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:32.518099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:32.518066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:32.703289 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:32.703245    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:33.024149 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.024117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:33.122310 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.122264    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"]
Aug 05 19:42:33.124025 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.124000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:42:33.125664 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.125648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.127965 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.127947    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c87762-dockercfg-n22jn\""
Aug 05 19:42:33.128060 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.127947    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c87762\""
Aug 05 19:42:33.135870 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.135846    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"]
Aug 05 19:42:33.157386 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.157355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwt9\" (UniqueName: \"kubernetes.io/projected/8485d773-3ef5-4f07-9105-362be09513dc-kube-api-access-lbwt9\") pod \"payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.157529 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.157402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8485d773-3ef5-4f07-9105-362be09513dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.258238 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.258170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwt9\" (UniqueName: \"kubernetes.io/projected/8485d773-3ef5-4f07-9105-362be09513dc-kube-api-access-lbwt9\") pod \"payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.258448 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.258252    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8485d773-3ef5-4f07-9105-362be09513dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.258909 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.258888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8485d773-3ef5-4f07-9105-362be09513dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.271674 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.271645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwt9\" (UniqueName: \"kubernetes.io/projected/8485d773-3ef5-4f07-9105-362be09513dc-kube-api-access-lbwt9\") pod \"payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.436449 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.436336    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:33.586794 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:33.586760    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"]
Aug 05 19:42:33.590089 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:42:33.590061    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8485d773_3ef5_4f07_9105_362be09513dc.slice/crio-f85aced222fa7ef086f1234a5083744c060b34ef1c5b6acab875b1e0c18247b8 WatchSource:0}: Error finding container f85aced222fa7ef086f1234a5083744c060b34ef1c5b6acab875b1e0c18247b8: Status 404 returned error can't find the container with id f85aced222fa7ef086f1234a5083744c060b34ef1c5b6acab875b1e0c18247b8
Aug 05 19:42:34.339566 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:34.339517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54" event={"ID":"8485d773-3ef5-4f07-9105-362be09513dc","Type":"ContainerStarted","Data":"a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333"}
Aug 05 19:42:34.339776 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:34.339589    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:34.339776 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:34.339613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54" event={"ID":"8485d773-3ef5-4f07-9105-362be09513dc","Type":"ContainerStarted","Data":"f85aced222fa7ef086f1234a5083744c060b34ef1c5b6acab875b1e0c18247b8"}
Aug 05 19:42:34.355495 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:34.355443    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54" podStartSLOduration=1.355426013 podStartE2EDuration="1.355426013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:34.353806675 +0000 UTC m=+2450.405294368" watchObservedRunningTime="2026-08-05 19:42:34.355426013 +0000 UTC m=+2450.406913713"
Aug 05 19:42:35.702779 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:35.702743    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:42:45.346269 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:45.346236    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:42:56.357694 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:42:56.357657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:43:04.371970 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.371934    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"]
Aug 05 19:43:04.375586 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.375568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.377944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.377921    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8dc955\"/\"test-model-8dc955-kserve-self-signed-certs\""
Aug 05 19:43:04.378730 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.378706    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8dc955\"/\"openshift-service-ca.crt\""
Aug 05 19:43:04.378864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.378724    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8dc955\"/\"kube-root-ca.crt\""
Aug 05 19:43:04.378864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.378789    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8dc955\"/\"default-dockercfg-55g8q\""
Aug 05 19:43:04.388850 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.388824    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"]
Aug 05 19:43:04.396721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.396684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:43:04.440115 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.440079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-home\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.440330 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.440124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-tmp-dir\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.440330 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.440210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-model-cache\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.440330 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.440264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6t2\" (UniqueName: \"kubernetes.io/projected/e248219b-4933-47f3-823f-832b0ae72212-kube-api-access-xf6t2\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.440330 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.440300    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e248219b-4933-47f3-823f-832b0ae72212-tls-certs\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.440330 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.440323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-dshm\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.541610 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.541570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e248219b-4933-47f3-823f-832b0ae72212-tls-certs\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.541790 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.541629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-dshm\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.541790 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.541693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-home\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.541790 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.541722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-tmp-dir\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.541790 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.541761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-model-cache\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.541984 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.541908    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6t2\" (UniqueName: \"kubernetes.io/projected/e248219b-4933-47f3-823f-832b0ae72212-kube-api-access-xf6t2\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.542129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.542102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-home\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.542509 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.542490    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-model-cache\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.542723 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.542704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-tmp-dir\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.544292 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.544263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-dshm\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.544491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.544474    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e248219b-4933-47f3-823f-832b0ae72212-tls-certs\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.550238 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.550216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6t2\" (UniqueName: \"kubernetes.io/projected/e248219b-4933-47f3-823f-832b0ae72212-kube-api-access-xf6t2\") pod \"test-model-8dc955-kserve-7c9c98dcd5-kmh9x\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") " pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.685492 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.685386    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:04.820616 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:04.820582    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"]
Aug 05 19:43:04.823858 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:43:04.823828    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode248219b_4933_47f3_823f_832b0ae72212.slice/crio-c8b5a6ab48eba8e53e62d176c71a195497723b4b92999f455c9b4c4edab3aaf3 WatchSource:0}: Error finding container c8b5a6ab48eba8e53e62d176c71a195497723b4b92999f455c9b4c4edab3aaf3: Status 404 returned error can't find the container with id c8b5a6ab48eba8e53e62d176c71a195497723b4b92999f455c9b4c4edab3aaf3
Aug 05 19:43:05.490152 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:05.490113    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x" event={"ID":"e248219b-4933-47f3-823f-832b0ae72212","Type":"ContainerStarted","Data":"6962e1b68210e4a61ac446458ecb94d3a31ea9ffac6dc1841ab7d90f1c841bb9"}
Aug 05 19:43:05.490152 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:05.490158    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x" event={"ID":"e248219b-4933-47f3-823f-832b0ae72212","Type":"ContainerStarted","Data":"c8b5a6ab48eba8e53e62d176c71a195497723b4b92999f455c9b4c4edab3aaf3"}
Aug 05 19:43:05.507925 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:05.507866    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x" podStartSLOduration=1.5078508849999999 podStartE2EDuration="1.507850885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:43:05.50586879 +0000 UTC m=+2481.557356483" watchObservedRunningTime="2026-08-05 19:43:05.507850885 +0000 UTC m=+2481.559338583"
Aug 05 19:43:07.098249 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:07.098207    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:43:14.000876 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:14.000837    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:43:14.685692 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:14.685650    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:14.685883 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:14.685705    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:14.698334 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:14.698309    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:15.551962 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:15.551928    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:43:24.686588 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.686556    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"]
Aug 05 19:43:24.689941 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.689921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.693087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.693061    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c87762\"/\"default-dockercfg-g8rs8\""
Aug 05 19:43:24.693229 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.693115    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c87762\"/\"test-model-c87762-kserve-self-signed-certs\""
Aug 05 19:43:24.693229 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.693126    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c87762\"/\"kube-root-ca.crt\""
Aug 05 19:43:24.693229 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.693062    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c87762\"/\"openshift-service-ca.crt\""
Aug 05 19:43:24.699772 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.699748    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"]
Aug 05 19:43:24.708693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.708669    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:43:24.820097 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.820061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tmp-dir\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.820296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.820103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4m6k\" (UniqueName: \"kubernetes.io/projected/f048ca64-c1a9-42e3-a10b-384df0e8f39e-kube-api-access-z4m6k\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.820296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.820126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tls-certs\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.820296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.820173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-dshm\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.820296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.820246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-model-cache\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.820296 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.820271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-home\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921274 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-dshm\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-model-cache\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-home\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tmp-dir\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4m6k\" (UniqueName: \"kubernetes.io/projected/f048ca64-c1a9-42e3-a10b-384df0e8f39e-kube-api-access-z4m6k\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tls-certs\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-model-cache\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tmp-dir\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.921852 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.921806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-home\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.923591 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.923568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-dshm\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.924026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.924008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tls-certs\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:24.929094 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:24.929074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4m6k\" (UniqueName: \"kubernetes.io/projected/f048ca64-c1a9-42e3-a10b-384df0e8f39e-kube-api-access-z4m6k\") pod \"test-model-c87762-kserve-84f56875ff-kb28n\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") " pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:25.001081 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:25.000998    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:25.137260 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:25.137235    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"]
Aug 05 19:43:25.139114 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:43:25.139088    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf048ca64_c1a9_42e3_a10b_384df0e8f39e.slice/crio-fcb5da6e41e8c221037dbea78a5eadf3019d5c23a656d18d6967c90ebcb3e2b0 WatchSource:0}: Error finding container fcb5da6e41e8c221037dbea78a5eadf3019d5c23a656d18d6967c90ebcb3e2b0: Status 404 returned error can't find the container with id fcb5da6e41e8c221037dbea78a5eadf3019d5c23a656d18d6967c90ebcb3e2b0
Aug 05 19:43:25.581881 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:25.581844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n" event={"ID":"f048ca64-c1a9-42e3-a10b-384df0e8f39e","Type":"ContainerStarted","Data":"b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a"}
Aug 05 19:43:25.581881 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:25.581887    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n" event={"ID":"f048ca64-c1a9-42e3-a10b-384df0e8f39e","Type":"ContainerStarted","Data":"fcb5da6e41e8c221037dbea78a5eadf3019d5c23a656d18d6967c90ebcb3e2b0"}
Aug 05 19:43:25.600342 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:25.600293    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n" podStartSLOduration=1.600277335 podStartE2EDuration="1.600277335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:43:25.599417439 +0000 UTC m=+2501.650905133" watchObservedRunningTime="2026-08-05 19:43:25.600277335 +0000 UTC m=+2501.651765027"
Aug 05 19:43:27.603509 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:27.603474    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:43:29.836196 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:29.836147    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:43:34.100136 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:34.100096    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:43:35.002211 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:35.002117    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:35.002401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:35.002297    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:35.015589 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:35.015560    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:43:35.645581 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:43:35.645548    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:44:02.138378 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:02.138345    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:10.601469 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:10.601436    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"]
Aug 05 19:44:10.628402 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:10.628367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:11.593705 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:11.593661    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"]
Aug 05 19:44:11.617327 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:11.617288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:13.998065 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:13.998029    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:44:22.266793 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.266745    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:22.295350 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.295307    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"]
Aug 05 19:44:22.295650 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.295621    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc" podUID="81d03786-2740-409b-9ab4-dd921d7c8f49" containerName="payload-processing" containerID="cri-o://63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c" gracePeriod=30
Aug 05 19:44:22.303558 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.303524    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"]
Aug 05 19:44:22.303808 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.303776    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z" podUID="b7c3f183-ef6d-46ec-86c1-fa04a0be2876" containerName="payload-pre-processing" containerID="cri-o://0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b" gracePeriod=30
Aug 05 19:44:22.335396 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.335359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:22.395835 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.395795    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:22.460067 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.460032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:22.571420 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.571396    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:44:22.596589 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.596564    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:44:22.744283 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.744255    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-plugins-config-volume\") pod \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") "
Aug 05 19:44:22.744474 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.744323    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzxzf\" (UniqueName: \"kubernetes.io/projected/81d03786-2740-409b-9ab4-dd921d7c8f49-kube-api-access-lzxzf\") pod \"81d03786-2740-409b-9ab4-dd921d7c8f49\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") "
Aug 05 19:44:22.744474 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.744347    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d03786-2740-409b-9ab4-dd921d7c8f49-plugins-config-volume\") pod \"81d03786-2740-409b-9ab4-dd921d7c8f49\" (UID: \"81d03786-2740-409b-9ab4-dd921d7c8f49\") "
Aug 05 19:44:22.744474 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.744392    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvbzm\" (UniqueName: \"kubernetes.io/projected/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-kube-api-access-qvbzm\") pod \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\" (UID: \"b7c3f183-ef6d-46ec-86c1-fa04a0be2876\") "
Aug 05 19:44:22.744762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.744721    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7c3f183-ef6d-46ec-86c1-fa04a0be2876" (UID: "b7c3f183-ef6d-46ec-86c1-fa04a0be2876"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:44:22.744762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.744744    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d03786-2740-409b-9ab4-dd921d7c8f49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81d03786-2740-409b-9ab4-dd921d7c8f49" (UID: "81d03786-2740-409b-9ab4-dd921d7c8f49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:44:22.746679 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.746658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d03786-2740-409b-9ab4-dd921d7c8f49-kube-api-access-lzxzf" (OuterVolumeSpecName: "kube-api-access-lzxzf") pod "81d03786-2740-409b-9ab4-dd921d7c8f49" (UID: "81d03786-2740-409b-9ab4-dd921d7c8f49"). InnerVolumeSpecName "kube-api-access-lzxzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:44:22.746679 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.746656    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-kube-api-access-qvbzm" (OuterVolumeSpecName: "kube-api-access-qvbzm") pod "b7c3f183-ef6d-46ec-86c1-fa04a0be2876" (UID: "b7c3f183-ef6d-46ec-86c1-fa04a0be2876"). InnerVolumeSpecName "kube-api-access-qvbzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:44:22.801837 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.801755    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:22.845387 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.845354    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvbzm\" (UniqueName: \"kubernetes.io/projected/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-kube-api-access-qvbzm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:22.845387 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.845381    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7c3f183-ef6d-46ec-86c1-fa04a0be2876-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:22.845387 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.845390    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzxzf\" (UniqueName: \"kubernetes.io/projected/81d03786-2740-409b-9ab4-dd921d7c8f49-kube-api-access-lzxzf\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:22.845649 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.845401    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d03786-2740-409b-9ab4-dd921d7c8f49-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:22.854510 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.854482    2558 generic.go:356] "Generic (PLEG): container finished" podID="b7c3f183-ef6d-46ec-86c1-fa04a0be2876" containerID="0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b" exitCode=0
Aug 05 19:44:22.854654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.854533    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"
Aug 05 19:44:22.854654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.854569    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z" event={"ID":"b7c3f183-ef6d-46ec-86c1-fa04a0be2876","Type":"ContainerDied","Data":"0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b"}
Aug 05 19:44:22.854654 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.854637    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z" event={"ID":"b7c3f183-ef6d-46ec-86c1-fa04a0be2876","Type":"ContainerDied","Data":"0fe591b8fd6264f9901412ccf67ca28aee58f22b19c7b0d760d12bd8b3a28fbe"}
Aug 05 19:44:22.854778 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.854672    2558 scope.go:117] "RemoveContainer" containerID="0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b"
Aug 05 19:44:22.856084 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.856057    2558 generic.go:356] "Generic (PLEG): container finished" podID="81d03786-2740-409b-9ab4-dd921d7c8f49" containerID="63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c" exitCode=0
Aug 05 19:44:22.856231 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.856105    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"
Aug 05 19:44:22.856231 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.856148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc" event={"ID":"81d03786-2740-409b-9ab4-dd921d7c8f49","Type":"ContainerDied","Data":"63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c"}
Aug 05 19:44:22.856518 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.856471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc" event={"ID":"81d03786-2740-409b-9ab4-dd921d7c8f49","Type":"ContainerDied","Data":"74c00ed32c88a2450f212f10c2c19f3ecbfcb6968bdc2d965bfc94b12385ef20"}
Aug 05 19:44:22.863543 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.863525    2558 scope.go:117] "RemoveContainer" containerID="0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b"
Aug 05 19:44:22.863828 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:44:22.863808    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b\": container with ID starting with 0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b not found: ID does not exist" containerID="0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b"
Aug 05 19:44:22.863887 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.863836    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b"} err="failed to get container status \"0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b\": rpc error: code = NotFound desc = could not find container \"0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b\": container with ID starting with 0642537731a359787b475b38ba18aa56b70d841bac0a59bb3edce4267881e77b not found: ID does not exist"
Aug 05 19:44:22.863887 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.863855    2558 scope.go:117] "RemoveContainer" containerID="63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c"
Aug 05 19:44:22.872680 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.872665    2558 scope.go:117] "RemoveContainer" containerID="63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c"
Aug 05 19:44:22.872924 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:44:22.872906    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c\": container with ID starting with 63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c not found: ID does not exist" containerID="63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c"
Aug 05 19:44:22.872999 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.872933    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c"} err="failed to get container status \"63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c\": rpc error: code = NotFound desc = could not find container \"63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c\": container with ID starting with 63bbd45f6b35bac3addda2c2cf33ce099c5668aebf382dcb6f719077692edc8c not found: ID does not exist"
Aug 05 19:44:22.879165 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.879144    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"]
Aug 05 19:44:22.883643 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.883624    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8dc955-66d54468d4-c7w8z"]
Aug 05 19:44:22.893076 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.893054    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"]
Aug 05 19:44:22.896762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:22.896741    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8dc955-698977466-7k2zc"]
Aug 05 19:44:24.475838 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:24.475804    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81d03786-2740-409b-9ab4-dd921d7c8f49" path="/var/lib/kubelet/pods/81d03786-2740-409b-9ab4-dd921d7c8f49/volumes"
Aug 05 19:44:24.476359 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:24.476303    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7c3f183-ef6d-46ec-86c1-fa04a0be2876" path="/var/lib/kubelet/pods/b7c3f183-ef6d-46ec-86c1-fa04a0be2876/volumes"
Aug 05 19:44:24.543806 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:24.543760    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:44:25.620747 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.620705    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x" podUID="e248219b-4933-47f3-823f-832b0ae72212" containerName="main" containerID="cri-o://6962e1b68210e4a61ac446458ecb94d3a31ea9ffac6dc1841ab7d90f1c841bb9" gracePeriod=45
Aug 05 19:44:25.873558 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.873484    2558 generic.go:356] "Generic (PLEG): container finished" podID="e248219b-4933-47f3-823f-832b0ae72212" containerID="6962e1b68210e4a61ac446458ecb94d3a31ea9ffac6dc1841ab7d90f1c841bb9" exitCode=0
Aug 05 19:44:25.873558 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.873531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x" event={"ID":"e248219b-4933-47f3-823f-832b0ae72212","Type":"ContainerDied","Data":"6962e1b68210e4a61ac446458ecb94d3a31ea9ffac6dc1841ab7d90f1c841bb9"}
Aug 05 19:44:25.873715 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.873564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x" event={"ID":"e248219b-4933-47f3-823f-832b0ae72212","Type":"ContainerDied","Data":"c8b5a6ab48eba8e53e62d176c71a195497723b4b92999f455c9b4c4edab3aaf3"}
Aug 05 19:44:25.873715 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.873583    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8b5a6ab48eba8e53e62d176c71a195497723b4b92999f455c9b4c4edab3aaf3"
Aug 05 19:44:25.880100 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.880078    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:44:25.975553 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975524    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-dshm\") pod \"e248219b-4933-47f3-823f-832b0ae72212\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") "
Aug 05 19:44:25.975757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975585    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-tmp-dir\") pod \"e248219b-4933-47f3-823f-832b0ae72212\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") "
Aug 05 19:44:25.975757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975611    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-model-cache\") pod \"e248219b-4933-47f3-823f-832b0ae72212\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") "
Aug 05 19:44:25.975757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975667    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf6t2\" (UniqueName: \"kubernetes.io/projected/e248219b-4933-47f3-823f-832b0ae72212-kube-api-access-xf6t2\") pod \"e248219b-4933-47f3-823f-832b0ae72212\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") "
Aug 05 19:44:25.975757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975687    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e248219b-4933-47f3-823f-832b0ae72212-tls-certs\") pod \"e248219b-4933-47f3-823f-832b0ae72212\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") "
Aug 05 19:44:25.975757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975734    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-home\") pod \"e248219b-4933-47f3-823f-832b0ae72212\" (UID: \"e248219b-4933-47f3-823f-832b0ae72212\") "
Aug 05 19:44:25.976026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975905    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e248219b-4933-47f3-823f-832b0ae72212" (UID: "e248219b-4933-47f3-823f-832b0ae72212"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:25.976026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.975948    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-model-cache" (OuterVolumeSpecName: "model-cache") pod "e248219b-4933-47f3-823f-832b0ae72212" (UID: "e248219b-4933-47f3-823f-832b0ae72212"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:25.976140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.976039    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:25.976140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.976093    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-home" (OuterVolumeSpecName: "home") pod "e248219b-4933-47f3-823f-832b0ae72212" (UID: "e248219b-4933-47f3-823f-832b0ae72212"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:25.978093 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.978067    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-dshm" (OuterVolumeSpecName: "dshm") pod "e248219b-4933-47f3-823f-832b0ae72212" (UID: "e248219b-4933-47f3-823f-832b0ae72212"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:25.978258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.978109    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e248219b-4933-47f3-823f-832b0ae72212-kube-api-access-xf6t2" (OuterVolumeSpecName: "kube-api-access-xf6t2") pod "e248219b-4933-47f3-823f-832b0ae72212" (UID: "e248219b-4933-47f3-823f-832b0ae72212"). InnerVolumeSpecName "kube-api-access-xf6t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:44:25.978258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:25.978119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e248219b-4933-47f3-823f-832b0ae72212-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e248219b-4933-47f3-823f-832b0ae72212" (UID: "e248219b-4933-47f3-823f-832b0ae72212"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:44:26.077408 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.077368    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:26.077408 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.077402    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf6t2\" (UniqueName: \"kubernetes.io/projected/e248219b-4933-47f3-823f-832b0ae72212-kube-api-access-xf6t2\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:26.077408 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.077413    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e248219b-4933-47f3-823f-832b0ae72212-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:26.077643 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.077423    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:26.077643 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.077432    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e248219b-4933-47f3-823f-832b0ae72212-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:26.614333 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.614288    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n" podUID="f048ca64-c1a9-42e3-a10b-384df0e8f39e" containerName="main" containerID="cri-o://b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a" gracePeriod=45
Aug 05 19:44:26.873130 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.873099    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:44:26.878630 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.878606    2558 generic.go:356] "Generic (PLEG): container finished" podID="f048ca64-c1a9-42e3-a10b-384df0e8f39e" containerID="b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a" exitCode=0
Aug 05 19:44:26.878745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.878640    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"
Aug 05 19:44:26.878745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.878687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n" event={"ID":"f048ca64-c1a9-42e3-a10b-384df0e8f39e","Type":"ContainerDied","Data":"b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a"}
Aug 05 19:44:26.878745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.878729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n" event={"ID":"f048ca64-c1a9-42e3-a10b-384df0e8f39e","Type":"ContainerDied","Data":"fcb5da6e41e8c221037dbea78a5eadf3019d5c23a656d18d6967c90ebcb3e2b0"}
Aug 05 19:44:26.878745 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.878746    2558 scope.go:117] "RemoveContainer" containerID="b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a"
Aug 05 19:44:26.878940 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.878764    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"
Aug 05 19:44:26.888811 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.888789    2558 scope.go:117] "RemoveContainer" containerID="b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a"
Aug 05 19:44:26.889100 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:44:26.889060    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a\": container with ID starting with b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a not found: ID does not exist" containerID="b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a"
Aug 05 19:44:26.889230 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.889105    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a"} err="failed to get container status \"b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a\": rpc error: code = NotFound desc = could not find container \"b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a\": container with ID starting with b7fc4dac6a4bae17033b061f970e5dc35ad3788bf37aca3a2a5e026589191c5a not found: ID does not exist"
Aug 05 19:44:26.905445 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.905415    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"]
Aug 05 19:44:26.908765 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.908744    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8dc955/test-model-8dc955-kserve-7c9c98dcd5-kmh9x"]
Aug 05 19:44:26.984035 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.983937    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tmp-dir\") pod \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") "
Aug 05 19:44:26.984035 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.983991    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4m6k\" (UniqueName: \"kubernetes.io/projected/f048ca64-c1a9-42e3-a10b-384df0e8f39e-kube-api-access-z4m6k\") pod \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") "
Aug 05 19:44:26.984035 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984020    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-model-cache\") pod \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") "
Aug 05 19:44:26.984370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984046    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-dshm\") pod \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") "
Aug 05 19:44:26.984370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984060    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-home\") pod \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") "
Aug 05 19:44:26.984370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984098    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tls-certs\") pod \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\" (UID: \"f048ca64-c1a9-42e3-a10b-384df0e8f39e\") "
Aug 05 19:44:26.984370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984276    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f048ca64-c1a9-42e3-a10b-384df0e8f39e" (UID: "f048ca64-c1a9-42e3-a10b-384df0e8f39e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:26.984370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984354    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-model-cache" (OuterVolumeSpecName: "model-cache") pod "f048ca64-c1a9-42e3-a10b-384df0e8f39e" (UID: "f048ca64-c1a9-42e3-a10b-384df0e8f39e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:26.984573 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984414    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:26.984573 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.984424    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-home" (OuterVolumeSpecName: "home") pod "f048ca64-c1a9-42e3-a10b-384df0e8f39e" (UID: "f048ca64-c1a9-42e3-a10b-384df0e8f39e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:26.986559 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.986536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f048ca64-c1a9-42e3-a10b-384df0e8f39e" (UID: "f048ca64-c1a9-42e3-a10b-384df0e8f39e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:44:26.986653 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.986610    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f048ca64-c1a9-42e3-a10b-384df0e8f39e-kube-api-access-z4m6k" (OuterVolumeSpecName: "kube-api-access-z4m6k") pod "f048ca64-c1a9-42e3-a10b-384df0e8f39e" (UID: "f048ca64-c1a9-42e3-a10b-384df0e8f39e"). InnerVolumeSpecName "kube-api-access-z4m6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:44:26.986653 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:26.986624    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-dshm" (OuterVolumeSpecName: "dshm") pod "f048ca64-c1a9-42e3-a10b-384df0e8f39e" (UID: "f048ca64-c1a9-42e3-a10b-384df0e8f39e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:44:27.084888 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:27.084849    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:27.084888 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:27.084879    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:27.084888 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:27.084887    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f048ca64-c1a9-42e3-a10b-384df0e8f39e-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:27.084888 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:27.084895    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f048ca64-c1a9-42e3-a10b-384df0e8f39e-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:27.085155 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:27.084905    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4m6k\" (UniqueName: \"kubernetes.io/projected/f048ca64-c1a9-42e3-a10b-384df0e8f39e-kube-api-access-z4m6k\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:27.201376 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:27.201343    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"]
Aug 05 19:44:27.205438 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:27.205411    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c87762/test-model-c87762-kserve-84f56875ff-kb28n"]
Aug 05 19:44:28.475757 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:28.475727    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e248219b-4933-47f3-823f-832b0ae72212" path="/var/lib/kubelet/pods/e248219b-4933-47f3-823f-832b0ae72212/volumes"
Aug 05 19:44:28.476140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:28.476095    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f048ca64-c1a9-42e3-a10b-384df0e8f39e" path="/var/lib/kubelet/pods/f048ca64-c1a9-42e3-a10b-384df0e8f39e/volumes"
Aug 05 19:44:28.655956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:28.655923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:28.759491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:28.759397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:28.901513 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:28.901484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:29.113578 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:29.113545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:37.728362 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:37.728317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:37.783453 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:37.783422    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:39.851460 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:39.851419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:39.889473 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:39.889440    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"]
Aug 05 19:44:39.889748 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:39.889719    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54" podUID="8485d773-3ef5-4f07-9105-362be09513dc" containerName="payload-pre-processing" containerID="cri-o://a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333" gracePeriod=30
Aug 05 19:44:39.916102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:39.916065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:39.982252 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:39.982212    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:40.042635 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.042600    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:40.144062 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.144034    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:44:40.187375 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.187344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbwt9\" (UniqueName: \"kubernetes.io/projected/8485d773-3ef5-4f07-9105-362be09513dc-kube-api-access-lbwt9\") pod \"8485d773-3ef5-4f07-9105-362be09513dc\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") "
Aug 05 19:44:40.187544 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.187406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8485d773-3ef5-4f07-9105-362be09513dc-plugins-config-volume\") pod \"8485d773-3ef5-4f07-9105-362be09513dc\" (UID: \"8485d773-3ef5-4f07-9105-362be09513dc\") "
Aug 05 19:44:40.187846 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.187818    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8485d773-3ef5-4f07-9105-362be09513dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8485d773-3ef5-4f07-9105-362be09513dc" (UID: "8485d773-3ef5-4f07-9105-362be09513dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:44:40.189728 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.189699    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8485d773-3ef5-4f07-9105-362be09513dc-kube-api-access-lbwt9" (OuterVolumeSpecName: "kube-api-access-lbwt9") pod "8485d773-3ef5-4f07-9105-362be09513dc" (UID: "8485d773-3ef5-4f07-9105-362be09513dc"). InnerVolumeSpecName "kube-api-access-lbwt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:44:40.288516 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.288474    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8485d773-3ef5-4f07-9105-362be09513dc-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:40.288516 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.288510    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbwt9\" (UniqueName: \"kubernetes.io/projected/8485d773-3ef5-4f07-9105-362be09513dc-kube-api-access-lbwt9\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:44:40.379620 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.379524    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:40.944253 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.944216    2558 generic.go:356] "Generic (PLEG): container finished" podID="8485d773-3ef5-4f07-9105-362be09513dc" containerID="a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333" exitCode=0
Aug 05 19:44:40.944721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.944258    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"
Aug 05 19:44:40.944721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.944279    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54" event={"ID":"8485d773-3ef5-4f07-9105-362be09513dc","Type":"ContainerDied","Data":"a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333"}
Aug 05 19:44:40.944721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.944329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54" event={"ID":"8485d773-3ef5-4f07-9105-362be09513dc","Type":"ContainerDied","Data":"f85aced222fa7ef086f1234a5083744c060b34ef1c5b6acab875b1e0c18247b8"}
Aug 05 19:44:40.944721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.944353    2558 scope.go:117] "RemoveContainer" containerID="a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333"
Aug 05 19:44:40.952882 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.952865    2558 scope.go:117] "RemoveContainer" containerID="a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333"
Aug 05 19:44:40.953205 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:44:40.953169    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333\": container with ID starting with a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333 not found: ID does not exist" containerID="a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333"
Aug 05 19:44:40.953305 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.953217    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333"} err="failed to get container status \"a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333\": rpc error: code = NotFound desc = could not find container \"a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333\": container with ID starting with a2b643453b91487c048a0cc0bf8a32226622ea15d4ab666ad1abdc1c531e2333 not found: ID does not exist"
Aug 05 19:44:40.959432 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.959406    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"]
Aug 05 19:44:40.963487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:40.963466    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c87762-846db97dd4-nll54"]
Aug 05 19:44:41.802803 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:41.802770    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:44:42.475852 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:42.475820    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8485d773-3ef5-4f07-9105-362be09513dc" path="/var/lib/kubelet/pods/8485d773-3ef5-4f07-9105-362be09513dc/volumes"
Aug 05 19:44:46.262851 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:46.262815    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:46.363552 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:46.363517    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:46.539555 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:46.539515    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:46.732151 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:46.732121    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:47.069241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:47.069151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:47.401484 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:47.401397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:47.522377 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:47.522346    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:50.162304 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:50.162265    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:50.253040 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:50.253010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:51.296239 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.296207    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:51.624155 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.624070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:51.786633 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.786598    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:51.882444 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.882348    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:44:51.905524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.905479    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"]
Aug 05 19:44:51.906121 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906097    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e248219b-4933-47f3-823f-832b0ae72212" containerName="main"
Aug 05 19:44:51.906121 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906121    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e248219b-4933-47f3-823f-832b0ae72212" containerName="main"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906148    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8485d773-3ef5-4f07-9105-362be09513dc" containerName="payload-pre-processing"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906156    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8485d773-3ef5-4f07-9105-362be09513dc" containerName="payload-pre-processing"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906193    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f048ca64-c1a9-42e3-a10b-384df0e8f39e" containerName="main"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906204    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f048ca64-c1a9-42e3-a10b-384df0e8f39e" containerName="main"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906230    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d03786-2740-409b-9ab4-dd921d7c8f49" containerName="payload-processing"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906238    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d03786-2740-409b-9ab4-dd921d7c8f49" containerName="payload-processing"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906251    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c3f183-ef6d-46ec-86c1-fa04a0be2876" containerName="payload-pre-processing"
Aug 05 19:44:51.906326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906259    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c3f183-ef6d-46ec-86c1-fa04a0be2876" containerName="payload-pre-processing"
Aug 05 19:44:51.906698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906427    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7c3f183-ef6d-46ec-86c1-fa04a0be2876" containerName="payload-pre-processing"
Aug 05 19:44:51.906698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906447    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f048ca64-c1a9-42e3-a10b-384df0e8f39e" containerName="main"
Aug 05 19:44:51.906698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906456    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d03786-2740-409b-9ab4-dd921d7c8f49" containerName="payload-processing"
Aug 05 19:44:51.906698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906465    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e248219b-4933-47f3-823f-832b0ae72212" containerName="main"
Aug 05 19:44:51.906698 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.906480    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8485d773-3ef5-4f07-9105-362be09513dc" containerName="payload-pre-processing"
Aug 05 19:44:51.909886 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.909862    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:51.913781 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.913756    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-94093f-dockercfg-tcg8h\""
Aug 05 19:44:51.913888 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.913799    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-94093f\""
Aug 05 19:44:51.918337 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.918281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"]
Aug 05 19:44:51.972439 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.972405    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"]
Aug 05 19:44:51.975538 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.975523    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:51.983555 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.983529    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"]
Aug 05 19:44:51.991636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.991601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35f6da50-6e47-4d15-bbff-69e1db963e59-plugins-config-volume\") pod \"payload-processing-e2e-api-a-94093f-794db9658b-qjnvx\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") " pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:51.991763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:51.991736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gp4d\" (UniqueName: \"kubernetes.io/projected/35f6da50-6e47-4d15-bbff-69e1db963e59-kube-api-access-8gp4d\") pod \"payload-processing-e2e-api-a-94093f-794db9658b-qjnvx\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") " pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:52.092978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.092936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76ms7\" (UniqueName: \"kubernetes.io/projected/acf78166-5313-4696-ad78-b18778170b22-kube-api-access-76ms7\") pod \"payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:52.093171 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.093002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gp4d\" (UniqueName: \"kubernetes.io/projected/35f6da50-6e47-4d15-bbff-69e1db963e59-kube-api-access-8gp4d\") pod \"payload-processing-e2e-api-a-94093f-794db9658b-qjnvx\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") " pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:52.093171 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.093028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf78166-5313-4696-ad78-b18778170b22-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:52.093171 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.093072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35f6da50-6e47-4d15-bbff-69e1db963e59-plugins-config-volume\") pod \"payload-processing-e2e-api-a-94093f-794db9658b-qjnvx\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") " pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:52.093812 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.093791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35f6da50-6e47-4d15-bbff-69e1db963e59-plugins-config-volume\") pod \"payload-processing-e2e-api-a-94093f-794db9658b-qjnvx\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") " pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:52.100693 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.100658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gp4d\" (UniqueName: \"kubernetes.io/projected/35f6da50-6e47-4d15-bbff-69e1db963e59-kube-api-access-8gp4d\") pod \"payload-processing-e2e-api-a-94093f-794db9658b-qjnvx\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") " pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:52.193670 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.193572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76ms7\" (UniqueName: \"kubernetes.io/projected/acf78166-5313-4696-ad78-b18778170b22-kube-api-access-76ms7\") pod \"payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:52.193670 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.193617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf78166-5313-4696-ad78-b18778170b22-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:52.194327 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.194308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf78166-5313-4696-ad78-b18778170b22-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:52.201749 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.201724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76ms7\" (UniqueName: \"kubernetes.io/projected/acf78166-5313-4696-ad78-b18778170b22-kube-api-access-76ms7\") pod \"payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:52.222614 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.222587    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:52.286572 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.286323    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:52.359985 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.359878    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"]
Aug 05 19:44:52.363034 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:44:52.363009    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f6da50_6e47_4d15_bbff_69e1db963e59.slice/crio-17ac1e353b684f0213df85b6b4cebe10b2ecbe6fa3be94cfe59d9879230f2ed2 WatchSource:0}: Error finding container 17ac1e353b684f0213df85b6b4cebe10b2ecbe6fa3be94cfe59d9879230f2ed2: Status 404 returned error can't find the container with id 17ac1e353b684f0213df85b6b4cebe10b2ecbe6fa3be94cfe59d9879230f2ed2
Aug 05 19:44:52.431655 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:52.431622    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"]
Aug 05 19:44:52.432928 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:44:52.432905    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf78166_5313_4696_ad78_b18778170b22.slice/crio-203ce2b44bca5a20e1ede85c1119d7091d60ae8c088da0fff1060a74f26f428a WatchSource:0}: Error finding container 203ce2b44bca5a20e1ede85c1119d7091d60ae8c088da0fff1060a74f26f428a: Status 404 returned error can't find the container with id 203ce2b44bca5a20e1ede85c1119d7091d60ae8c088da0fff1060a74f26f428a
Aug 05 19:44:53.001252 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.001217    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9" event={"ID":"acf78166-5313-4696-ad78-b18778170b22","Type":"ContainerStarted","Data":"0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35"}
Aug 05 19:44:53.001444 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.001272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9" event={"ID":"acf78166-5313-4696-ad78-b18778170b22","Type":"ContainerStarted","Data":"203ce2b44bca5a20e1ede85c1119d7091d60ae8c088da0fff1060a74f26f428a"}
Aug 05 19:44:53.001444 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.001391    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:44:53.002870 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.002843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx" event={"ID":"35f6da50-6e47-4d15-bbff-69e1db963e59","Type":"ContainerStarted","Data":"73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496"}
Aug 05 19:44:53.003007 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.002892    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx" event={"ID":"35f6da50-6e47-4d15-bbff-69e1db963e59","Type":"ContainerStarted","Data":"17ac1e353b684f0213df85b6b4cebe10b2ecbe6fa3be94cfe59d9879230f2ed2"}
Aug 05 19:44:53.003007 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.002955    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:44:53.018687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.018638    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9" podStartSLOduration=2.018621513 podStartE2EDuration="2.018621513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:44:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:44:53.017056486 +0000 UTC m=+2589.068544177" watchObservedRunningTime="2026-08-05 19:44:53.018621513 +0000 UTC m=+2589.070109205"
Aug 05 19:44:53.033981 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.033938    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx" podStartSLOduration=2.033923048 podStartE2EDuration="2.033923048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:44:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:44:53.032373167 +0000 UTC m=+2589.083860858" watchObservedRunningTime="2026-08-05 19:44:53.033923048 +0000 UTC m=+2589.085410736"
Aug 05 19:44:53.999600 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:44:53.999562    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:45:04.009119 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:04.009057    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9" podUID="acf78166-5313-4696-ad78-b18778170b22" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.50:9004: connect: connection refused"
Aug 05 19:45:04.009547 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:04.009516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:45:14.008426 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:14.008345    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:45:15.102053 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:15.102021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:15.562699 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:15.562667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:15.873438 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:15.873338    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:16.437740 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:16.437706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:18.410005 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:18.409964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:18.557253 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:18.557133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:19.434507 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:19.434443    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:19.860022 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:19.859986    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:19.960703 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:19.960647    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:20.063206 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.063150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:45:20.063831 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.063812    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"]
Aug 05 19:45:20.067544 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.067524    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.069798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.069774    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a47f42\""
Aug 05 19:45:20.069933 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.069784    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a47f42-dockercfg-qtr2m\""
Aug 05 19:45:20.075870 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.075843    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"]
Aug 05 19:45:20.235247 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.235155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e621f48b-2107-478b-8315-f8226224c771-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") " pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.235247 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.235220    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv7pr\" (UniqueName: \"kubernetes.io/projected/e621f48b-2107-478b-8315-f8226224c771-kube-api-access-tv7pr\") pod \"payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") " pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.335984 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.335943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e621f48b-2107-478b-8315-f8226224c771-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") " pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.336173 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.335988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv7pr\" (UniqueName: \"kubernetes.io/projected/e621f48b-2107-478b-8315-f8226224c771-kube-api-access-tv7pr\") pod \"payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") " pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.336683 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.336663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e621f48b-2107-478b-8315-f8226224c771-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") " pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.346640 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.346609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv7pr\" (UniqueName: \"kubernetes.io/projected/e621f48b-2107-478b-8315-f8226224c771-kube-api-access-tv7pr\") pod \"payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") " pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.380463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.380427    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:20.722412 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:20.722387    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"]
Aug 05 19:45:20.725125 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:45:20.725098    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode621f48b_2107_478b_8315_f8226224c771.slice/crio-f25f64bd035ccb9c45525eb9feb48ad2848fe354859762a6d5f531b5005a63c1 WatchSource:0}: Error finding container f25f64bd035ccb9c45525eb9feb48ad2848fe354859762a6d5f531b5005a63c1: Status 404 returned error can't find the container with id f25f64bd035ccb9c45525eb9feb48ad2848fe354859762a6d5f531b5005a63c1
Aug 05 19:45:21.130729 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:21.130694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9" event={"ID":"e621f48b-2107-478b-8315-f8226224c771","Type":"ContainerStarted","Data":"c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9"}
Aug 05 19:45:21.130960 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:21.130755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9" event={"ID":"e621f48b-2107-478b-8315-f8226224c771","Type":"ContainerStarted","Data":"f25f64bd035ccb9c45525eb9feb48ad2848fe354859762a6d5f531b5005a63c1"}
Aug 05 19:45:21.130960 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:21.130832    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:21.146463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:21.146399    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9" podStartSLOduration=1.146380978 podStartE2EDuration="1.146380978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:45:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:45:21.14437667 +0000 UTC m=+2617.195864361" watchObservedRunningTime="2026-08-05 19:45:21.146380978 +0000 UTC m=+2617.197868671"
Aug 05 19:45:21.802783 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:21.802741    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:45:32.138251 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:32.138210    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:45:43.239150 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:45:43.239111    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:01.580936 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.580899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:01.595762 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.595725    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"]
Aug 05 19:46:01.596017 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.595987    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx" podUID="35f6da50-6e47-4d15-bbff-69e1db963e59" containerName="payload-processing" containerID="cri-o://73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496" gracePeriod=30
Aug 05 19:46:01.604963 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.604924    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"]
Aug 05 19:46:01.605441 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.605407    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9" podUID="acf78166-5313-4696-ad78-b18778170b22" containerName="payload-pre-processing" containerID="cri-o://0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35" gracePeriod=30
Aug 05 19:46:01.853002 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.852965    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:46:01.882902 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.882874    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:46:01.984136 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.984104    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf78166-5313-4696-ad78-b18778170b22-plugins-config-volume\") pod \"acf78166-5313-4696-ad78-b18778170b22\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") "
Aug 05 19:46:01.984345 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.984227    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35f6da50-6e47-4d15-bbff-69e1db963e59-plugins-config-volume\") pod \"35f6da50-6e47-4d15-bbff-69e1db963e59\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") "
Aug 05 19:46:01.984345 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.984267    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gp4d\" (UniqueName: \"kubernetes.io/projected/35f6da50-6e47-4d15-bbff-69e1db963e59-kube-api-access-8gp4d\") pod \"35f6da50-6e47-4d15-bbff-69e1db963e59\" (UID: \"35f6da50-6e47-4d15-bbff-69e1db963e59\") "
Aug 05 19:46:01.984345 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.984293    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76ms7\" (UniqueName: \"kubernetes.io/projected/acf78166-5313-4696-ad78-b18778170b22-kube-api-access-76ms7\") pod \"acf78166-5313-4696-ad78-b18778170b22\" (UID: \"acf78166-5313-4696-ad78-b18778170b22\") "
Aug 05 19:46:01.984590 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.984562    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf78166-5313-4696-ad78-b18778170b22-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "acf78166-5313-4696-ad78-b18778170b22" (UID: "acf78166-5313-4696-ad78-b18778170b22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:46:01.984680 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.984650    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35f6da50-6e47-4d15-bbff-69e1db963e59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "35f6da50-6e47-4d15-bbff-69e1db963e59" (UID: "35f6da50-6e47-4d15-bbff-69e1db963e59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:46:01.986573 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.986552    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf78166-5313-4696-ad78-b18778170b22-kube-api-access-76ms7" (OuterVolumeSpecName: "kube-api-access-76ms7") pod "acf78166-5313-4696-ad78-b18778170b22" (UID: "acf78166-5313-4696-ad78-b18778170b22"). InnerVolumeSpecName "kube-api-access-76ms7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:46:01.986637 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:01.986603    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f6da50-6e47-4d15-bbff-69e1db963e59-kube-api-access-8gp4d" (OuterVolumeSpecName: "kube-api-access-8gp4d") pod "35f6da50-6e47-4d15-bbff-69e1db963e59" (UID: "35f6da50-6e47-4d15-bbff-69e1db963e59"). InnerVolumeSpecName "kube-api-access-8gp4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:46:02.085557 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.085466    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gp4d\" (UniqueName: \"kubernetes.io/projected/35f6da50-6e47-4d15-bbff-69e1db963e59-kube-api-access-8gp4d\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:46:02.085557 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.085496    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76ms7\" (UniqueName: \"kubernetes.io/projected/acf78166-5313-4696-ad78-b18778170b22-kube-api-access-76ms7\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:46:02.085557 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.085509    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf78166-5313-4696-ad78-b18778170b22-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:46:02.085557 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.085519    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35f6da50-6e47-4d15-bbff-69e1db963e59-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:46:02.319738 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.319701    2558 generic.go:356] "Generic (PLEG): container finished" podID="acf78166-5313-4696-ad78-b18778170b22" containerID="0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35" exitCode=0
Aug 05 19:46:02.319922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.319765    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"
Aug 05 19:46:02.319922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.319794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9" event={"ID":"acf78166-5313-4696-ad78-b18778170b22","Type":"ContainerDied","Data":"0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35"}
Aug 05 19:46:02.319922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.319845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9" event={"ID":"acf78166-5313-4696-ad78-b18778170b22","Type":"ContainerDied","Data":"203ce2b44bca5a20e1ede85c1119d7091d60ae8c088da0fff1060a74f26f428a"}
Aug 05 19:46:02.319922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.319868    2558 scope.go:117] "RemoveContainer" containerID="0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35"
Aug 05 19:46:02.321145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.321122    2558 generic.go:356] "Generic (PLEG): container finished" podID="35f6da50-6e47-4d15-bbff-69e1db963e59" containerID="73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496" exitCode=0
Aug 05 19:46:02.321266 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.321150    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx" event={"ID":"35f6da50-6e47-4d15-bbff-69e1db963e59","Type":"ContainerDied","Data":"73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496"}
Aug 05 19:46:02.321266 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.321175    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"
Aug 05 19:46:02.321266 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.321210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx" event={"ID":"35f6da50-6e47-4d15-bbff-69e1db963e59","Type":"ContainerDied","Data":"17ac1e353b684f0213df85b6b4cebe10b2ecbe6fa3be94cfe59d9879230f2ed2"}
Aug 05 19:46:02.328564 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.328546    2558 scope.go:117] "RemoveContainer" containerID="0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35"
Aug 05 19:46:02.328859 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:46:02.328835    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35\": container with ID starting with 0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35 not found: ID does not exist" containerID="0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35"
Aug 05 19:46:02.328938 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.328871    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35"} err="failed to get container status \"0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35\": rpc error: code = NotFound desc = could not find container \"0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35\": container with ID starting with 0078a196f8a1066a7c1dcb16306226c55cf1db90f42def3d4b0d92d2a29b3b35 not found: ID does not exist"
Aug 05 19:46:02.328938 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.328894    2558 scope.go:117] "RemoveContainer" containerID="73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496"
Aug 05 19:46:02.337262 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.337242    2558 scope.go:117] "RemoveContainer" containerID="73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496"
Aug 05 19:46:02.337561 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:46:02.337537    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496\": container with ID starting with 73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496 not found: ID does not exist" containerID="73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496"
Aug 05 19:46:02.337659 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.337563    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496"} err="failed to get container status \"73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496\": rpc error: code = NotFound desc = could not find container \"73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496\": container with ID starting with 73bc688c8de463a9f0421e4ca3cc68dbc27085f9f16e304e4d37cae6a7ee1496 not found: ID does not exist"
Aug 05 19:46:02.345147 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.345114    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"]
Aug 05 19:46:02.351384 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.351360    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-94093f-794db9658b-qjnvx"]
Aug 05 19:46:02.360554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.360524    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"]
Aug 05 19:46:02.364148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.364119    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-94093f-57798c5bfb-lwtm9"]
Aug 05 19:46:02.480803 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.480769    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35f6da50-6e47-4d15-bbff-69e1db963e59" path="/var/lib/kubelet/pods/35f6da50-6e47-4d15-bbff-69e1db963e59/volumes"
Aug 05 19:46:02.481138 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.481125    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf78166-5313-4696-ad78-b18778170b22" path="/var/lib/kubelet/pods/acf78166-5313-4696-ad78-b18778170b22/volumes"
Aug 05 19:46:02.741444 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:02.741407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:04.392402 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:04.392363    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:46:07.766505 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:07.766462    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:07.828683 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:07.828656    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:08.013027 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:08.012998    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:08.227130 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:08.227096    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:23.786752 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:23.786704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:23.815143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:23.815113    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"]
Aug 05 19:46:23.815396 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:23.815345    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9" podUID="e621f48b-2107-478b-8315-f8226224c771" containerName="payload-processing" containerID="cri-o://c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9" gracePeriod=30
Aug 05 19:46:23.886968 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:23.886912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:23.967107 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:23.967066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:24.069021 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.068984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:24.071636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.071609    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:46:24.188110 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.188076    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv7pr\" (UniqueName: \"kubernetes.io/projected/e621f48b-2107-478b-8315-f8226224c771-kube-api-access-tv7pr\") pod \"e621f48b-2107-478b-8315-f8226224c771\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") "
Aug 05 19:46:24.188282 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.188223    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e621f48b-2107-478b-8315-f8226224c771-plugins-config-volume\") pod \"e621f48b-2107-478b-8315-f8226224c771\" (UID: \"e621f48b-2107-478b-8315-f8226224c771\") "
Aug 05 19:46:24.188585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.188558    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e621f48b-2107-478b-8315-f8226224c771-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e621f48b-2107-478b-8315-f8226224c771" (UID: "e621f48b-2107-478b-8315-f8226224c771"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:46:24.190363 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.190337    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e621f48b-2107-478b-8315-f8226224c771-kube-api-access-tv7pr" (OuterVolumeSpecName: "kube-api-access-tv7pr") pod "e621f48b-2107-478b-8315-f8226224c771" (UID: "e621f48b-2107-478b-8315-f8226224c771"). InnerVolumeSpecName "kube-api-access-tv7pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:46:24.289140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.289109    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e621f48b-2107-478b-8315-f8226224c771-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:46:24.289140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.289133    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv7pr\" (UniqueName: \"kubernetes.io/projected/e621f48b-2107-478b-8315-f8226224c771-kube-api-access-tv7pr\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:46:24.347843 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.347766    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:24.427156 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.427119    2558 generic.go:356] "Generic (PLEG): container finished" podID="e621f48b-2107-478b-8315-f8226224c771" containerID="c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9" exitCode=0
Aug 05 19:46:24.427315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.427166    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"
Aug 05 19:46:24.427315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.427208    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9" event={"ID":"e621f48b-2107-478b-8315-f8226224c771","Type":"ContainerDied","Data":"c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9"}
Aug 05 19:46:24.427315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.427278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9" event={"ID":"e621f48b-2107-478b-8315-f8226224c771","Type":"ContainerDied","Data":"f25f64bd035ccb9c45525eb9feb48ad2848fe354859762a6d5f531b5005a63c1"}
Aug 05 19:46:24.427315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.427302    2558 scope.go:117] "RemoveContainer" containerID="c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9"
Aug 05 19:46:24.435891 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.435875    2558 scope.go:117] "RemoveContainer" containerID="c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9"
Aug 05 19:46:24.436167 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:46:24.436144    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9\": container with ID starting with c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9 not found: ID does not exist" containerID="c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9"
Aug 05 19:46:24.436279 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.436174    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9"} err="failed to get container status \"c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9\": rpc error: code = NotFound desc = could not find container \"c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9\": container with ID starting with c00f8c5334cae2a356da1343392eaebf7609b6719ae0a301db49932b83677db9 not found: ID does not exist"
Aug 05 19:46:24.448217 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.448167    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"]
Aug 05 19:46:24.452131 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.452113    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a47f42-86648dd986-wwnz9"]
Aug 05 19:46:24.475964 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:24.475938    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e621f48b-2107-478b-8315-f8226224c771" path="/var/lib/kubelet/pods/e621f48b-2107-478b-8315-f8226224c771/volumes"
Aug 05 19:46:25.998744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:25.998701    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:46:30.230834 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:30.230797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:30.297107 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:30.297073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:30.512473 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:30.512395    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:30.705468 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:30.705426    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:31.023662 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:31.023629    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:31.311005 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:31.310931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:31.822713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:31.822665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:33.751148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:33.751070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:33.846592 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:33.846549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:34.889268 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:34.889225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:34.989753 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:34.989659    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:35.378306 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.378255    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:35.470561 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470526    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"]
Aug 05 19:46:35.470857 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470844    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e621f48b-2107-478b-8315-f8226224c771" containerName="payload-processing"
Aug 05 19:46:35.470907 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470870    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e621f48b-2107-478b-8315-f8226224c771" containerName="payload-processing"
Aug 05 19:46:35.470907 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470886    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf78166-5313-4696-ad78-b18778170b22" containerName="payload-pre-processing"
Aug 05 19:46:35.470907 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470892    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf78166-5313-4696-ad78-b18778170b22" containerName="payload-pre-processing"
Aug 05 19:46:35.470907 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470899    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35f6da50-6e47-4d15-bbff-69e1db963e59" containerName="payload-processing"
Aug 05 19:46:35.470907 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470904    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="35f6da50-6e47-4d15-bbff-69e1db963e59" containerName="payload-processing"
Aug 05 19:46:35.471061 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470959    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e621f48b-2107-478b-8315-f8226224c771" containerName="payload-processing"
Aug 05 19:46:35.471061 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470968    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="35f6da50-6e47-4d15-bbff-69e1db963e59" containerName="payload-processing"
Aug 05 19:46:35.471061 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.470975    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf78166-5313-4696-ad78-b18778170b22" containerName="payload-pre-processing"
Aug 05 19:46:35.475596 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.475574    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.477840 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.477814    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-6a2d7d\""
Aug 05 19:46:35.487454 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.487430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"]
Aug 05 19:46:35.508920 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.508892    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"]
Aug 05 19:46:35.511155 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.511136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:35.511847 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.511831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.514877 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.514856    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-6a2d7d-dockercfg-p9brj\""
Aug 05 19:46:35.521691 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.521671    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"]
Aug 05 19:46:35.576851 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.576810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.576851 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.576849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf3cbde-16f8-4caf-914f-db735502259f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.577101 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.576913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576bm\" (UniqueName: \"kubernetes.io/projected/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-kube-api-access-576bm\") pod \"payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.577101 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.577002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zpxm\" (UniqueName: \"kubernetes.io/projected/ddf3cbde-16f8-4caf-914f-db735502259f-kube-api-access-5zpxm\") pod \"payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.677753 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.677667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zpxm\" (UniqueName: \"kubernetes.io/projected/ddf3cbde-16f8-4caf-914f-db735502259f-kube-api-access-5zpxm\") pod \"payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.677753 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.677710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.677753 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.677731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf3cbde-16f8-4caf-914f-db735502259f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.678062 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.677760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-576bm\" (UniqueName: \"kubernetes.io/projected/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-kube-api-access-576bm\") pod \"payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.678481 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.678455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.678583 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.678500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf3cbde-16f8-4caf-914f-db735502259f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.686505 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.686476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zpxm\" (UniqueName: \"kubernetes.io/projected/ddf3cbde-16f8-4caf-914f-db735502259f-kube-api-access-5zpxm\") pod \"payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.686622 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.686557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-576bm\" (UniqueName: \"kubernetes.io/projected/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-kube-api-access-576bm\") pod \"payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.785642 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.785607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:35.822218 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.822160    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:35.931790 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.931758    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"]
Aug 05 19:46:35.934942 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:46:35.934908    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d49d700_6028_46d4_ad5d_4be2d50a6b9b.slice/crio-0b18cc0d6c376490ef126a02365a2d232b0f6f3abf39856681d158b06216e532 WatchSource:0}: Error finding container 0b18cc0d6c376490ef126a02365a2d232b0f6f3abf39856681d158b06216e532: Status 404 returned error can't find the container with id 0b18cc0d6c376490ef126a02365a2d232b0f6f3abf39856681d158b06216e532
Aug 05 19:46:35.977173 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:35.977146    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"]
Aug 05 19:46:36.482913 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.482878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m" event={"ID":"1d49d700-6028-46d4-ad5d-4be2d50a6b9b","Type":"ContainerStarted","Data":"411ff8a687480c599d9a02981d6e4ca5a0632dfca936102256ed1fd5c1ba88e2"}
Aug 05 19:46:36.483131 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.482939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m" event={"ID":"1d49d700-6028-46d4-ad5d-4be2d50a6b9b","Type":"ContainerStarted","Data":"0b18cc0d6c376490ef126a02365a2d232b0f6f3abf39856681d158b06216e532"}
Aug 05 19:46:36.483131 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.482969    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:36.484437 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.484414    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh" event={"ID":"ddf3cbde-16f8-4caf-914f-db735502259f","Type":"ContainerStarted","Data":"c45aab47faff78089ce3f9e76de20ef34667a5ccdb8b3acf914adefc87c43b92"}
Aug 05 19:46:36.484567 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.484451    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh" event={"ID":"ddf3cbde-16f8-4caf-914f-db735502259f","Type":"ContainerStarted","Data":"81dba8877eff6563cd736828273af853eba9755602b2de18e8033fc2c8fdfb83"}
Aug 05 19:46:36.484567 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.484548    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:36.498468 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.498420    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m" podStartSLOduration=1.4984057339999999 podStartE2EDuration="1.498405734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:46:36.497137702 +0000 UTC m=+2692.548625395" watchObservedRunningTime="2026-08-05 19:46:36.498405734 +0000 UTC m=+2692.549893427"
Aug 05 19:46:36.514235 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:36.514167    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh" podStartSLOduration=1.5141518779999998 podStartE2EDuration="1.514151878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:46:36.512367004 +0000 UTC m=+2692.563854708" watchObservedRunningTime="2026-08-05 19:46:36.514151878 +0000 UTC m=+2692.565639571"
Aug 05 19:46:37.406148 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:37.406116    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:46:47.491362 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:47.491328    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 19:46:47.491797 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:47.491706    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 19:46:58.690609 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:58.690576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:59.073490 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:59.073456    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:59.322785 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:59.322749    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:46:59.550582 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:46:59.550546    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:01.921307 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:01.921260    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:02.011099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:02.011061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:03.150797 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.150761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:03.352648 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.352616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:03.613545 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.613509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:03.713622 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.713589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:03.737074 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.737049    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"]
Aug 05 19:47:03.740258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.740241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:03.742454 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.742433    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-1df35a-dockercfg-twdjp\""
Aug 05 19:47:03.742538 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.742477    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-1df35a\""
Aug 05 19:47:03.750798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.750775    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"]
Aug 05 19:47:03.817866 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.817836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:03.818012 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.817876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4hpl\" (UniqueName: \"kubernetes.io/projected/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-kube-api-access-n4hpl\") pod \"payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:03.919283 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.919163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:03.919283 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.919231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4hpl\" (UniqueName: \"kubernetes.io/projected/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-kube-api-access-n4hpl\") pod \"payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:03.919922 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.919902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:03.928088 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:03.928065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4hpl\" (UniqueName: \"kubernetes.io/projected/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-kube-api-access-n4hpl\") pod \"payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:04.053131 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:04.053091    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:04.184380 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:04.184298    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"]
Aug 05 19:47:04.187381 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:47:04.187352    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd85ca27_bab3_4fae_b19e_99e068b8e8c7.slice/crio-0ceb4791267e81dc9a841c838c7a73ca4937fb48bcd8987ea4e82747c28f83f1 WatchSource:0}: Error finding container 0ceb4791267e81dc9a841c838c7a73ca4937fb48bcd8987ea4e82747c28f83f1: Status 404 returned error can't find the container with id 0ceb4791267e81dc9a841c838c7a73ca4937fb48bcd8987ea4e82747c28f83f1
Aug 05 19:47:04.620642 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:04.620603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn" event={"ID":"dd85ca27-bab3-4fae-b19e-99e068b8e8c7","Type":"ContainerStarted","Data":"a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091"}
Aug 05 19:47:04.620889 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:04.620658    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn" event={"ID":"dd85ca27-bab3-4fae-b19e-99e068b8e8c7","Type":"ContainerStarted","Data":"0ceb4791267e81dc9a841c838c7a73ca4937fb48bcd8987ea4e82747c28f83f1"}
Aug 05 19:47:04.620889 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:04.620685    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:04.634954 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:04.634898    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn" podStartSLOduration=1.634880231 podStartE2EDuration="1.634880231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:47:04.634600892 +0000 UTC m=+2720.686088589" watchObservedRunningTime="2026-08-05 19:47:04.634880231 +0000 UTC m=+2720.686367938"
Aug 05 19:47:05.894964 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:05.894928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:47:15.627324 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:15.627292    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 19:47:26.846915 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:26.846872    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:38.884100 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.884069    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"]
Aug 05 19:47:38.887593 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.887576    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:38.890665 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.890637    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"kube-root-ca.crt\""
Aug 05 19:47:38.890798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.890695    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"openshift-service-ca.crt\""
Aug 05 19:47:38.890798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.890697    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"default-dockercfg-khw9g\""
Aug 05 19:47:38.890798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.890697    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"auth-test-model-6a2d7d-kserve-self-signed-certs\""
Aug 05 19:47:38.896662 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.896642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"]
Aug 05 19:47:38.910006 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.909976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tmp-dir\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:38.910127 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.910016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-dshm\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:38.910127 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.910072    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-model-cache\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:38.910127 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.910098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tls-certs\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:38.910319 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.910127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-home\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:38.910319 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.910158    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46zc\" (UniqueName: \"kubernetes.io/projected/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-kube-api-access-f46zc\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:38.979427 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:38.979394    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:47:39.010999 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.010965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tmp-dir\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-dshm\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-model-cache\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tls-certs\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011090    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-home\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f46zc\" (UniqueName: \"kubernetes.io/projected/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-kube-api-access-f46zc\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011507 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tmp-dir\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011556 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-model-cache\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.011631 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.011610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-home\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.013483 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.013468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-dshm\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.013736 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.013719    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tls-certs\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.019268 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.019247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46zc\" (UniqueName: \"kubernetes.io/projected/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-kube-api-access-f46zc\") pod \"auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") " pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.197443 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.197351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:39.337033 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.336977    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"]
Aug 05 19:47:39.339480 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:47:39.339446    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5bc47b0_8b2a_457c_a6a6_464649ebfe71.slice/crio-5bbed4f381683fba336250add228d4cd2d7f06bd7af3eac3dd6f6270c250bff2 WatchSource:0}: Error finding container 5bbed4f381683fba336250add228d4cd2d7f06bd7af3eac3dd6f6270c250bff2: Status 404 returned error can't find the container with id 5bbed4f381683fba336250add228d4cd2d7f06bd7af3eac3dd6f6270c250bff2
Aug 05 19:47:39.786542 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.786502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp" event={"ID":"f5bc47b0-8b2a-457c-a6a6-464649ebfe71","Type":"ContainerStarted","Data":"8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa"}
Aug 05 19:47:39.786542 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.786546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp" event={"ID":"f5bc47b0-8b2a-457c-a6a6-464649ebfe71","Type":"ContainerStarted","Data":"5bbed4f381683fba336250add228d4cd2d7f06bd7af3eac3dd6f6270c250bff2"}
Aug 05 19:47:39.804952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:39.804895    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp" podStartSLOduration=1.804880424 podStartE2EDuration="1.804880424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:47:39.80281495 +0000 UTC m=+2755.854302643" watchObservedRunningTime="2026-08-05 19:47:39.804880424 +0000 UTC m=+2755.856368169"
Aug 05 19:47:41.492587 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:41.492553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:47:49.197520 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:49.197475    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:49.199858 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:49.197541    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:49.210317 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:49.210293    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:47:49.846221 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:47:49.846175    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:48:01.985326 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:01.985289    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"]
Aug 05 19:48:01.988611 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:01.988591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:01.991581 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:01.991558    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"kube-root-ca.crt\""
Aug 05 19:48:01.991725 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:01.991605    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"default-dockercfg-46nwm\""
Aug 05 19:48:01.991725 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:01.991606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"auth-test-model-1df35a-kserve-self-signed-certs\""
Aug 05 19:48:01.991725 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:01.991665    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"openshift-service-ca.crt\""
Aug 05 19:48:01.998722 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:01.998698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"]
Aug 05 19:48:02.084536 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.084504    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:48:02.112792 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.112759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-model-cache\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.112792 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.112792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tls-certs\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.113002 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.112817    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-home\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.113002 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.112836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tmp-dir\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.113002 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.112966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbmh5\" (UniqueName: \"kubernetes.io/projected/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-kube-api-access-vbmh5\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.113138 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.113011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-dshm\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.213854 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.213819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbmh5\" (UniqueName: \"kubernetes.io/projected/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-kube-api-access-vbmh5\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214067 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.213869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-dshm\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214067 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.214000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-model-cache\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214067 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.214038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tls-certs\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214067 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.214064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-home\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.214082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tmp-dir\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214458 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.214434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-model-cache\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214523 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.214473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tmp-dir\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.214523 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.214496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-home\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.216301 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.216278    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-dshm\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.216616 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.216600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tls-certs\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.221929 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.221905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbmh5\" (UniqueName: \"kubernetes.io/projected/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-kube-api-access-vbmh5\") pod \"auth-test-model-1df35a-kserve-7947fc6c5-r5gb4\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") " pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.298545 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.298515    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:02.437843 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.437818    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"]
Aug 05 19:48:02.440438 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:48:02.440410    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5133c3ee_2aa3_4484_a2ca_7c488ad3a5bb.slice/crio-5873eb7a9ac796f1f3ffbe507cbd1d90a7d88ec1b0f7a7c623a98c151a9df1fa WatchSource:0}: Error finding container 5873eb7a9ac796f1f3ffbe507cbd1d90a7d88ec1b0f7a7c623a98c151a9df1fa: Status 404 returned error can't find the container with id 5873eb7a9ac796f1f3ffbe507cbd1d90a7d88ec1b0f7a7c623a98c151a9df1fa
Aug 05 19:48:02.896263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.896224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4" event={"ID":"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb","Type":"ContainerStarted","Data":"4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69"}
Aug 05 19:48:02.896449 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.896274    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4" event={"ID":"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb","Type":"ContainerStarted","Data":"5873eb7a9ac796f1f3ffbe507cbd1d90a7d88ec1b0f7a7c623a98c151a9df1fa"}
Aug 05 19:48:02.912344 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:02.912290    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4" podStartSLOduration=1.912274035 podStartE2EDuration="1.912274035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:48:02.911496364 +0000 UTC m=+2778.962984057" watchObservedRunningTime="2026-08-05 19:48:02.912274035 +0000 UTC m=+2778.963761726"
Aug 05 19:48:04.602728 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:04.602690    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:48:12.299403 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:12.299370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:12.299403 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:12.299410    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:12.312301 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:12.312272    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:12.954194 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:12.954151    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:48:18.062550 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:18.062508    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:48:27.205238 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:27.205197    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:48:42.600839 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:42.600800    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:48:53.216227 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:48:53.216193    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:49:08.993539 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:08.993497    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:49:16.148951 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:16.148910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:49:34.796550 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:34.796513    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:49:37.812823 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:37.812779    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:49:44.695153 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:44.695121    2558 scope.go:117] "RemoveContainer" containerID="6962e1b68210e4a61ac446458ecb94d3a31ea9ffac6dc1841ab7d90f1c841bb9"
Aug 05 19:49:45.394878 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:45.394834    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:49:48.872581 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:48.872545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:49:48.971060 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:49:48.971021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:50:01.102372 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:50:01.102335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:50:17.093759 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:50:17.093718    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:50:27.809454 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:50:27.809414    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:50:42.993558 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:50:42.993522    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:50:53.618122 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:50:53.618076    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:51:09.195467 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:51:09.195383    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:51:24.402839 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:51:24.402800    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:51:35.802864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:51:35.802821    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:51:50.797938 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:51:50.797902    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:51:54.465472 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:51:54.465397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:52:04.313872 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:04.313838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:52:08.187883 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:08.187848    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"]
Aug 05 19:52:08.205902 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:08.205875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:52:09.071829 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:09.071791    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"]
Aug 05 19:52:09.091410 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:09.091377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:52:14.217953 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:14.217917    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:52:19.619403 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:19.619369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:52:21.997987 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:21.997952    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:52:23.207383 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.207345    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp" podUID="f5bc47b0-8b2a-457c-a6a6-464649ebfe71" containerName="main" containerID="cri-o://8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa" gracePeriod=45
Aug 05 19:52:23.457610 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.457543    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:52:23.565688 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.565649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tmp-dir\") pod \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") "
Aug 05 19:52:23.565688 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.565691    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tls-certs\") pod \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") "
Aug 05 19:52:23.565942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.565737    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-dshm\") pod \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") "
Aug 05 19:52:23.565942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.565770    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f46zc\" (UniqueName: \"kubernetes.io/projected/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-kube-api-access-f46zc\") pod \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") "
Aug 05 19:52:23.565942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.565844    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-home\") pod \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") "
Aug 05 19:52:23.565942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.565895    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-model-cache\") pod \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\" (UID: \"f5bc47b0-8b2a-457c-a6a6-464649ebfe71\") "
Aug 05 19:52:23.565942 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.565920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f5bc47b0-8b2a-457c-a6a6-464649ebfe71" (UID: "f5bc47b0-8b2a-457c-a6a6-464649ebfe71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:23.566235 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.566106    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-home" (OuterVolumeSpecName: "home") pod "f5bc47b0-8b2a-457c-a6a6-464649ebfe71" (UID: "f5bc47b0-8b2a-457c-a6a6-464649ebfe71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:23.566235 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.566203    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-model-cache" (OuterVolumeSpecName: "model-cache") pod "f5bc47b0-8b2a-457c-a6a6-464649ebfe71" (UID: "f5bc47b0-8b2a-457c-a6a6-464649ebfe71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:23.566235 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.566229    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:23.566412 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.566244    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:23.568138 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.568112    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-dshm" (OuterVolumeSpecName: "dshm") pod "f5bc47b0-8b2a-457c-a6a6-464649ebfe71" (UID: "f5bc47b0-8b2a-457c-a6a6-464649ebfe71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:23.568269 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.568164    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f5bc47b0-8b2a-457c-a6a6-464649ebfe71" (UID: "f5bc47b0-8b2a-457c-a6a6-464649ebfe71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:52:23.568269 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.568173    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-kube-api-access-f46zc" (OuterVolumeSpecName: "kube-api-access-f46zc") pod "f5bc47b0-8b2a-457c-a6a6-464649ebfe71" (UID: "f5bc47b0-8b2a-457c-a6a6-464649ebfe71"). InnerVolumeSpecName "kube-api-access-f46zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:52:23.667391 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.667356    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:23.667391 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.667383    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:23.667391 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.667392    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f46zc\" (UniqueName: \"kubernetes.io/projected/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-kube-api-access-f46zc\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:23.667624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:23.667405    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bc47b0-8b2a-457c-a6a6-464649ebfe71-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:24.091393 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.091348    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4" podUID="5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" containerName="main" containerID="cri-o://4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69" gracePeriod=45
Aug 05 19:52:24.120116 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.120088    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5bc47b0-8b2a-457c-a6a6-464649ebfe71" containerID="8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa" exitCode=0
Aug 05 19:52:24.120298 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.120137    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"
Aug 05 19:52:24.120298 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.120141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp" event={"ID":"f5bc47b0-8b2a-457c-a6a6-464649ebfe71","Type":"ContainerDied","Data":"8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa"}
Aug 05 19:52:24.120298 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.120221    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp" event={"ID":"f5bc47b0-8b2a-457c-a6a6-464649ebfe71","Type":"ContainerDied","Data":"5bbed4f381683fba336250add228d4cd2d7f06bd7af3eac3dd6f6270c250bff2"}
Aug 05 19:52:24.120298 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.120238    2558 scope.go:117] "RemoveContainer" containerID="8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa"
Aug 05 19:52:24.164561 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.164529    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"]
Aug 05 19:52:24.168232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.168212    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/auth-test-model-6a2d7d-kserve-586ff68d79-8xzzp"]
Aug 05 19:52:24.203087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.203064    2558 scope.go:117] "RemoveContainer" containerID="8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa"
Aug 05 19:52:24.203503 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:52:24.203479    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa\": container with ID starting with 8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa not found: ID does not exist" containerID="8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa"
Aug 05 19:52:24.203600 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.203509    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa"} err="failed to get container status \"8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa\": rpc error: code = NotFound desc = could not find container \"8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa\": container with ID starting with 8138216846c226980252f1581d2feea8cd1bd1cc8fb116fceedf95368e6417aa not found: ID does not exist"
Aug 05 19:52:24.339672 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.339640    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:52:24.474669 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474589    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tmp-dir\") pod \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") "
Aug 05 19:52:24.474669 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-dshm\") pod \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") "
Aug 05 19:52:24.474895 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474679    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-home\") pod \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") "
Aug 05 19:52:24.474895 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbmh5\" (UniqueName: \"kubernetes.io/projected/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-kube-api-access-vbmh5\") pod \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") "
Aug 05 19:52:24.474895 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474755    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tls-certs\") pod \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") "
Aug 05 19:52:24.474895 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474811    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-model-cache\") pod \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\" (UID: \"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb\") "
Aug 05 19:52:24.475117 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474912    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-home" (OuterVolumeSpecName: "home") pod "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" (UID: "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:24.475117 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.475093    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" (UID: "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:24.475232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.474900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" (UID: "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:24.475232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.475146    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:24.476421 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.476395    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5bc47b0-8b2a-457c-a6a6-464649ebfe71" path="/var/lib/kubelet/pods/f5bc47b0-8b2a-457c-a6a6-464649ebfe71/volumes"
Aug 05 19:52:24.477096 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.477066    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" (UID: "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:52:24.477232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.477117    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-kube-api-access-vbmh5" (OuterVolumeSpecName: "kube-api-access-vbmh5") pod "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" (UID: "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb"). InnerVolumeSpecName "kube-api-access-vbmh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:52:24.477232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.477204    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-dshm" (OuterVolumeSpecName: "dshm") pod "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" (UID: "5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:52:24.576196 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.576159    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:24.576196 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.576200    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:24.576401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.576209    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:24.576401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.576217    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbmh5\" (UniqueName: \"kubernetes.io/projected/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-kube-api-access-vbmh5\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:24.576401 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:24.576227    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:52:25.125473 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.125431    2558 generic.go:356] "Generic (PLEG): container finished" podID="5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" containerID="4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69" exitCode=0
Aug 05 19:52:25.125763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.125471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4" event={"ID":"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb","Type":"ContainerDied","Data":"4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69"}
Aug 05 19:52:25.125763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.125521    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4" event={"ID":"5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb","Type":"ContainerDied","Data":"5873eb7a9ac796f1f3ffbe507cbd1d90a7d88ec1b0f7a7c623a98c151a9df1fa"}
Aug 05 19:52:25.125763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.125544    2558 scope.go:117] "RemoveContainer" containerID="4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69"
Aug 05 19:52:25.125763 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.125480    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"
Aug 05 19:52:25.140481 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.140463    2558 scope.go:117] "RemoveContainer" containerID="4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69"
Aug 05 19:52:25.140712 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:52:25.140693    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69\": container with ID starting with 4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69 not found: ID does not exist" containerID="4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69"
Aug 05 19:52:25.140760 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.140719    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69"} err="failed to get container status \"4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69\": rpc error: code = NotFound desc = could not find container \"4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69\": container with ID starting with 4b0677c04b31db6dd2dff24497734e6640c67b8bf51942bb52d5ada21b97ba69 not found: ID does not exist"
Aug 05 19:52:25.151063 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.151039    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"]
Aug 05 19:52:25.153697 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:25.153675    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/auth-test-model-1df35a-kserve-7947fc6c5-r5gb4"]
Aug 05 19:52:26.475295 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:26.475262    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" path="/var/lib/kubelet/pods/5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb/volumes"
Aug 05 19:52:39.878255 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.877967    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"]
Aug 05 19:52:39.879118 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.879094    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5bc47b0-8b2a-457c-a6a6-464649ebfe71" containerName="main"
Aug 05 19:52:39.879361 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.879335    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5bc47b0-8b2a-457c-a6a6-464649ebfe71" containerName="main"
Aug 05 19:52:39.879559 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.879539    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" containerName="main"
Aug 05 19:52:39.879689 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.879562    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" containerName="main"
Aug 05 19:52:39.879773 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.879755    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5133c3ee-2aa3-4484-a2ca-7c488ad3a5bb" containerName="main"
Aug 05 19:52:39.879849 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.879775    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5bc47b0-8b2a-457c-a6a6-464649ebfe71" containerName="main"
Aug 05 19:52:39.885406 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.885383    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:39.889054 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.889003    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"openshift-service-ca.crt\""
Aug 05 19:52:39.889054 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.889044    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"kube-root-ca.crt\""
Aug 05 19:52:39.889397 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.889378    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"default-dockercfg-46nwm\""
Aug 05 19:52:39.889748 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.889732    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"sub-test-model-1df35a-kserve-self-signed-certs\""
Aug 05 19:52:39.894964 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.894945    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"]
Aug 05 19:52:39.907527 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:39.907499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:52:40.002521 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.002485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szff5\" (UniqueName: \"kubernetes.io/projected/8601cebf-cfcc-4222-93bc-7406b23c925e-kube-api-access-szff5\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.002687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.002537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8601cebf-cfcc-4222-93bc-7406b23c925e-tls-certs\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.002687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.002595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-dshm\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.002687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.002612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-model-cache\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.002687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.002646    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-tmp-dir\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.002687 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.002672    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-home\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.103976 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.103941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-home\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.103991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szff5\" (UniqueName: \"kubernetes.io/projected/8601cebf-cfcc-4222-93bc-7406b23c925e-kube-api-access-szff5\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.104027    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8601cebf-cfcc-4222-93bc-7406b23c925e-tls-certs\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.104058    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-dshm\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.104078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-model-cache\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104172 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.104116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-tmp-dir\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104489 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.104403    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-home\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104545 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.104494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-model-cache\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.104545 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.104526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-tmp-dir\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.106487 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.106461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-dshm\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.106735 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.106719    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8601cebf-cfcc-4222-93bc-7406b23c925e-tls-certs\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.112145 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.112119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szff5\" (UniqueName: \"kubernetes.io/projected/8601cebf-cfcc-4222-93bc-7406b23c925e-kube-api-access-szff5\") pod \"sub-test-model-1df35a-kserve-5f88c7b679-v6vg9\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") " pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.197290 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.197174    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:40.332108 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:40.332084    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"]
Aug 05 19:52:40.334568 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:52:40.334533    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8601cebf_cfcc_4222_93bc_7406b23c925e.slice/crio-214c98c854466b0665eeacc42de70428313720b81e05f825dbdfc847cbfc56ed WatchSource:0}: Error finding container 214c98c854466b0665eeacc42de70428313720b81e05f825dbdfc847cbfc56ed: Status 404 returned error can't find the container with id 214c98c854466b0665eeacc42de70428313720b81e05f825dbdfc847cbfc56ed
Aug 05 19:52:41.204032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:41.203996    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9" event={"ID":"8601cebf-cfcc-4222-93bc-7406b23c925e","Type":"ContainerStarted","Data":"9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9"}
Aug 05 19:52:41.204032 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:41.204039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9" event={"ID":"8601cebf-cfcc-4222-93bc-7406b23c925e","Type":"ContainerStarted","Data":"214c98c854466b0665eeacc42de70428313720b81e05f825dbdfc847cbfc56ed"}
Aug 05 19:52:41.221299 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:41.221244    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9" podStartSLOduration=2.221228901 podStartE2EDuration="2.221228901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:52:41.219867627 +0000 UTC m=+3057.271355319" watchObservedRunningTime="2026-08-05 19:52:41.221228901 +0000 UTC m=+3057.272716592"
Aug 05 19:52:42.305531 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:42.305491    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:52:50.197547 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:50.197505    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:50.199898 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:50.197573    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:50.210287 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:50.210264    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:52:50.256470 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:52:50.256438    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:53:16.210039 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:16.209998    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:53:28.207778 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:28.207733    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:53:28.262584 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:28.262528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:53:29.009576 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:29.009545    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:53:40.794486 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:40.794455    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:53:46.284823 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:46.284784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:53:47.122529 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:47.122485    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"]
Aug 05 19:53:47.151333 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:47.151298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:53:49.195640 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:53:49.195602    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:54:00.088388 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.088347    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"]
Aug 05 19:54:00.091357 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.091332    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.094551 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.094529    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"kube-root-ca.crt\""
Aug 05 19:54:00.094691 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.094543    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"openshift-service-ca.crt\""
Aug 05 19:54:00.094769 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.094628    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"rate-test-model-6a2d7d-kserve-self-signed-certs\""
Aug 05 19:54:00.094769 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.094679    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"default-dockercfg-khw9g\""
Aug 05 19:54:00.104709 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.104684    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"]
Aug 05 19:54:00.124753 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.124711    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:54:00.196128 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.196091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-home\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.196128 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.196127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-dshm\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.196456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.196171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-model-cache\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.196456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.196277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-tmp-dir\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.196456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.196336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be81114-9ee0-4411-8a9b-fae762ef1b04-tls-certs\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.196456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.196409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p7dm\" (UniqueName: \"kubernetes.io/projected/1be81114-9ee0-4411-8a9b-fae762ef1b04-kube-api-access-7p7dm\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.296994 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.296958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p7dm\" (UniqueName: \"kubernetes.io/projected/1be81114-9ee0-4411-8a9b-fae762ef1b04-kube-api-access-7p7dm\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297225 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-home\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297225 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-dshm\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297225 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-model-cache\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297225 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-tmp-dir\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297472 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be81114-9ee0-4411-8a9b-fae762ef1b04-tls-certs\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297598 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297577    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-home\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297658 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297605    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-model-cache\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.297694 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.297650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-tmp-dir\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.299726 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.299702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-dshm\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.299933 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.299913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be81114-9ee0-4411-8a9b-fae762ef1b04-tls-certs\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.308270 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.308172    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p7dm\" (UniqueName: \"kubernetes.io/projected/1be81114-9ee0-4411-8a9b-fae762ef1b04-kube-api-access-7p7dm\") pod \"rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") " pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.404311 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.404213    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:00.539358 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.539306    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"]
Aug 05 19:54:00.542201 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:54:00.542153    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1be81114_9ee0_4411_8a9b_fae762ef1b04.slice/crio-f0787185f6757fcb03689fd13068db1d2eff3e06c1becffef4765a0f3a5e3908 WatchSource:0}: Error finding container f0787185f6757fcb03689fd13068db1d2eff3e06c1becffef4765a0f3a5e3908: Status 404 returned error can't find the container with id f0787185f6757fcb03689fd13068db1d2eff3e06c1becffef4765a0f3a5e3908
Aug 05 19:54:00.573485 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:00.573450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8" event={"ID":"1be81114-9ee0-4411-8a9b-fae762ef1b04","Type":"ContainerStarted","Data":"f0787185f6757fcb03689fd13068db1d2eff3e06c1becffef4765a0f3a5e3908"}
Aug 05 19:54:01.580448 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:01.580409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8" event={"ID":"1be81114-9ee0-4411-8a9b-fae762ef1b04","Type":"ContainerStarted","Data":"136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16"}
Aug 05 19:54:01.603009 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:01.602949    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8" podStartSLOduration=1.6029273019999999 podStartE2EDuration="1.602927302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:54:01.601980228 +0000 UTC m=+3137.653467920" watchObservedRunningTime="2026-08-05 19:54:01.602927302 +0000 UTC m=+3137.654414996"
Aug 05 19:54:02.142332 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.142290    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9" podUID="8601cebf-cfcc-4222-93bc-7406b23c925e" containerName="main" containerID="cri-o://9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9" gracePeriod=45
Aug 05 19:54:02.392568 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.392499    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:54:02.519596 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519560    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szff5\" (UniqueName: \"kubernetes.io/projected/8601cebf-cfcc-4222-93bc-7406b23c925e-kube-api-access-szff5\") pod \"8601cebf-cfcc-4222-93bc-7406b23c925e\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") "
Aug 05 19:54:02.519780 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-tmp-dir\") pod \"8601cebf-cfcc-4222-93bc-7406b23c925e\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") "
Aug 05 19:54:02.519780 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519691    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-model-cache\") pod \"8601cebf-cfcc-4222-93bc-7406b23c925e\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") "
Aug 05 19:54:02.519780 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519722    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-dshm\") pod \"8601cebf-cfcc-4222-93bc-7406b23c925e\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") "
Aug 05 19:54:02.519780 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519747    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-home\") pod \"8601cebf-cfcc-4222-93bc-7406b23c925e\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") "
Aug 05 19:54:02.519780 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519774    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8601cebf-cfcc-4222-93bc-7406b23c925e-tls-certs\") pod \"8601cebf-cfcc-4222-93bc-7406b23c925e\" (UID: \"8601cebf-cfcc-4222-93bc-7406b23c925e\") "
Aug 05 19:54:02.520055 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519974    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-model-cache" (OuterVolumeSpecName: "model-cache") pod "8601cebf-cfcc-4222-93bc-7406b23c925e" (UID: "8601cebf-cfcc-4222-93bc-7406b23c925e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:02.520055 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.519985    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8601cebf-cfcc-4222-93bc-7406b23c925e" (UID: "8601cebf-cfcc-4222-93bc-7406b23c925e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:02.520155 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.520048    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-home" (OuterVolumeSpecName: "home") pod "8601cebf-cfcc-4222-93bc-7406b23c925e" (UID: "8601cebf-cfcc-4222-93bc-7406b23c925e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:02.520155 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.520095    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:54:02.520155 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.520112    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:54:02.522041 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.522015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8601cebf-cfcc-4222-93bc-7406b23c925e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8601cebf-cfcc-4222-93bc-7406b23c925e" (UID: "8601cebf-cfcc-4222-93bc-7406b23c925e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:54:02.522162 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.522061    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-dshm" (OuterVolumeSpecName: "dshm") pod "8601cebf-cfcc-4222-93bc-7406b23c925e" (UID: "8601cebf-cfcc-4222-93bc-7406b23c925e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:02.522162 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.522075    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8601cebf-cfcc-4222-93bc-7406b23c925e-kube-api-access-szff5" (OuterVolumeSpecName: "kube-api-access-szff5") pod "8601cebf-cfcc-4222-93bc-7406b23c925e" (UID: "8601cebf-cfcc-4222-93bc-7406b23c925e"). InnerVolumeSpecName "kube-api-access-szff5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:54:02.587663 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.587632    2558 generic.go:356] "Generic (PLEG): container finished" podID="8601cebf-cfcc-4222-93bc-7406b23c925e" containerID="9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9" exitCode=0
Aug 05 19:54:02.588143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.587685    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"
Aug 05 19:54:02.588143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.587709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9" event={"ID":"8601cebf-cfcc-4222-93bc-7406b23c925e","Type":"ContainerDied","Data":"9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9"}
Aug 05 19:54:02.588143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.587748    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9" event={"ID":"8601cebf-cfcc-4222-93bc-7406b23c925e","Type":"ContainerDied","Data":"214c98c854466b0665eeacc42de70428313720b81e05f825dbdfc847cbfc56ed"}
Aug 05 19:54:02.588143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.587764    2558 scope.go:117] "RemoveContainer" containerID="9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9"
Aug 05 19:54:02.597500 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.597482    2558 scope.go:117] "RemoveContainer" containerID="9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9"
Aug 05 19:54:02.597808 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:54:02.597782    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9\": container with ID starting with 9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9 not found: ID does not exist" containerID="9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9"
Aug 05 19:54:02.597849 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.597823    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9"} err="failed to get container status \"9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9\": rpc error: code = NotFound desc = could not find container \"9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9\": container with ID starting with 9674407b7aed4a65e887d9f0d8c3f1da7ecbe286ec4133b2abcd5f2e7cb4dbb9 not found: ID does not exist"
Aug 05 19:54:02.609903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.609871    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"]
Aug 05 19:54:02.611291 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.611270    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/sub-test-model-1df35a-kserve-5f88c7b679-v6vg9"]
Aug 05 19:54:02.621461 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.621434    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:54:02.621461 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.621456    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8601cebf-cfcc-4222-93bc-7406b23c925e-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:54:02.621461 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.621465    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8601cebf-cfcc-4222-93bc-7406b23c925e-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:54:02.621636 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.621474    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szff5\" (UniqueName: \"kubernetes.io/projected/8601cebf-cfcc-4222-93bc-7406b23c925e-kube-api-access-szff5\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:54:02.811478 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:02.811438    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:54:04.478193 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:04.478143    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8601cebf-cfcc-4222-93bc-7406b23c925e" path="/var/lib/kubelet/pods/8601cebf-cfcc-4222-93bc-7406b23c925e/volumes"
Aug 05 19:54:10.405157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:10.405048    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:10.405157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:10.405112    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:10.418092 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:10.418059    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:10.640530 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:10.640504    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:54:35.989599 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.989564    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"]
Aug 05 19:54:35.989976 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.989910    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8601cebf-cfcc-4222-93bc-7406b23c925e" containerName="main"
Aug 05 19:54:35.989976 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.989920    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8601cebf-cfcc-4222-93bc-7406b23c925e" containerName="main"
Aug 05 19:54:35.990053 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.989980    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8601cebf-cfcc-4222-93bc-7406b23c925e" containerName="main"
Aug 05 19:54:35.992907 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.992891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:35.995456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.995430    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"openshift-service-ca.crt\""
Aug 05 19:54:35.995456 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.995439    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"rate-test-model-1df35a-kserve-self-signed-certs\""
Aug 05 19:54:35.995639 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.995462    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"kube-root-ca.crt\""
Aug 05 19:54:35.995639 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:35.995506    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1df35a\"/\"default-dockercfg-46nwm\""
Aug 05 19:54:36.000933 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.000909    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"]
Aug 05 19:54:36.077250 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.077221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:54:36.103500 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.103466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tmp-dir\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.103677 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.103507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-dshm\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.103677 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.103531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-home\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.103677 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.103652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2gf\" (UniqueName: \"kubernetes.io/projected/f4f148b4-af8c-40c6-a990-82acb53cc5b3-kube-api-access-5v2gf\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.103815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.103688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tls-certs\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.103815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.103726    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-model-cache\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.204710 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.204668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-home\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.204919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.204735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2gf\" (UniqueName: \"kubernetes.io/projected/f4f148b4-af8c-40c6-a990-82acb53cc5b3-kube-api-access-5v2gf\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.204919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.204758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tls-certs\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.204919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.204787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-model-cache\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.204919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.204818    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tmp-dir\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.204919 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.204834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-dshm\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.205232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.205152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-home\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.205232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.205219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-model-cache\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.205371 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.205269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tmp-dir\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.207323 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.207305    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-dshm\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.207610 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.207588    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tls-certs\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.213238 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.213216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2gf\" (UniqueName: \"kubernetes.io/projected/f4f148b4-af8c-40c6-a990-82acb53cc5b3-kube-api-access-5v2gf\") pod \"rate-test-model-1df35a-kserve-9755f8bff-5wd4s\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") " pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.303558 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.303512    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:36.444553 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.444512    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"]
Aug 05 19:54:36.446574 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:54:36.446541    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4f148b4_af8c_40c6_a990_82acb53cc5b3.slice/crio-2312051cec800170d8bd8a63912aa9b47f95e0a984aa10a95e6fb31b94256c4e WatchSource:0}: Error finding container 2312051cec800170d8bd8a63912aa9b47f95e0a984aa10a95e6fb31b94256c4e: Status 404 returned error can't find the container with id 2312051cec800170d8bd8a63912aa9b47f95e0a984aa10a95e6fb31b94256c4e
Aug 05 19:54:36.753770 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.753674    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s" event={"ID":"f4f148b4-af8c-40c6-a990-82acb53cc5b3","Type":"ContainerStarted","Data":"960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa"}
Aug 05 19:54:36.753770 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.753729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s" event={"ID":"f4f148b4-af8c-40c6-a990-82acb53cc5b3","Type":"ContainerStarted","Data":"2312051cec800170d8bd8a63912aa9b47f95e0a984aa10a95e6fb31b94256c4e"}
Aug 05 19:54:36.770102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:36.770053    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s" podStartSLOduration=1.7700360389999998 podStartE2EDuration="1.770036039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:54:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:54:36.769370265 +0000 UTC m=+3172.820857959" watchObservedRunningTime="2026-08-05 19:54:36.770036039 +0000 UTC m=+3172.821523730"
Aug 05 19:54:38.404483 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:38.404445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:54:46.303863 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:46.303825    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:46.303863 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:46.303878    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:46.316683 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:46.316654    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:54:46.808956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:54:46.808917    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:55:24.704299 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:55:24.704265    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:55:32.297429 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:55:32.297390    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:56:04.497422 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:04.497343    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:56:09.621544 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:09.621498    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"]
Aug 05 19:56:09.668705 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:09.668670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:10.667491 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:10.667458    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"]
Aug 05 19:56:10.689695 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:10.689657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:13.595955 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:13.595911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:56:23.398384 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.398348    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:23.401447 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.401431    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:23.403471 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.403448    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nrk4n\""
Aug 05 19:56:23.407510 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.407486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:23.557575 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.557540    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nh6\" (UniqueName: \"kubernetes.io/projected/fdb1eecb-a1af-480b-b14b-b47977eac493-kube-api-access-w9nh6\") pod \"test-curl-7627-139713598452048\" (UID: \"fdb1eecb-a1af-480b-b14b-b47977eac493\") " pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:23.658140 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.658040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nh6\" (UniqueName: \"kubernetes.io/projected/fdb1eecb-a1af-480b-b14b-b47977eac493-kube-api-access-w9nh6\") pod \"test-curl-7627-139713598452048\" (UID: \"fdb1eecb-a1af-480b-b14b-b47977eac493\") " pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:23.666583 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.666556    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nh6\" (UniqueName: \"kubernetes.io/projected/fdb1eecb-a1af-480b-b14b-b47977eac493-kube-api-access-w9nh6\") pod \"test-curl-7627-139713598452048\" (UID: \"fdb1eecb-a1af-480b-b14b-b47977eac493\") " pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:23.713263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.713237    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:23.845579 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.845525    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:23.848463 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:56:23.848429    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdb1eecb_a1af_480b_b14b_b47977eac493.slice/crio-65636d755ebe0c19c17d45b03be932fcf9565b209510d6cc4b53d5130bbdf00a WatchSource:0}: Error finding container 65636d755ebe0c19c17d45b03be932fcf9565b209510d6cc4b53d5130bbdf00a: Status 404 returned error can't find the container with id 65636d755ebe0c19c17d45b03be932fcf9565b209510d6cc4b53d5130bbdf00a
Aug 05 19:56:23.849902 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:23.849883    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:56:24.265847 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:24.265804    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598452048" event={"ID":"fdb1eecb-a1af-480b-b14b-b47977eac493","Type":"ContainerStarted","Data":"65636d755ebe0c19c17d45b03be932fcf9565b209510d6cc4b53d5130bbdf00a"}
Aug 05 19:56:24.640889 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:24.640854    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8" podUID="1be81114-9ee0-4411-8a9b-fae762ef1b04" containerName="main" containerID="cri-o://136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16" gracePeriod=45
Aug 05 19:56:24.896062 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:24.896038    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:56:25.072241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072113    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-home\") pod \"1be81114-9ee0-4411-8a9b-fae762ef1b04\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") "
Aug 05 19:56:25.072241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072175    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be81114-9ee0-4411-8a9b-fae762ef1b04-tls-certs\") pod \"1be81114-9ee0-4411-8a9b-fae762ef1b04\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") "
Aug 05 19:56:25.072241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072218    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-tmp-dir\") pod \"1be81114-9ee0-4411-8a9b-fae762ef1b04\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") "
Aug 05 19:56:25.072524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072270    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-dshm\") pod \"1be81114-9ee0-4411-8a9b-fae762ef1b04\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") "
Aug 05 19:56:25.072524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-model-cache\") pod \"1be81114-9ee0-4411-8a9b-fae762ef1b04\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") "
Aug 05 19:56:25.072524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072322    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p7dm\" (UniqueName: \"kubernetes.io/projected/1be81114-9ee0-4411-8a9b-fae762ef1b04-kube-api-access-7p7dm\") pod \"1be81114-9ee0-4411-8a9b-fae762ef1b04\" (UID: \"1be81114-9ee0-4411-8a9b-fae762ef1b04\") "
Aug 05 19:56:25.072524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072448    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-home" (OuterVolumeSpecName: "home") pod "1be81114-9ee0-4411-8a9b-fae762ef1b04" (UID: "1be81114-9ee0-4411-8a9b-fae762ef1b04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:25.072524 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072510    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1be81114-9ee0-4411-8a9b-fae762ef1b04" (UID: "1be81114-9ee0-4411-8a9b-fae762ef1b04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:25.072788 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072622    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-model-cache" (OuterVolumeSpecName: "model-cache") pod "1be81114-9ee0-4411-8a9b-fae762ef1b04" (UID: "1be81114-9ee0-4411-8a9b-fae762ef1b04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:25.072788 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072709    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:25.072788 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.072729    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:25.074624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.074590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-dshm" (OuterVolumeSpecName: "dshm") pod "1be81114-9ee0-4411-8a9b-fae762ef1b04" (UID: "1be81114-9ee0-4411-8a9b-fae762ef1b04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:25.074750 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.074625    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1be81114-9ee0-4411-8a9b-fae762ef1b04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1be81114-9ee0-4411-8a9b-fae762ef1b04" (UID: "1be81114-9ee0-4411-8a9b-fae762ef1b04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:56:25.074750 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.074628    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1be81114-9ee0-4411-8a9b-fae762ef1b04-kube-api-access-7p7dm" (OuterVolumeSpecName: "kube-api-access-7p7dm") pod "1be81114-9ee0-4411-8a9b-fae762ef1b04" (UID: "1be81114-9ee0-4411-8a9b-fae762ef1b04"). InnerVolumeSpecName "kube-api-access-7p7dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:56:25.173719 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.173682    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:25.173719 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.173714    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be81114-9ee0-4411-8a9b-fae762ef1b04-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:25.173948 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.173731    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p7dm\" (UniqueName: \"kubernetes.io/projected/1be81114-9ee0-4411-8a9b-fae762ef1b04-kube-api-access-7p7dm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:25.173948 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.173740    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be81114-9ee0-4411-8a9b-fae762ef1b04-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:25.271240 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.271202    2558 generic.go:356] "Generic (PLEG): container finished" podID="1be81114-9ee0-4411-8a9b-fae762ef1b04" containerID="136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16" exitCode=0
Aug 05 19:56:25.271451 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.271258    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"
Aug 05 19:56:25.271451 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.271273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8" event={"ID":"1be81114-9ee0-4411-8a9b-fae762ef1b04","Type":"ContainerDied","Data":"136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16"}
Aug 05 19:56:25.271451 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.271326    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8" event={"ID":"1be81114-9ee0-4411-8a9b-fae762ef1b04","Type":"ContainerDied","Data":"f0787185f6757fcb03689fd13068db1d2eff3e06c1becffef4765a0f3a5e3908"}
Aug 05 19:56:25.271451 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.271350    2558 scope.go:117] "RemoveContainer" containerID="136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16"
Aug 05 19:56:25.273029 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.273003    2558 generic.go:356] "Generic (PLEG): container finished" podID="fdb1eecb-a1af-480b-b14b-b47977eac493" containerID="1fe4e0fab4b90f83945e3ddeceffe26a3c3facabede131c17b73cd345332bc94" exitCode=0
Aug 05 19:56:25.273151 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.273035    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598452048" event={"ID":"fdb1eecb-a1af-480b-b14b-b47977eac493","Type":"ContainerDied","Data":"1fe4e0fab4b90f83945e3ddeceffe26a3c3facabede131c17b73cd345332bc94"}
Aug 05 19:56:25.280721 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.280705    2558 scope.go:117] "RemoveContainer" containerID="136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16"
Aug 05 19:56:25.280998 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:56:25.280981    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16\": container with ID starting with 136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16 not found: ID does not exist" containerID="136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16"
Aug 05 19:56:25.281051 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.281007    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16"} err="failed to get container status \"136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16\": rpc error: code = NotFound desc = could not find container \"136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16\": container with ID starting with 136a0b4b41d2c6d4135ceb240f656161894628e47cef84017dba150b5978de16 not found: ID does not exist"
Aug 05 19:56:25.300573 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.300553    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"]
Aug 05 19:56:25.303935 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.303909    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/rate-test-model-6a2d7d-kserve-78f5999df9-rnwz8"]
Aug 05 19:56:25.687289 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.687252    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s" podUID="f4f148b4-af8c-40c6-a990-82acb53cc5b3" containerName="main" containerID="cri-o://960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa" gracePeriod=45
Aug 05 19:56:25.940572 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:25.940515    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:56:26.081498 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081459    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-model-cache\") pod \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") "
Aug 05 19:56:26.081498 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081497    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-home\") pod \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") "
Aug 05 19:56:26.081747 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081534    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tmp-dir\") pod \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") "
Aug 05 19:56:26.081747 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081590    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v2gf\" (UniqueName: \"kubernetes.io/projected/f4f148b4-af8c-40c6-a990-82acb53cc5b3-kube-api-access-5v2gf\") pod \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") "
Aug 05 19:56:26.081747 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081613    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tls-certs\") pod \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") "
Aug 05 19:56:26.081747 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081635    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-dshm\") pod \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\" (UID: \"f4f148b4-af8c-40c6-a990-82acb53cc5b3\") "
Aug 05 19:56:26.081952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081793    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-home" (OuterVolumeSpecName: "home") pod "f4f148b4-af8c-40c6-a990-82acb53cc5b3" (UID: "f4f148b4-af8c-40c6-a990-82acb53cc5b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:26.081952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081830    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4f148b4-af8c-40c6-a990-82acb53cc5b3" (UID: "f4f148b4-af8c-40c6-a990-82acb53cc5b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:26.081952 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.081852    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4f148b4-af8c-40c6-a990-82acb53cc5b3" (UID: "f4f148b4-af8c-40c6-a990-82acb53cc5b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:26.083931 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.083901    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-dshm" (OuterVolumeSpecName: "dshm") pod "f4f148b4-af8c-40c6-a990-82acb53cc5b3" (UID: "f4f148b4-af8c-40c6-a990-82acb53cc5b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:56:26.083931 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.083923    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4f148b4-af8c-40c6-a990-82acb53cc5b3" (UID: "f4f148b4-af8c-40c6-a990-82acb53cc5b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:56:26.084099 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.084024    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f148b4-af8c-40c6-a990-82acb53cc5b3-kube-api-access-5v2gf" (OuterVolumeSpecName: "kube-api-access-5v2gf") pod "f4f148b4-af8c-40c6-a990-82acb53cc5b3" (UID: "f4f148b4-af8c-40c6-a990-82acb53cc5b3"). InnerVolumeSpecName "kube-api-access-5v2gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:56:26.183044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.183007    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:26.183044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.183035    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v2gf\" (UniqueName: \"kubernetes.io/projected/f4f148b4-af8c-40c6-a990-82acb53cc5b3-kube-api-access-5v2gf\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:26.183044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.183045    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f148b4-af8c-40c6-a990-82acb53cc5b3-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:26.183044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.183054    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:26.183338 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.183062    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:26.183338 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.183069    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f148b4-af8c-40c6-a990-82acb53cc5b3-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:26.279231 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.279166    2558 generic.go:356] "Generic (PLEG): container finished" podID="f4f148b4-af8c-40c6-a990-82acb53cc5b3" containerID="960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa" exitCode=0
Aug 05 19:56:26.279231 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.279222    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"
Aug 05 19:56:26.279473 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.279221    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s" event={"ID":"f4f148b4-af8c-40c6-a990-82acb53cc5b3","Type":"ContainerDied","Data":"960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa"}
Aug 05 19:56:26.279473 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.279330    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s" event={"ID":"f4f148b4-af8c-40c6-a990-82acb53cc5b3","Type":"ContainerDied","Data":"2312051cec800170d8bd8a63912aa9b47f95e0a984aa10a95e6fb31b94256c4e"}
Aug 05 19:56:26.279473 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.279353    2558 scope.go:117] "RemoveContainer" containerID="960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa"
Aug 05 19:56:26.288991 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.288965    2558 scope.go:117] "RemoveContainer" containerID="960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa"
Aug 05 19:56:26.289359 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:56:26.289329    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa\": container with ID starting with 960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa not found: ID does not exist" containerID="960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa"
Aug 05 19:56:26.289413 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.289367    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa"} err="failed to get container status \"960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa\": rpc error: code = NotFound desc = could not find container \"960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa\": container with ID starting with 960fea8b7da817dd7d5bc22988f9a2dccb7a611fb91f67c4a402bbeaecc6f9fa not found: ID does not exist"
Aug 05 19:56:26.300574 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.300537    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"]
Aug 05 19:56:26.303744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.303718    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1df35a/rate-test-model-1df35a-kserve-9755f8bff-5wd4s"]
Aug 05 19:56:26.401827 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.401802    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:26.421421 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.421394    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7627-139713598452048_fdb1eecb-a1af-480b-b14b-b47977eac493/test-curl-7627-139713598452048/0.log"
Aug 05 19:56:26.442525 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.442487    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:26.445682 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.445659    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:26.476399 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.476369    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1be81114-9ee0-4411-8a9b-fae762ef1b04" path="/var/lib/kubelet/pods/1be81114-9ee0-4411-8a9b-fae762ef1b04/volumes"
Aug 05 19:56:26.476769 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.476755    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f148b4-af8c-40c6-a990-82acb53cc5b3" path="/var/lib/kubelet/pods/f4f148b4-af8c-40c6-a990-82acb53cc5b3/volumes"
Aug 05 19:56:26.484668 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.484646    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9nh6\" (UniqueName: \"kubernetes.io/projected/fdb1eecb-a1af-480b-b14b-b47977eac493-kube-api-access-w9nh6\") pod \"fdb1eecb-a1af-480b-b14b-b47977eac493\" (UID: \"fdb1eecb-a1af-480b-b14b-b47977eac493\") "
Aug 05 19:56:26.487093 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.487068    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb1eecb-a1af-480b-b14b-b47977eac493-kube-api-access-w9nh6" (OuterVolumeSpecName: "kube-api-access-w9nh6") pod "fdb1eecb-a1af-480b-b14b-b47977eac493" (UID: "fdb1eecb-a1af-480b-b14b-b47977eac493"). InnerVolumeSpecName "kube-api-access-w9nh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:56:26.569761 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.569682    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:26.570046 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570034    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f148b4-af8c-40c6-a990-82acb53cc5b3" containerName="main"
Aug 05 19:56:26.570090 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570048    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f148b4-af8c-40c6-a990-82acb53cc5b3" containerName="main"
Aug 05 19:56:26.570090 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570060    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb1eecb-a1af-480b-b14b-b47977eac493" containerName="test-curl-7627-139713598452048"
Aug 05 19:56:26.570090 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570068    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb1eecb-a1af-480b-b14b-b47977eac493" containerName="test-curl-7627-139713598452048"
Aug 05 19:56:26.570090 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570079    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1be81114-9ee0-4411-8a9b-fae762ef1b04" containerName="main"
Aug 05 19:56:26.570090 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570084    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be81114-9ee0-4411-8a9b-fae762ef1b04" containerName="main"
Aug 05 19:56:26.570279 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570134    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb1eecb-a1af-480b-b14b-b47977eac493" containerName="test-curl-7627-139713598452048"
Aug 05 19:56:26.570279 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570145    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f148b4-af8c-40c6-a990-82acb53cc5b3" containerName="main"
Aug 05 19:56:26.570279 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.570153    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1be81114-9ee0-4411-8a9b-fae762ef1b04" containerName="main"
Aug 05 19:56:26.574864 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.574835    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:26.580028 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.580000    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:26.586129 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.585922    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9nh6\" (UniqueName: \"kubernetes.io/projected/fdb1eecb-a1af-480b-b14b-b47977eac493-kube-api-access-w9nh6\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:26.686574 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.686542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cldjc\" (UniqueName: \"kubernetes.io/projected/55568fe8-2381-44cd-a114-6322c011424c-kube-api-access-cldjc\") pod \"test-curl-7627-139713598452048\" (UID: \"55568fe8-2381-44cd-a114-6322c011424c\") " pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:26.787538 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.787502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cldjc\" (UniqueName: \"kubernetes.io/projected/55568fe8-2381-44cd-a114-6322c011424c-kube-api-access-cldjc\") pod \"test-curl-7627-139713598452048\" (UID: \"55568fe8-2381-44cd-a114-6322c011424c\") " pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:26.796252 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.796230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cldjc\" (UniqueName: \"kubernetes.io/projected/55568fe8-2381-44cd-a114-6322c011424c-kube-api-access-cldjc\") pod \"test-curl-7627-139713598452048\" (UID: \"55568fe8-2381-44cd-a114-6322c011424c\") " pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:26.886367 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:26.886278    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:27.018436 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:27.018404    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:27.021046 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:56:27.021015    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55568fe8_2381_44cd_a114_6322c011424c.slice/crio-5415b71d930ace2cc4fd23cc8b045aa372dcf090ab5298e24905bc677144fdb2 WatchSource:0}: Error finding container 5415b71d930ace2cc4fd23cc8b045aa372dcf090ab5298e24905bc677144fdb2: Status 404 returned error can't find the container with id 5415b71d930ace2cc4fd23cc8b045aa372dcf090ab5298e24905bc677144fdb2
Aug 05 19:56:27.285280 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:27.285231    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598452048" event={"ID":"55568fe8-2381-44cd-a114-6322c011424c","Type":"ContainerStarted","Data":"5415b71d930ace2cc4fd23cc8b045aa372dcf090ab5298e24905bc677144fdb2"}
Aug 05 19:56:27.287170 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:27.287150    2558 scope.go:117] "RemoveContainer" containerID="1fe4e0fab4b90f83945e3ddeceffe26a3c3facabede131c17b73cd345332bc94"
Aug 05 19:56:27.287290 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:27.287192    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:28.294283 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:28.294246    2558 generic.go:356] "Generic (PLEG): container finished" podID="55568fe8-2381-44cd-a114-6322c011424c" containerID="cda256b36785d714831975b9daf4058d0122cf08e81310fc9fd4f22982daa260" exitCode=0
Aug 05 19:56:28.294672 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:28.294320    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598452048" event={"ID":"55568fe8-2381-44cd-a114-6322c011424c","Type":"ContainerDied","Data":"cda256b36785d714831975b9daf4058d0122cf08e81310fc9fd4f22982daa260"}
Aug 05 19:56:28.475286 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:28.475250    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdb1eecb-a1af-480b-b14b-b47977eac493" path="/var/lib/kubelet/pods/fdb1eecb-a1af-480b-b14b-b47977eac493/volumes"
Aug 05 19:56:29.432162 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:29.432139    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:29.451329 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:29.451309    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7627-139713598452048_55568fe8-2381-44cd-a114-6322c011424c/test-curl-7627-139713598452048/0.log"
Aug 05 19:56:29.473577 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:29.473551    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:29.477279 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:29.477198    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7627-139713598452048"]
Aug 05 19:56:29.617068 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:29.616975    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cldjc\" (UniqueName: \"kubernetes.io/projected/55568fe8-2381-44cd-a114-6322c011424c-kube-api-access-cldjc\") pod \"55568fe8-2381-44cd-a114-6322c011424c\" (UID: \"55568fe8-2381-44cd-a114-6322c011424c\") "
Aug 05 19:56:29.619269 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:29.619240    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55568fe8-2381-44cd-a114-6322c011424c-kube-api-access-cldjc" (OuterVolumeSpecName: "kube-api-access-cldjc") pod "55568fe8-2381-44cd-a114-6322c011424c" (UID: "55568fe8-2381-44cd-a114-6322c011424c"). InnerVolumeSpecName "kube-api-access-cldjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:56:29.717776 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:29.717740    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cldjc\" (UniqueName: \"kubernetes.io/projected/55568fe8-2381-44cd-a114-6322c011424c-kube-api-access-cldjc\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:56:30.304168 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:30.304137    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:30.304371 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:30.304141    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5415b71d930ace2cc4fd23cc8b045aa372dcf090ab5298e24905bc677144fdb2"
Aug 05 19:56:30.313498 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:56:30.313463    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7627-139713598452048\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="55568fe8-2381-44cd-a114-6322c011424c" pod="opendatahub/test-curl-7627-139713598452048"
Aug 05 19:56:30.475978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:30.475936    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55568fe8-2381-44cd-a114-6322c011424c" path="/var/lib/kubelet/pods/55568fe8-2381-44cd-a114-6322c011424c/volumes"
Aug 05 19:56:30.654738 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:30.654647    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:30.755880 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:30.755848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:33.061333 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:33.061297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:33.159815 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:33.159778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:34.182428 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.182381    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:34.657433 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.657403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:34.751713 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.751676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:34.803754 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.803719    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"]
Aug 05 19:56:34.804124 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.804110    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55568fe8-2381-44cd-a114-6322c011424c" containerName="test-curl-7627-139713598452048"
Aug 05 19:56:34.804171 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.804125    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55568fe8-2381-44cd-a114-6322c011424c" containerName="test-curl-7627-139713598452048"
Aug 05 19:56:34.804246 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.804174    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="55568fe8-2381-44cd-a114-6322c011424c" containerName="test-curl-7627-139713598452048"
Aug 05 19:56:34.807433 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.807416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:34.809989 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.809966    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-c686d7\""
Aug 05 19:56:34.810121 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.809992    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-c686d7-dockercfg-pvs8r\""
Aug 05 19:56:34.815938 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.815901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"]
Aug 05 19:56:34.827082 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.827057    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:34.827868 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.827846    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"]
Aug 05 19:56:34.831374 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.831356    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:34.842056 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.842030    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"]
Aug 05 19:56:34.863332 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.863301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbqh7\" (UniqueName: \"kubernetes.io/projected/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-kube-api-access-sbqh7\") pod \"payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:34.863457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.863425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c9ba36-c82d-4d8e-91db-16b404e6346e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:34.863457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.863451    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpvlx\" (UniqueName: \"kubernetes.io/projected/d0c9ba36-c82d-4d8e-91db-16b404e6346e-kube-api-access-zpvlx\") pod \"payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:34.863528 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.863487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:34.964228 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.964114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c9ba36-c82d-4d8e-91db-16b404e6346e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:34.964228 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.964150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpvlx\" (UniqueName: \"kubernetes.io/projected/d0c9ba36-c82d-4d8e-91db-16b404e6346e-kube-api-access-zpvlx\") pod \"payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:34.964228 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.964175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:34.964445 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.964273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbqh7\" (UniqueName: \"kubernetes.io/projected/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-kube-api-access-sbqh7\") pod \"payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:34.964969 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.964953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c9ba36-c82d-4d8e-91db-16b404e6346e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:34.965003 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.964954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:34.971348 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.971325    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbqh7\" (UniqueName: \"kubernetes.io/projected/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-kube-api-access-sbqh7\") pod \"payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:34.971454 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:34.971359    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpvlx\" (UniqueName: \"kubernetes.io/projected/d0c9ba36-c82d-4d8e-91db-16b404e6346e-kube-api-access-zpvlx\") pod \"payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:35.118315 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:35.118284    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:35.142662 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:35.142634    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:35.275496 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:35.275317    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"]
Aug 05 19:56:35.278503 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:56:35.278473    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8625ff5f_0ca4_4202_a584_08a0bfc8a1a6.slice/crio-c857b0c236e716ceede688aba9a12f704a1f5e75441e08df5de7fbcf6399e094 WatchSource:0}: Error finding container c857b0c236e716ceede688aba9a12f704a1f5e75441e08df5de7fbcf6399e094: Status 404 returned error can't find the container with id c857b0c236e716ceede688aba9a12f704a1f5e75441e08df5de7fbcf6399e094
Aug 05 19:56:35.303957 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:35.303934    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"]
Aug 05 19:56:35.306373 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:56:35.306348    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c9ba36_c82d_4d8e_91db_16b404e6346e.slice/crio-b90211254c07ae35397d0153a112111f7b625099e38ebe98eeb8bf0363b82d71 WatchSource:0}: Error finding container b90211254c07ae35397d0153a112111f7b625099e38ebe98eeb8bf0363b82d71: Status 404 returned error can't find the container with id b90211254c07ae35397d0153a112111f7b625099e38ebe98eeb8bf0363b82d71
Aug 05 19:56:35.330991 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:35.330960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4" event={"ID":"d0c9ba36-c82d-4d8e-91db-16b404e6346e","Type":"ContainerStarted","Data":"b90211254c07ae35397d0153a112111f7b625099e38ebe98eeb8bf0363b82d71"}
Aug 05 19:56:35.332356 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:35.332329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll" event={"ID":"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6","Type":"ContainerStarted","Data":"c857b0c236e716ceede688aba9a12f704a1f5e75441e08df5de7fbcf6399e094"}
Aug 05 19:56:36.339445 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:36.339403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll" event={"ID":"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6","Type":"ContainerStarted","Data":"cb325f8b8a62dbb489d24f8d48513352e147608df8c9a29b10a84bd5b29c9cbc"}
Aug 05 19:56:36.339908 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:36.339489    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:36.343109 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:36.343071    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4" event={"ID":"d0c9ba36-c82d-4d8e-91db-16b404e6346e","Type":"ContainerStarted","Data":"7d81997776bfe3ea167948094b0a109c83bf3edab6aa87519812feb9de44dafe"}
Aug 05 19:56:36.343352 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:36.343333    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:36.356800 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:36.356752    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll" podStartSLOduration=2.356737793 podStartE2EDuration="2.356737793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:56:36.355629793 +0000 UTC m=+3292.407117487" watchObservedRunningTime="2026-08-05 19:56:36.356737793 +0000 UTC m=+3292.408225484"
Aug 05 19:56:36.373798 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:36.373747    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4" podStartSLOduration=2.373733596 podStartE2EDuration="2.373733596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:56:36.371827912 +0000 UTC m=+3292.423315605" watchObservedRunningTime="2026-08-05 19:56:36.373733596 +0000 UTC m=+3292.425221289"
Aug 05 19:56:37.210950 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:37.210919    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:56:47.350446 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:47.350414    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:56:47.350862 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:47.350491    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:56:57.999807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:57.999767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:59.212970 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:59.212933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:56:59.445710 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:56:59.445660    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:04.389278 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:04.389239    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:04.486406 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:04.486371    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:05.513365 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:05.513276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:05.724955 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:05.724915    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:06.009369 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.009330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:06.112862 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.112828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:06.119085 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.119057    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"]
Aug 05 19:57:06.123165 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.123148    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.125656 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.125626    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-a1e3e2-dockercfg-kl2t5\""
Aug 05 19:57:06.125812 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.125665    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a1e3e2\""
Aug 05 19:57:06.133608 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.133584    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"]
Aug 05 19:57:06.153025 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.152998    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"]
Aug 05 19:57:06.160006 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.159981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.167586 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.167550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"]
Aug 05 19:57:06.248429 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.248395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6tv9\" (UniqueName: \"kubernetes.io/projected/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-kube-api-access-t6tv9\") pod \"payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.248612 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.248482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r28qg\" (UniqueName: \"kubernetes.io/projected/deb95820-2c13-4907-a271-f93275b9c3bb-kube-api-access-r28qg\") pod \"payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.248612 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.248548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deb95820-2c13-4907-a271-f93275b9c3bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.248612 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.248587    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.349262 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.349222    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r28qg\" (UniqueName: \"kubernetes.io/projected/deb95820-2c13-4907-a271-f93275b9c3bb-kube-api-access-r28qg\") pod \"payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.349477 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.349292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deb95820-2c13-4907-a271-f93275b9c3bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.349477 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.349323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.349477 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.349353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6tv9\" (UniqueName: \"kubernetes.io/projected/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-kube-api-access-t6tv9\") pod \"payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.350118 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.350092    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deb95820-2c13-4907-a271-f93275b9c3bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.350232 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.350094    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.357174 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.357143    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6tv9\" (UniqueName: \"kubernetes.io/projected/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-kube-api-access-t6tv9\") pod \"payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.357309 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.357288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r28qg\" (UniqueName: \"kubernetes.io/projected/deb95820-2c13-4907-a271-f93275b9c3bb-kube-api-access-r28qg\") pod \"payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.434794 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.434766    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:06.473865 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.473836    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:06.587944 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.587816    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"]
Aug 05 19:57:06.590999 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:57:06.590960    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb95820_2c13_4907_a271_f93275b9c3bb.slice/crio-5018c630b3a8d39a7f5222f26282dc1520c12243331dcb925e0720a6a0ba8554 WatchSource:0}: Error finding container 5018c630b3a8d39a7f5222f26282dc1520c12243331dcb925e0720a6a0ba8554: Status 404 returned error can't find the container with id 5018c630b3a8d39a7f5222f26282dc1520c12243331dcb925e0720a6a0ba8554
Aug 05 19:57:06.631152 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:06.630976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"]
Aug 05 19:57:06.633238 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:57:06.633210    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e93b169_0896_46f7_9bb7_4d3a7195b2c5.slice/crio-753a3789d53009205e94e7f068406a49f8dae1d77bb47a63118a0fe542acdb6b WatchSource:0}: Error finding container 753a3789d53009205e94e7f068406a49f8dae1d77bb47a63118a0fe542acdb6b: Status 404 returned error can't find the container with id 753a3789d53009205e94e7f068406a49f8dae1d77bb47a63118a0fe542acdb6b
Aug 05 19:57:07.495674 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.495635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29" event={"ID":"deb95820-2c13-4907-a271-f93275b9c3bb","Type":"ContainerStarted","Data":"4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950"}
Aug 05 19:57:07.495868 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.495704    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:07.495868 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.495729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29" event={"ID":"deb95820-2c13-4907-a271-f93275b9c3bb","Type":"ContainerStarted","Data":"5018c630b3a8d39a7f5222f26282dc1520c12243331dcb925e0720a6a0ba8554"}
Aug 05 19:57:07.497043 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.497019    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89" event={"ID":"4e93b169-0896-46f7-9bb7-4d3a7195b2c5","Type":"ContainerStarted","Data":"1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a"}
Aug 05 19:57:07.497102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.497076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89" event={"ID":"4e93b169-0896-46f7-9bb7-4d3a7195b2c5","Type":"ContainerStarted","Data":"753a3789d53009205e94e7f068406a49f8dae1d77bb47a63118a0fe542acdb6b"}
Aug 05 19:57:07.497102 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.497097    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:07.510945 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.510901    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29" podStartSLOduration=1.510883191 podStartE2EDuration="1.510883191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:57:07.509633528 +0000 UTC m=+3323.561121220" watchObservedRunningTime="2026-08-05 19:57:07.510883191 +0000 UTC m=+3323.562370882"
Aug 05 19:57:07.525258 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:07.525209    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89" podStartSLOduration=1.525159692 podStartE2EDuration="1.525159692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:57:07.524477712 +0000 UTC m=+3323.575965401" watchObservedRunningTime="2026-08-05 19:57:07.525159692 +0000 UTC m=+3323.576647395"
Aug 05 19:57:08.395132 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:08.395094    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:57:18.504349 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:18.504311    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 19:57:18.504797 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:18.504394    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 19:57:29.354594 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:29.354559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:31.250716 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:31.250683    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:36.318938 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:36.318903    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89_4e93b169-0896-46f7-9bb7-4d3a7195b2c5/payload-processing/0.log"
Aug 05 19:57:42.970744 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:42.970702    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"]
Aug 05 19:57:42.974508 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:42.974485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:42.976766 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:42.976744    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c686d7\"/\"kube-root-ca.crt\""
Aug 05 19:57:42.977477 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:42.977459    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c686d7\"/\"openshift-service-ca.crt\""
Aug 05 19:57:42.977583 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:42.977518    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c686d7\"/\"ipp-route-c686d7-kserve-self-signed-certs\""
Aug 05 19:57:42.977642 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:42.977616    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c686d7\"/\"default-dockercfg-6ktzx\""
Aug 05 19:57:42.983719 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:42.983699    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"]
Aug 05 19:57:43.083720 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.083690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-dshm\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.083720 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.083723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-model-cache\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.083956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.083743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8230f6-57e7-4b41-ab32-696515fc1c76-tls-certs\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.083956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.083759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-tmp-dir\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.083956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.083840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxz8\" (UniqueName: \"kubernetes.io/projected/dd8230f6-57e7-4b41-ab32-696515fc1c76-kube-api-access-nzxz8\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.083956 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.083888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-home\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.089005 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.088978    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:57:43.184356 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-dshm\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.184554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-model-cache\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.184554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8230f6-57e7-4b41-ab32-696515fc1c76-tls-certs\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.184554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-tmp-dir\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.184554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxz8\" (UniqueName: \"kubernetes.io/projected/dd8230f6-57e7-4b41-ab32-696515fc1c76-kube-api-access-nzxz8\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.184554 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-home\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.184903 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-model-cache\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.185028 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184883    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-home\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.185028 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.184945    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-tmp-dir\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.186837 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.186822    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-dshm\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.186948 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.186929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8230f6-57e7-4b41-ab32-696515fc1c76-tls-certs\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.192371 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.192353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxz8\" (UniqueName: \"kubernetes.io/projected/dd8230f6-57e7-4b41-ab32-696515fc1c76-kube-api-access-nzxz8\") pod \"ipp-route-c686d7-kserve-5d5d47f8c5-58ps6\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") " pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.284950 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.284913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:43.428909 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.428883    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"]
Aug 05 19:57:43.430864 ip-10-0-133-67 kubenswrapper[2558]: W0805 19:57:43.430834    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd8230f6_57e7_4b41_ab32_696515fc1c76.slice/crio-e6b22c3d228808449c7c179793a1f2fe94fb3cde2452984e2cceeb70f48b1641 WatchSource:0}: Error finding container e6b22c3d228808449c7c179793a1f2fe94fb3cde2452984e2cceeb70f48b1641: Status 404 returned error can't find the container with id e6b22c3d228808449c7c179793a1f2fe94fb3cde2452984e2cceeb70f48b1641
Aug 05 19:57:43.672263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.672160    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6" event={"ID":"dd8230f6-57e7-4b41-ab32-696515fc1c76","Type":"ContainerStarted","Data":"5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e"}
Aug 05 19:57:43.672263 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.672220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6" event={"ID":"dd8230f6-57e7-4b41-ab32-696515fc1c76","Type":"ContainerStarted","Data":"e6b22c3d228808449c7c179793a1f2fe94fb3cde2452984e2cceeb70f48b1641"}
Aug 05 19:57:43.688511 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:43.688465    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6" podStartSLOduration=1.6884495510000002 podStartE2EDuration="1.688449551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:57:43.686318798 +0000 UTC m=+3359.737806489" watchObservedRunningTime="2026-08-05 19:57:43.688449551 +0000 UTC m=+3359.739937295"
Aug 05 19:57:45.698978 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:45.698943    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:57:53.285107 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:53.285064    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:53.287475 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:53.285125    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:53.297735 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:53.297702    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:57:53.730632 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:57:53.730543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:58:10.000241 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:10.000197    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:58:14.517991 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:14.517956    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:20.974590 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:20.974558    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4_d0c9ba36-c82d-4d8e-91db-16b404e6346e/payload-processing/0.log"
Aug 05 19:58:21.219927 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:21.219897    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89_4e93b169-0896-46f7-9bb7-4d3a7195b2c5/payload-processing/0.log"
Aug 05 19:58:21.487330 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:21.487291    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:21.840044 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:21.840010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:22.002205 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:22.002139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:22.065967 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:22.065939    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:24.905455 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:24.905422    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:25.008933 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:25.008899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:26.019409 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:26.019370    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:26.200274 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:26.200236    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:26.513370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:26.513336    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:26.603471 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:26.603439    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:30.997975 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:30.997939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:58:49.824291 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:49.824210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:56.637087 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:56.637035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:56.731465 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:56.731434    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:56.811599 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:56.811561    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:56.876982 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:56.876945    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:57.141169 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:57.141141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:58:59.700735 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:58:59.700701    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:59:02.782826 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:02.782790    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:02.846114 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:02.846077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:03.041143 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:03.041050    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:03.253590 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:03.253557    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:19.896831 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:19.896730    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:59:21.947123 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:21.947086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:21.964972 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:21.964938    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"]
Aug 05 19:59:21.965253 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:21.965221    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4" podUID="d0c9ba36-c82d-4d8e-91db-16b404e6346e" containerName="payload-processing" containerID="cri-o://7d81997776bfe3ea167948094b0a109c83bf3edab6aa87519812feb9de44dafe" gracePeriod=30
Aug 05 19:59:21.967528 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:21.967468    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"]
Aug 05 19:59:21.969001 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:21.968974    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll" podUID="8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" containerName="payload-pre-processing" containerID="cri-o://cb325f8b8a62dbb489d24f8d48513352e147608df8c9a29b10a84bd5b29c9cbc" gracePeriod=30
Aug 05 19:59:22.046336 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.046305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:22.110366 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.110319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:22.156281 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.156250    2558 generic.go:356] "Generic (PLEG): container finished" podID="8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" containerID="cb325f8b8a62dbb489d24f8d48513352e147608df8c9a29b10a84bd5b29c9cbc" exitCode=0
Aug 05 19:59:22.156454 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.156299    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll" event={"ID":"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6","Type":"ContainerDied","Data":"cb325f8b8a62dbb489d24f8d48513352e147608df8c9a29b10a84bd5b29c9cbc"}
Aug 05 19:59:22.157992 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.157965    2558 generic.go:356] "Generic (PLEG): container finished" podID="d0c9ba36-c82d-4d8e-91db-16b404e6346e" containerID="7d81997776bfe3ea167948094b0a109c83bf3edab6aa87519812feb9de44dafe" exitCode=0
Aug 05 19:59:22.158126 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.157999    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4" event={"ID":"d0c9ba36-c82d-4d8e-91db-16b404e6346e","Type":"ContainerDied","Data":"7d81997776bfe3ea167948094b0a109c83bf3edab6aa87519812feb9de44dafe"}
Aug 05 19:59:22.247900 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.247875    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:59:22.251603 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.251578    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:59:22.363847 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.363815    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-plugins-config-volume\") pod \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") "
Aug 05 19:59:22.363847 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.363851    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpvlx\" (UniqueName: \"kubernetes.io/projected/d0c9ba36-c82d-4d8e-91db-16b404e6346e-kube-api-access-zpvlx\") pod \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") "
Aug 05 19:59:22.364117 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.363880    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbqh7\" (UniqueName: \"kubernetes.io/projected/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-kube-api-access-sbqh7\") pod \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\" (UID: \"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6\") "
Aug 05 19:59:22.364117 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.363927    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c9ba36-c82d-4d8e-91db-16b404e6346e-plugins-config-volume\") pod \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\" (UID: \"d0c9ba36-c82d-4d8e-91db-16b404e6346e\") "
Aug 05 19:59:22.364339 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.364312    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" (UID: "8625ff5f-0ca4-4202-a584-08a0bfc8a1a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:59:22.364397 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.364343    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0c9ba36-c82d-4d8e-91db-16b404e6346e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0c9ba36-c82d-4d8e-91db-16b404e6346e" (UID: "d0c9ba36-c82d-4d8e-91db-16b404e6346e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:59:22.366240 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.366222    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-kube-api-access-sbqh7" (OuterVolumeSpecName: "kube-api-access-sbqh7") pod "8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" (UID: "8625ff5f-0ca4-4202-a584-08a0bfc8a1a6"). InnerVolumeSpecName "kube-api-access-sbqh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:59:22.366306 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.366266    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c9ba36-c82d-4d8e-91db-16b404e6346e-kube-api-access-zpvlx" (OuterVolumeSpecName: "kube-api-access-zpvlx") pod "d0c9ba36-c82d-4d8e-91db-16b404e6346e" (UID: "d0c9ba36-c82d-4d8e-91db-16b404e6346e"). InnerVolumeSpecName "kube-api-access-zpvlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:59:22.459860 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.459828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:22.465010 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.464982    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:22.465010 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.465010    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpvlx\" (UniqueName: \"kubernetes.io/projected/d0c9ba36-c82d-4d8e-91db-16b404e6346e-kube-api-access-zpvlx\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:22.465223 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.465020    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbqh7\" (UniqueName: \"kubernetes.io/projected/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6-kube-api-access-sbqh7\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:22.465223 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:22.465029    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c9ba36-c82d-4d8e-91db-16b404e6346e-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:23.164344 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.164315    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"
Aug 05 19:59:23.164344 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.164326    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll" event={"ID":"8625ff5f-0ca4-4202-a584-08a0bfc8a1a6","Type":"ContainerDied","Data":"c857b0c236e716ceede688aba9a12f704a1f5e75441e08df5de7fbcf6399e094"}
Aug 05 19:59:23.164860 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.164386    2558 scope.go:117] "RemoveContainer" containerID="cb325f8b8a62dbb489d24f8d48513352e147608df8c9a29b10a84bd5b29c9cbc"
Aug 05 19:59:23.165739 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.165657    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4" event={"ID":"d0c9ba36-c82d-4d8e-91db-16b404e6346e","Type":"ContainerDied","Data":"b90211254c07ae35397d0153a112111f7b625099e38ebe98eeb8bf0363b82d71"}
Aug 05 19:59:23.165739 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.165698    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"
Aug 05 19:59:23.173122 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.173101    2558 scope.go:117] "RemoveContainer" containerID="7d81997776bfe3ea167948094b0a109c83bf3edab6aa87519812feb9de44dafe"
Aug 05 19:59:23.181290 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.181257    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"]
Aug 05 19:59:23.184452 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.184432    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c686d7-77774dcf66-b9hd4"]
Aug 05 19:59:23.194436 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.194415    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"]
Aug 05 19:59:23.202015 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:23.201994    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c686d7-7fb8569676-w25ll"]
Aug 05 19:59:24.478981 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:24.478948    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" path="/var/lib/kubelet/pods/8625ff5f-0ca4-4202-a584-08a0bfc8a1a6/volumes"
Aug 05 19:59:24.479391 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:24.479320    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c9ba36-c82d-4d8e-91db-16b404e6346e" path="/var/lib/kubelet/pods/d0c9ba36-c82d-4d8e-91db-16b404e6346e/volumes"
Aug 05 19:59:27.447201 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:27.447146    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"]
Aug 05 19:59:27.499318 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:27.499286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:28.993336 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:28.993299    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 19:59:32.284157 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:32.284125    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:32.338463 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:32.338424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 19:59:42.467786 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.467739    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6" podUID="dd8230f6-57e7-4b41-ab32-696515fc1c76" containerName="main" containerID="cri-o://5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e" gracePeriod=45
Aug 05 19:59:42.713013 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.712986    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:59:42.750853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.750774    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-tmp-dir\") pod \"dd8230f6-57e7-4b41-ab32-696515fc1c76\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") "
Aug 05 19:59:42.750853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.750829    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzxz8\" (UniqueName: \"kubernetes.io/projected/dd8230f6-57e7-4b41-ab32-696515fc1c76-kube-api-access-nzxz8\") pod \"dd8230f6-57e7-4b41-ab32-696515fc1c76\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") "
Aug 05 19:59:42.750853 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.750848    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-home\") pod \"dd8230f6-57e7-4b41-ab32-696515fc1c76\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") "
Aug 05 19:59:42.751195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.750885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-dshm\") pod \"dd8230f6-57e7-4b41-ab32-696515fc1c76\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") "
Aug 05 19:59:42.751195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.750901    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8230f6-57e7-4b41-ab32-696515fc1c76-tls-certs\") pod \"dd8230f6-57e7-4b41-ab32-696515fc1c76\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") "
Aug 05 19:59:42.751195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.750960    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-model-cache\") pod \"dd8230f6-57e7-4b41-ab32-696515fc1c76\" (UID: \"dd8230f6-57e7-4b41-ab32-696515fc1c76\") "
Aug 05 19:59:42.751195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.751060    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd8230f6-57e7-4b41-ab32-696515fc1c76" (UID: "dd8230f6-57e7-4b41-ab32-696515fc1c76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:42.751195 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.751141    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-home" (OuterVolumeSpecName: "home") pod "dd8230f6-57e7-4b41-ab32-696515fc1c76" (UID: "dd8230f6-57e7-4b41-ab32-696515fc1c76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:42.751457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.751302    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-tmp-dir\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:42.751457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.751320    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-home\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:42.751457 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.751325    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd8230f6-57e7-4b41-ab32-696515fc1c76" (UID: "dd8230f6-57e7-4b41-ab32-696515fc1c76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:42.753382 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.753353    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-dshm" (OuterVolumeSpecName: "dshm") pod "dd8230f6-57e7-4b41-ab32-696515fc1c76" (UID: "dd8230f6-57e7-4b41-ab32-696515fc1c76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:42.753495 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.753391    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd8230f6-57e7-4b41-ab32-696515fc1c76-kube-api-access-nzxz8" (OuterVolumeSpecName: "kube-api-access-nzxz8") pod "dd8230f6-57e7-4b41-ab32-696515fc1c76" (UID: "dd8230f6-57e7-4b41-ab32-696515fc1c76"). InnerVolumeSpecName "kube-api-access-nzxz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:59:42.753585 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.753567    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd8230f6-57e7-4b41-ab32-696515fc1c76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd8230f6-57e7-4b41-ab32-696515fc1c76" (UID: "dd8230f6-57e7-4b41-ab32-696515fc1c76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:59:42.851949 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.851909    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzxz8\" (UniqueName: \"kubernetes.io/projected/dd8230f6-57e7-4b41-ab32-696515fc1c76-kube-api-access-nzxz8\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:42.851949 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.851943    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-dshm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:42.851949 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.851952    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8230f6-57e7-4b41-ab32-696515fc1c76-tls-certs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:42.852225 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:42.851964    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8230f6-57e7-4b41-ab32-696515fc1c76-model-cache\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 19:59:43.260850 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.260819    2558 generic.go:356] "Generic (PLEG): container finished" podID="dd8230f6-57e7-4b41-ab32-696515fc1c76" containerID="5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e" exitCode=0
Aug 05 19:59:43.261026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.260867    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"
Aug 05 19:59:43.261026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.260890    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6" event={"ID":"dd8230f6-57e7-4b41-ab32-696515fc1c76","Type":"ContainerDied","Data":"5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e"}
Aug 05 19:59:43.261026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.260920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6" event={"ID":"dd8230f6-57e7-4b41-ab32-696515fc1c76","Type":"ContainerDied","Data":"e6b22c3d228808449c7c179793a1f2fe94fb3cde2452984e2cceeb70f48b1641"}
Aug 05 19:59:43.261026 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.260941    2558 scope.go:117] "RemoveContainer" containerID="5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e"
Aug 05 19:59:43.275370 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.275349    2558 scope.go:117] "RemoveContainer" containerID="5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e"
Aug 05 19:59:43.275647 ip-10-0-133-67 kubenswrapper[2558]: E0805 19:59:43.275628    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e\": container with ID starting with 5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e not found: ID does not exist" containerID="5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e"
Aug 05 19:59:43.275701 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.275655    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e"} err="failed to get container status \"5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e\": rpc error: code = NotFound desc = could not find container \"5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e\": container with ID starting with 5ccf7e0056be72b192f10159b52fd4b83458c0d47247ceb6ddf8cee49f6f194e not found: ID does not exist"
Aug 05 19:59:43.284160 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.284063    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"]
Aug 05 19:59:43.285807 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:43.285785    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-c686d7/ipp-route-c686d7-kserve-5d5d47f8c5-58ps6"]
Aug 05 19:59:44.476624 ip-10-0-133-67 kubenswrapper[2558]: I0805 19:59:44.476591    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd8230f6-57e7-4b41-ab32-696515fc1c76" path="/var/lib/kubelet/pods/dd8230f6-57e7-4b41-ab32-696515fc1c76/volumes"
Aug 05 20:00:04.123019 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:04.122981    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:04.656348 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:04.656315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:10.389466 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:10.389427    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:24.897265 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:24.897227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:24.983670 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:24.983637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:25.165049 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:25.164966    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:25.387744 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:25.387712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:36.068129 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.068086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:36.104143 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.104109    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"]
Aug 05 20:00:36.104412 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.104381    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89" podUID="4e93b169-0896-46f7-9bb7-4d3a7195b2c5" containerName="payload-processing" containerID="cri-o://1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a" gracePeriod=30
Aug 05 20:00:36.109903 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.109874    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"]
Aug 05 20:00:36.110111 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.110089    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29" podUID="deb95820-2c13-4907-a271-f93275b9c3bb" containerName="payload-pre-processing" containerID="cri-o://4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950" gracePeriod=30
Aug 05 20:00:36.143437 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.143406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:36.208801 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.208757    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:36.286741 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.286706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:36.364765 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.364739    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 20:00:36.391698 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.391674    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 20:00:36.427335 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.427304    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6tv9\" (UniqueName: \"kubernetes.io/projected/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-kube-api-access-t6tv9\") pod \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") "
Aug 05 20:00:36.427335 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.427333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deb95820-2c13-4907-a271-f93275b9c3bb-plugins-config-volume\") pod \"deb95820-2c13-4907-a271-f93275b9c3bb\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") "
Aug 05 20:00:36.427578 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.427369    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r28qg\" (UniqueName: \"kubernetes.io/projected/deb95820-2c13-4907-a271-f93275b9c3bb-kube-api-access-r28qg\") pod \"deb95820-2c13-4907-a271-f93275b9c3bb\" (UID: \"deb95820-2c13-4907-a271-f93275b9c3bb\") "
Aug 05 20:00:36.427578 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.427481    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-plugins-config-volume\") pod \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\" (UID: \"4e93b169-0896-46f7-9bb7-4d3a7195b2c5\") "
Aug 05 20:00:36.427801 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.427776    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb95820-2c13-4907-a271-f93275b9c3bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "deb95820-2c13-4907-a271-f93275b9c3bb" (UID: "deb95820-2c13-4907-a271-f93275b9c3bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:36.427895 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.427856    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e93b169-0896-46f7-9bb7-4d3a7195b2c5" (UID: "4e93b169-0896-46f7-9bb7-4d3a7195b2c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:36.427972 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.427916    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deb95820-2c13-4907-a271-f93275b9c3bb-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:36.429622 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.429594    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-kube-api-access-t6tv9" (OuterVolumeSpecName: "kube-api-access-t6tv9") pod "4e93b169-0896-46f7-9bb7-4d3a7195b2c5" (UID: "4e93b169-0896-46f7-9bb7-4d3a7195b2c5"). InnerVolumeSpecName "kube-api-access-t6tv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:36.429724 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.429703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb95820-2c13-4907-a271-f93275b9c3bb-kube-api-access-r28qg" (OuterVolumeSpecName: "kube-api-access-r28qg") pod "deb95820-2c13-4907-a271-f93275b9c3bb" (UID: "deb95820-2c13-4907-a271-f93275b9c3bb"). InnerVolumeSpecName "kube-api-access-r28qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:36.522620 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.522583    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e93b169-0896-46f7-9bb7-4d3a7195b2c5" containerID="1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a" exitCode=0
Aug 05 20:00:36.522798 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.522631    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"
Aug 05 20:00:36.522798 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.522665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89" event={"ID":"4e93b169-0896-46f7-9bb7-4d3a7195b2c5","Type":"ContainerDied","Data":"1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a"}
Aug 05 20:00:36.522798 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.522715    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89" event={"ID":"4e93b169-0896-46f7-9bb7-4d3a7195b2c5","Type":"ContainerDied","Data":"753a3789d53009205e94e7f068406a49f8dae1d77bb47a63118a0fe542acdb6b"}
Aug 05 20:00:36.522798 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.522739    2558 scope.go:117] "RemoveContainer" containerID="1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a"
Aug 05 20:00:36.524033 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.524008    2558 generic.go:356] "Generic (PLEG): container finished" podID="deb95820-2c13-4907-a271-f93275b9c3bb" containerID="4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950" exitCode=0
Aug 05 20:00:36.524150 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.524044    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"
Aug 05 20:00:36.524150 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.524067    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29" event={"ID":"deb95820-2c13-4907-a271-f93275b9c3bb","Type":"ContainerDied","Data":"4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950"}
Aug 05 20:00:36.524150 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.524109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29" event={"ID":"deb95820-2c13-4907-a271-f93275b9c3bb","Type":"ContainerDied","Data":"5018c630b3a8d39a7f5222f26282dc1520c12243331dcb925e0720a6a0ba8554"}
Aug 05 20:00:36.529753 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.529722    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6tv9\" (UniqueName: \"kubernetes.io/projected/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-kube-api-access-t6tv9\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:36.529753 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.529755    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r28qg\" (UniqueName: \"kubernetes.io/projected/deb95820-2c13-4907-a271-f93275b9c3bb-kube-api-access-r28qg\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:36.529939 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.529772    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e93b169-0896-46f7-9bb7-4d3a7195b2c5-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:36.531737 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.531722    2558 scope.go:117] "RemoveContainer" containerID="1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a"
Aug 05 20:00:36.532023 ip-10-0-133-67 kubenswrapper[2558]: E0805 20:00:36.532001    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a\": container with ID starting with 1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a not found: ID does not exist" containerID="1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a"
Aug 05 20:00:36.532091 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.532035    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a"} err="failed to get container status \"1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a\": rpc error: code = NotFound desc = could not find container \"1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a\": container with ID starting with 1c76baaf82d8dd9cfd6a578809ffa422b6fe5302a6fcdb966d13e8cb20907c2a not found: ID does not exist"
Aug 05 20:00:36.532091 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.532053    2558 scope.go:117] "RemoveContainer" containerID="4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950"
Aug 05 20:00:36.539731 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.539709    2558 scope.go:117] "RemoveContainer" containerID="4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950"
Aug 05 20:00:36.540329 ip-10-0-133-67 kubenswrapper[2558]: E0805 20:00:36.540294    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950\": container with ID starting with 4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950 not found: ID does not exist" containerID="4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950"
Aug 05 20:00:36.540576 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.540338    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950"} err="failed to get container status \"4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950\": rpc error: code = NotFound desc = could not find container \"4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950\": container with ID starting with 4ea47139d1b73b1b792a3c73c690f2aecf216d215f22d94152e02a96b5d07950 not found: ID does not exist"
Aug 05 20:00:36.542508 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.542486    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"]
Aug 05 20:00:36.547005 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.546982    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a1e3e2-866464487d-2cj89"]
Aug 05 20:00:36.558457 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.558405    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"]
Aug 05 20:00:36.561433 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.561410    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e3e2-747c6bbcf6-8pw29"]
Aug 05 20:00:36.611988 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:36.611901    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:38.302942 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:38.302907    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 20:00:38.475685 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:38.475650    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e93b169-0896-46f7-9bb7-4d3a7195b2c5" path="/var/lib/kubelet/pods/4e93b169-0896-46f7-9bb7-4d3a7195b2c5/volumes"
Aug 05 20:00:38.475994 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:38.475981    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb95820-2c13-4907-a271-f93275b9c3bb" path="/var/lib/kubelet/pods/deb95820-2c13-4907-a271-f93275b9c3bb/volumes"
Aug 05 20:00:42.316374 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:42.316330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:42.379094 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:42.379054    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:42.578643 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:42.578549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:42.785626 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:42.785585    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:53.430237 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.430204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:53.468274 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.468239    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"]
Aug 05 20:00:53.468562 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.468499    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh" podUID="ddf3cbde-16f8-4caf-914f-db735502259f" containerName="payload-processing" containerID="cri-o://c45aab47faff78089ce3f9e76de20ef34667a5ccdb8b3acf914adefc87c43b92" gracePeriod=30
Aug 05 20:00:53.479702 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.479671    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"]
Aug 05 20:00:53.479907 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.479884    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m" podUID="1d49d700-6028-46d4-ad5d-4be2d50a6b9b" containerName="payload-pre-processing" containerID="cri-o://411ff8a687480c599d9a02981d6e4ca5a0632dfca936102256ed1fd5c1ba88e2" gracePeriod=30
Aug 05 20:00:53.529327 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.529299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:53.613322 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.613284    2558 generic.go:356] "Generic (PLEG): container finished" podID="ddf3cbde-16f8-4caf-914f-db735502259f" containerID="c45aab47faff78089ce3f9e76de20ef34667a5ccdb8b3acf914adefc87c43b92" exitCode=0
Aug 05 20:00:53.613503 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.613354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh" event={"ID":"ddf3cbde-16f8-4caf-914f-db735502259f","Type":"ContainerDied","Data":"c45aab47faff78089ce3f9e76de20ef34667a5ccdb8b3acf914adefc87c43b92"}
Aug 05 20:00:53.615008 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.614981    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d49d700-6028-46d4-ad5d-4be2d50a6b9b" containerID="411ff8a687480c599d9a02981d6e4ca5a0632dfca936102256ed1fd5c1ba88e2" exitCode=0
Aug 05 20:00:53.615163 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.615030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m" event={"ID":"1d49d700-6028-46d4-ad5d-4be2d50a6b9b","Type":"ContainerDied","Data":"411ff8a687480c599d9a02981d6e4ca5a0632dfca936102256ed1fd5c1ba88e2"}
Aug 05 20:00:53.623403 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.623375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:53.689462 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.689390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:53.754804 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.754775    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 20:00:53.757857 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.757834    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 20:00:53.880683 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.880649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-576bm\" (UniqueName: \"kubernetes.io/projected/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-kube-api-access-576bm\") pod \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") "
Aug 05 20:00:53.880846 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.880691    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf3cbde-16f8-4caf-914f-db735502259f-plugins-config-volume\") pod \"ddf3cbde-16f8-4caf-914f-db735502259f\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") "
Aug 05 20:00:53.880846 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.880726    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-plugins-config-volume\") pod \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\" (UID: \"1d49d700-6028-46d4-ad5d-4be2d50a6b9b\") "
Aug 05 20:00:53.880846 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.880794    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zpxm\" (UniqueName: \"kubernetes.io/projected/ddf3cbde-16f8-4caf-914f-db735502259f-kube-api-access-5zpxm\") pod \"ddf3cbde-16f8-4caf-914f-db735502259f\" (UID: \"ddf3cbde-16f8-4caf-914f-db735502259f\") "
Aug 05 20:00:53.881134 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.881100    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddf3cbde-16f8-4caf-914f-db735502259f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ddf3cbde-16f8-4caf-914f-db735502259f" (UID: "ddf3cbde-16f8-4caf-914f-db735502259f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:53.881273 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.881107    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d49d700-6028-46d4-ad5d-4be2d50a6b9b" (UID: "1d49d700-6028-46d4-ad5d-4be2d50a6b9b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:53.882992 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.882969    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf3cbde-16f8-4caf-914f-db735502259f-kube-api-access-5zpxm" (OuterVolumeSpecName: "kube-api-access-5zpxm") pod "ddf3cbde-16f8-4caf-914f-db735502259f" (UID: "ddf3cbde-16f8-4caf-914f-db735502259f"). InnerVolumeSpecName "kube-api-access-5zpxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:53.883070 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.882998    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-kube-api-access-576bm" (OuterVolumeSpecName: "kube-api-access-576bm") pod "1d49d700-6028-46d4-ad5d-4be2d50a6b9b" (UID: "1d49d700-6028-46d4-ad5d-4be2d50a6b9b"). InnerVolumeSpecName "kube-api-access-576bm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:53.978096 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.977999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:53.982251 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.982230    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zpxm\" (UniqueName: \"kubernetes.io/projected/ddf3cbde-16f8-4caf-914f-db735502259f-kube-api-access-5zpxm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:53.982319 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.982253    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-576bm\" (UniqueName: \"kubernetes.io/projected/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-kube-api-access-576bm\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:53.982319 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.982262    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf3cbde-16f8-4caf-914f-db735502259f-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:53.982319 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:53.982270    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d49d700-6028-46d4-ad5d-4be2d50a6b9b-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:00:54.620947 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.620919    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"
Aug 05 20:00:54.621411 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.620947    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m" event={"ID":"1d49d700-6028-46d4-ad5d-4be2d50a6b9b","Type":"ContainerDied","Data":"0b18cc0d6c376490ef126a02365a2d232b0f6f3abf39856681d158b06216e532"}
Aug 05 20:00:54.621411 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.621002    2558 scope.go:117] "RemoveContainer" containerID="411ff8a687480c599d9a02981d6e4ca5a0632dfca936102256ed1fd5c1ba88e2"
Aug 05 20:00:54.622520 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.622501    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh" event={"ID":"ddf3cbde-16f8-4caf-914f-db735502259f","Type":"ContainerDied","Data":"81dba8877eff6563cd736828273af853eba9755602b2de18e8033fc2c8fdfb83"}
Aug 05 20:00:54.622622 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.622537    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"
Aug 05 20:00:54.629815 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.629790    2558 scope.go:117] "RemoveContainer" containerID="c45aab47faff78089ce3f9e76de20ef34667a5ccdb8b3acf914adefc87c43b92"
Aug 05 20:00:54.637747 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.637729    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"]
Aug 05 20:00:54.641453 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.641430    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2d7d-d9d77869b-rdx8m"]
Aug 05 20:00:54.651294 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.651274    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"]
Aug 05 20:00:54.655172 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:54.655153    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2d7d-5768f96ff4-5gkwh"]
Aug 05 20:00:55.801138 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:55.801105    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 20:00:56.475594 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:56.475561    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d49d700-6028-46d4-ad5d-4be2d50a6b9b" path="/var/lib/kubelet/pods/1d49d700-6028-46d4-ad5d-4be2d50a6b9b/volumes"
Aug 05 20:00:56.475906 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:56.475893    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf3cbde-16f8-4caf-914f-db735502259f" path="/var/lib/kubelet/pods/ddf3cbde-16f8-4caf-914f-db735502259f/volumes"
Aug 05 20:00:59.853671 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:59.853639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:00:59.920242 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:00:59.920213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:00.112860 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:00.112770    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:00.309598 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:00.309563    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:11.321811 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.321774    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:11.369512 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.369470    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"]
Aug 05 20:01:11.369764 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.369731    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn" podUID="dd85ca27-bab3-4fae-b19e-99e068b8e8c7" containerName="payload-processing" containerID="cri-o://a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091" gracePeriod=30
Aug 05 20:01:11.418097 ip-10-0-133-67 kubenswrapper[2558]: E0805 20:01:11.418060    2558 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd85ca27_bab3_4fae_b19e_99e068b8e8c7.slice/crio-conmon-a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd85ca27_bab3_4fae_b19e_99e068b8e8c7.slice/crio-a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091.scope\": RecentStats: unable to find data in memory cache]"
Aug 05 20:01:11.425982 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.425955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:11.523618 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.523587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:11.592650 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.592501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:11.619513 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.619489    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 20:01:11.643101 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.643067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-plugins-config-volume\") pod \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") "
Aug 05 20:01:11.643304 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.643153    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4hpl\" (UniqueName: \"kubernetes.io/projected/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-kube-api-access-n4hpl\") pod \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\" (UID: \"dd85ca27-bab3-4fae-b19e-99e068b8e8c7\") "
Aug 05 20:01:11.643493 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.643469    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd85ca27-bab3-4fae-b19e-99e068b8e8c7" (UID: "dd85ca27-bab3-4fae-b19e-99e068b8e8c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:01:11.645464 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.645438    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-kube-api-access-n4hpl" (OuterVolumeSpecName: "kube-api-access-n4hpl") pod "dd85ca27-bab3-4fae-b19e-99e068b8e8c7" (UID: "dd85ca27-bab3-4fae-b19e-99e068b8e8c7"). InnerVolumeSpecName "kube-api-access-n4hpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:01:11.706248 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.706216    2558 generic.go:356] "Generic (PLEG): container finished" podID="dd85ca27-bab3-4fae-b19e-99e068b8e8c7" containerID="a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091" exitCode=0
Aug 05 20:01:11.706423 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.706267    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"
Aug 05 20:01:11.706423 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.706290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn" event={"ID":"dd85ca27-bab3-4fae-b19e-99e068b8e8c7","Type":"ContainerDied","Data":"a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091"}
Aug 05 20:01:11.706423 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.706359    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn" event={"ID":"dd85ca27-bab3-4fae-b19e-99e068b8e8c7","Type":"ContainerDied","Data":"0ceb4791267e81dc9a841c838c7a73ca4937fb48bcd8987ea4e82747c28f83f1"}
Aug 05 20:01:11.706423 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.706380    2558 scope.go:117] "RemoveContainer" containerID="a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091"
Aug 05 20:01:11.715263 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.715244    2558 scope.go:117] "RemoveContainer" containerID="a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091"
Aug 05 20:01:11.715546 ip-10-0-133-67 kubenswrapper[2558]: E0805 20:01:11.715521    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091\": container with ID starting with a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091 not found: ID does not exist" containerID="a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091"
Aug 05 20:01:11.715639 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.715552    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091"} err="failed to get container status \"a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091\": rpc error: code = NotFound desc = could not find container \"a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091\": container with ID starting with a7d9c8b9a768bbbb4f078788f604d779cb6fd084962bcaae5c22f4cc3897d091 not found: ID does not exist"
Aug 05 20:01:11.727368 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.727342    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"]
Aug 05 20:01:11.731819 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.731797    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1df35a-7db768bfb6-2pdkn"]
Aug 05 20:01:11.743865 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.743842    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-plugins-config-volume\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:01:11.743865 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.743865    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4hpl\" (UniqueName: \"kubernetes.io/projected/dd85ca27-bab3-4fae-b19e-99e068b8e8c7-kube-api-access-n4hpl\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\""
Aug 05 20:01:11.906535 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:11.906446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:12.475543 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:12.475511    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd85ca27-bab3-4fae-b19e-99e068b8e8c7" path="/var/lib/kubelet/pods/dd85ca27-bab3-4fae-b19e-99e068b8e8c7/volumes"
Aug 05 20:01:13.503520 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:13.503481    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cf95j"]
Aug 05 20:01:18.022432 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:18.022396    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:18.124517 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:18.124480    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:18.303536 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:18.303440    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:18.504708 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:18.504678    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:18.904347 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:18.904311    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68955bc4bc-m4gfh_c9ecc895-05c8-4302-9d3a-cb75c2c22d07/authorino/0.log"
Aug 05 20:01:24.503852 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:24.503822    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-88dts_357fca42-3f1f-4a1f-889b-c93c893fd0e8/copy-manifests/0.log"
Aug 05 20:01:24.510694 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:24.510667    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-88dts_357fca42-3f1f-4a1f-889b-c93c893fd0e8/manager/0.log"
Aug 05 20:01:26.205143 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:26.205112    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68955bc4bc-m4gfh_c9ecc895-05c8-4302-9d3a-cb75c2c22d07/authorino/0.log"
Aug 05 20:01:26.647358 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:26.647329    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-snnzx_b0be61f5-fa79-4d68-ad27-8cf611120bd3/manager/0.log"
Aug 05 20:01:26.756313 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:26.756283    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-cf95j_953cfa8e-62e2-4d3b-8b18-58335776a9cf/limitador/0.log"
Aug 05 20:01:27.527230 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:27.527173    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-r4xkj_24a0cf82-dc5c-44a9-9ce1-077a7438bac8/kube-auth-proxy/0.log"
Aug 05 20:01:28.814773 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:28.814732    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-n966p_ec7600b4-ad88-414e-adae-6ec5d0f4a823/main/0.log"
Aug 05 20:01:33.934409 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934371    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6vfb/must-gather-hdt9s"]
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934693    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd85ca27-bab3-4fae-b19e-99e068b8e8c7" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934705    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd85ca27-bab3-4fae-b19e-99e068b8e8c7" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934715    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb95820-2c13-4907-a271-f93275b9c3bb" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934721    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb95820-2c13-4907-a271-f93275b9c3bb" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934732    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934737    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934749    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d49d700-6028-46d4-ad5d-4be2d50a6b9b" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934753    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d49d700-6028-46d4-ad5d-4be2d50a6b9b" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934759    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c9ba36-c82d-4d8e-91db-16b404e6346e" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934764    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c9ba36-c82d-4d8e-91db-16b404e6346e" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934770    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e93b169-0896-46f7-9bb7-4d3a7195b2c5" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934775    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e93b169-0896-46f7-9bb7-4d3a7195b2c5" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934786    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd8230f6-57e7-4b41-ab32-696515fc1c76" containerName="main"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934791    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd8230f6-57e7-4b41-ab32-696515fc1c76" containerName="main"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934797    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf3cbde-16f8-4caf-914f-db735502259f" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934802    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf3cbde-16f8-4caf-914f-db735502259f" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934850    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd85ca27-bab3-4fae-b19e-99e068b8e8c7" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934857    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d49d700-6028-46d4-ad5d-4be2d50a6b9b" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934862    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf3cbde-16f8-4caf-914f-db735502259f" containerName="payload-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934869    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8625ff5f-0ca4-4202-a584-08a0bfc8a1a6" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934874    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb95820-2c13-4907-a271-f93275b9c3bb" containerName="payload-pre-processing"
Aug 05 20:01:33.934861 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934878    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e93b169-0896-46f7-9bb7-4d3a7195b2c5" containerName="payload-processing"
Aug 05 20:01:33.935659 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934884    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0c9ba36-c82d-4d8e-91db-16b404e6346e" containerName="payload-processing"
Aug 05 20:01:33.935659 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.934891    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd8230f6-57e7-4b41-ab32-696515fc1c76" containerName="main"
Aug 05 20:01:33.937776 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.937755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:33.940173 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.940152    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w6vfb\"/\"default-dockercfg-zvhjt\""
Aug 05 20:01:33.940848 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.940832    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vfb\"/\"kube-root-ca.crt\""
Aug 05 20:01:33.940918 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.940874    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vfb\"/\"openshift-service-ca.crt\""
Aug 05 20:01:33.947699 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.947672    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/must-gather-hdt9s"]
Aug 05 20:01:33.959078 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:33.959028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:34.036112 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.036074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58vml\" (UniqueName: \"kubernetes.io/projected/56a8fafd-3b35-49b0-8f45-6b89e6190165-kube-api-access-58vml\") pod \"must-gather-hdt9s\" (UID: \"56a8fafd-3b35-49b0-8f45-6b89e6190165\") " pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:34.036341 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.036123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56a8fafd-3b35-49b0-8f45-6b89e6190165-must-gather-output\") pod \"must-gather-hdt9s\" (UID: \"56a8fafd-3b35-49b0-8f45-6b89e6190165\") " pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:34.053590 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.053551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log" limit=1024
Aug 05 20:01:34.137411 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.137376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56a8fafd-3b35-49b0-8f45-6b89e6190165-must-gather-output\") pod \"must-gather-hdt9s\" (UID: \"56a8fafd-3b35-49b0-8f45-6b89e6190165\") " pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:34.137601 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.137465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58vml\" (UniqueName: \"kubernetes.io/projected/56a8fafd-3b35-49b0-8f45-6b89e6190165-kube-api-access-58vml\") pod \"must-gather-hdt9s\" (UID: \"56a8fafd-3b35-49b0-8f45-6b89e6190165\") " pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:34.137776 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.137754    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56a8fafd-3b35-49b0-8f45-6b89e6190165-must-gather-output\") pod \"must-gather-hdt9s\" (UID: \"56a8fafd-3b35-49b0-8f45-6b89e6190165\") " pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:34.146542 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.146512    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58vml\" (UniqueName: \"kubernetes.io/projected/56a8fafd-3b35-49b0-8f45-6b89e6190165-kube-api-access-58vml\") pod \"must-gather-hdt9s\" (UID: \"56a8fafd-3b35-49b0-8f45-6b89e6190165\") " pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:34.247576 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.247493    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/must-gather-hdt9s"
Aug 05 20:01:34.380471 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.380416    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/must-gather-hdt9s"]
Aug 05 20:01:34.383115 ip-10-0-133-67 kubenswrapper[2558]: W0805 20:01:34.383086    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56a8fafd_3b35_49b0_8f45_6b89e6190165.slice/crio-01e746acda96d1326737222cd4e8455dfd81d47938e3d499d763103e7018bf9f WatchSource:0}: Error finding container 01e746acda96d1326737222cd4e8455dfd81d47938e3d499d763103e7018bf9f: Status 404 returned error can't find the container with id 01e746acda96d1326737222cd4e8455dfd81d47938e3d499d763103e7018bf9f
Aug 05 20:01:34.384893 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.384876    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 20:01:34.808423 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:34.808393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/must-gather-hdt9s" event={"ID":"56a8fafd-3b35-49b0-8f45-6b89e6190165","Type":"ContainerStarted","Data":"01e746acda96d1326737222cd4e8455dfd81d47938e3d499d763103e7018bf9f"}
Aug 05 20:01:35.817921 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:35.817881    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/must-gather-hdt9s" event={"ID":"56a8fafd-3b35-49b0-8f45-6b89e6190165","Type":"ContainerStarted","Data":"c59fcefaf743bad57f28577e0f1959931afd3426427c7263313f7ff273393f23"}
Aug 05 20:01:35.818415 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:35.817936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/must-gather-hdt9s" event={"ID":"56a8fafd-3b35-49b0-8f45-6b89e6190165","Type":"ContainerStarted","Data":"88b5e237337ae42a6d6007748a487e5feaf524a71a5530d5a7e833292c62b46b"}
Aug 05 20:01:35.834744 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:35.834687    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w6vfb/must-gather-hdt9s" podStartSLOduration=1.9150153460000001 podStartE2EDuration="2.834664976s" totalImagesPullingTime="919.64963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 20:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 20:01:35.832957859 +0000 UTC m=+3591.884445552" watchObservedRunningTime="2026-08-05 20:01:35.834664976 +0000 UTC m=+3591.886152669"
Aug 05 20:01:36.835229 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:36.835204    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bp8tx_bee8cc76-3bea-4cb9-ac15-a9de8deadbea/global-pull-secret-syncer/0.log"
Aug 05 20:01:36.969893 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:36.969861    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-485xc_b085e157-f603-495e-bdf9-444933187a8d/konnectivity-agent/0.log"
Aug 05 20:01:37.089159 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:37.089084    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-67.ec2.internal_300ceb00d8c140e964e4979aab4ccdce/haproxy/0.log"
Aug 05 20:01:42.392252 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:42.391854    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68955bc4bc-m4gfh_c9ecc895-05c8-4302-9d3a-cb75c2c22d07/authorino/0.log"
Aug 05 20:01:42.626205 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:42.625174    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-snnzx_b0be61f5-fa79-4d68-ad27-8cf611120bd3/manager/0.log"
Aug 05 20:01:42.647285 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:42.647205    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-cf95j_953cfa8e-62e2-4d3b-8b18-58335776a9cf/limitador/0.log"
Aug 05 20:01:44.467573 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.467419    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lb9bt_0909b5ab-02c0-40e3-b9a4-88c2e32ae178/kube-state-metrics/0.log"
Aug 05 20:01:44.505992 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.505931    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lb9bt_0909b5ab-02c0-40e3-b9a4-88c2e32ae178/kube-rbac-proxy-main/0.log"
Aug 05 20:01:44.547777 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.547581    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lb9bt_0909b5ab-02c0-40e3-b9a4-88c2e32ae178/kube-rbac-proxy-self/0.log"
Aug 05 20:01:44.794297 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.794264    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsdpr_55f3971a-8a9d-4046-8497-afe8eaa42827/node-exporter/0.log"
Aug 05 20:01:44.819299 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.819272    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsdpr_55f3971a-8a9d-4046-8497-afe8eaa42827/kube-rbac-proxy/0.log"
Aug 05 20:01:44.844759 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.844732    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsdpr_55f3971a-8a9d-4046-8497-afe8eaa42827/init-textfile/0.log"
Aug 05 20:01:44.878092 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.878058    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-rn5f8_a442431e-1e6f-4462-b803-dda1c4d55397/kube-rbac-proxy-main/0.log"
Aug 05 20:01:44.903204 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.902695    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-rn5f8_a442431e-1e6f-4462-b803-dda1c4d55397/kube-rbac-proxy-self/0.log"
Aug 05 20:01:44.932516 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.932457    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-rn5f8_a442431e-1e6f-4462-b803-dda1c4d55397/openshift-state-metrics/0.log"
Aug 05 20:01:44.976150 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:44.976122    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9/prometheus/0.log"
Aug 05 20:01:45.009044 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.008977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9/config-reloader/0.log"
Aug 05 20:01:45.033831 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.033804    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9/thanos-sidecar/0.log"
Aug 05 20:01:45.057924 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.057813    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9/kube-rbac-proxy-web/0.log"
Aug 05 20:01:45.084574 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.084539    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9/kube-rbac-proxy/0.log"
Aug 05 20:01:45.110205 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.110152    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9/kube-rbac-proxy-thanos/0.log"
Aug 05 20:01:45.132291 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.132226    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f25ab7d8-f160-4ea8-8ced-6dd94f40b0b9/init-config-reloader/0.log"
Aug 05 20:01:45.167006 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.166955    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-9vjq2_39c6520a-bad2-4976-8896-68b523145709/prometheus-operator/0.log"
Aug 05 20:01:45.188636 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.188604    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-9vjq2_39c6520a-bad2-4976-8896-68b523145709/kube-rbac-proxy/0.log"
Aug 05 20:01:45.225630 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:45.225535    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-527nz_b8ec1e6b-41e8-4340-b2d1-67b8b9d6a9cd/prometheus-operator-admission-webhook/0.log"
Aug 05 20:01:47.119042 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.118990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"]
Aug 05 20:01:47.127322 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.127283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.129777 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.129749    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"]
Aug 05 20:01:47.281493 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.281458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-lib-modules\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.281762 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.281745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kmp\" (UniqueName: \"kubernetes.io/projected/053760b5-779c-4d26-8913-6ba201a0a91c-kube-api-access-v7kmp\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.281874 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.281859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-sys\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.281977 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.281965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-proc\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.282161 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.282147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-podres\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.382962 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.382878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kmp\" (UniqueName: \"kubernetes.io/projected/053760b5-779c-4d26-8913-6ba201a0a91c-kube-api-access-v7kmp\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.382962 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.382917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-sys\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.382962 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.382932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-proc\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.383297 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.383002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-podres\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.383297 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.383018    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-sys\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.383297 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.383055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-lib-modules\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.383297 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.383101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-proc\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.383297 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.383146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-podres\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.383297 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.383216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/053760b5-779c-4d26-8913-6ba201a0a91c-lib-modules\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.391684 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.391651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kmp\" (UniqueName: \"kubernetes.io/projected/053760b5-779c-4d26-8913-6ba201a0a91c-kube-api-access-v7kmp\") pod \"perf-node-gather-daemonset-mvdsb\" (UID: \"053760b5-779c-4d26-8913-6ba201a0a91c\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.442682 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.442643    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.637222 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.637112    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"]
Aug 05 20:01:47.917749 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.917657    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb" event={"ID":"053760b5-779c-4d26-8913-6ba201a0a91c","Type":"ContainerStarted","Data":"fe5d3f71a3a16dee294f49a20fb82f21a1daa77130cb35aced92e6c517f98359"}
Aug 05 20:01:47.917749 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.917724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb" event={"ID":"053760b5-779c-4d26-8913-6ba201a0a91c","Type":"ContainerStarted","Data":"4140d5b73f579b68bbf309edd95729724bde8377aab60890283bc0582027d22d"}
Aug 05 20:01:47.917998 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.917903    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:47.933464 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.933394    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb" podStartSLOduration=0.933373359 podStartE2EDuration="933.373359ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 20:01:47.932340205 +0000 UTC m=+3603.983827899" watchObservedRunningTime="2026-08-05 20:01:47.933373359 +0000 UTC m=+3603.984861051"
Aug 05 20:01:47.971957 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:47.971924    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f4b88f4d5-gg627_3b29ef4c-fa02-4f47-a94f-f7e8e79f7743/console/0.log"
Aug 05 20:01:49.678130 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:49.678093    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8vl7_c28d8d99-35ea-49e3-a327-964b9d63b870/dns/0.log"
Aug 05 20:01:49.701102 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:49.701077    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8vl7_c28d8d99-35ea-49e3-a327-964b9d63b870/kube-rbac-proxy/0.log"
Aug 05 20:01:49.867454 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:49.867420    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4tck_9c44f229-aabd-42ce-bdb0-19ce7a2a1c34/dns-node-resolver/0.log"
Aug 05 20:01:50.450575 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:50.450500    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6mts_55f8a755-15c7-4719-8733-88c25d7fd7d6/node-ca/0.log"
Aug 05 20:01:51.598934 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:51.598905    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-r4xkj_24a0cf82-dc5c-44a9-9ce1-077a7438bac8/kube-auth-proxy/0.log"
Aug 05 20:01:52.513531 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:52.513499    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bzq5_deb30e3e-6611-4d30-a64d-a2ea5f7d709b/serve-healthcheck-canary/0.log"
Aug 05 20:01:53.125447 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:53.125416    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c9v7_dd084fc2-3ef8-4d1a-be0d-3d0347d812c0/kube-rbac-proxy/0.log"
Aug 05 20:01:53.146240 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:53.146215    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c9v7_dd084fc2-3ef8-4d1a-be0d-3d0347d812c0/exporter/0.log"
Aug 05 20:01:53.168117 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:53.168086    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c9v7_dd084fc2-3ef8-4d1a-be0d-3d0347d812c0/extractor/0.log"
Aug 05 20:01:53.936005 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:53.935964    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-mvdsb"
Aug 05 20:01:55.831107 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:55.831076    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-88dts_357fca42-3f1f-4a1f-889b-c93c893fd0e8/manager/0.log"
Aug 05 20:01:55.851702 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:55.851681    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-88dts_357fca42-3f1f-4a1f-889b-c93c893fd0e8/copy-manifests/0.log"
Aug 05 20:01:57.412510 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:57.412481    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bf99ddcb-8dczr_20ade799-4eba-4c0e-adff-456c5fee5e01/manager/0.log"
Aug 05 20:01:57.468511 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:57.468483    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dh4x5_b2f6103b-a125-40d3-a547-7a1e09822d6b/openshift-lws-operator/0.log"
Aug 05 20:01:57.936378 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:57.936350    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-r4xkj_24a0cf82-dc5c-44a9-9ce1-077a7438bac8/kube-auth-proxy/0.log"
Aug 05 20:01:59.622914 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:01:59.622846    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-r4xkj_24a0cf82-dc5c-44a9-9ce1-077a7438bac8/kube-auth-proxy/0.log"
Aug 05 20:02:03.792843 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:03.792808    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8s22f_73fd2155-1e97-4286-9fc6-217dbdd53c9e/kube-multus/0.log"
Aug 05 20:02:04.116884 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.116850    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qs29m_4e2df668-b1e8-46fa-a223-b46caf31083a/kube-multus-additional-cni-plugins/0.log"
Aug 05 20:02:04.140084 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.140053    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qs29m_4e2df668-b1e8-46fa-a223-b46caf31083a/egress-router-binary-copy/0.log"
Aug 05 20:02:04.159874 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.159852    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qs29m_4e2df668-b1e8-46fa-a223-b46caf31083a/cni-plugins/0.log"
Aug 05 20:02:04.179597 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.179571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qs29m_4e2df668-b1e8-46fa-a223-b46caf31083a/bond-cni-plugin/0.log"
Aug 05 20:02:04.202021 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.201996    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qs29m_4e2df668-b1e8-46fa-a223-b46caf31083a/routeoverride-cni/0.log"
Aug 05 20:02:04.222225 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.222198    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qs29m_4e2df668-b1e8-46fa-a223-b46caf31083a/whereabouts-cni-bincopy/0.log"
Aug 05 20:02:04.247611 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.247579    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qs29m_4e2df668-b1e8-46fa-a223-b46caf31083a/whereabouts-cni/0.log"
Aug 05 20:02:04.427986 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.427901    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v45rm_9a8275bb-663f-4f94-9e4f-295070eeac5c/network-metrics-daemon/0.log"
Aug 05 20:02:04.445059 ip-10-0-133-67 kubenswrapper[2558]: I0805 20:02:04.445030    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v45rm_9a8275bb-663f-4f94-9e4f-295070eeac5c/kube-rbac-proxy/0.log"