Sep 17 17:31:30.739802 ip-10-0-133-160 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 17:31:34.187194 ip-10-0-133-160 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:31:34.187194 ip-10-0-133-160 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 17:31:34.187194 ip-10-0-133-160 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:31:34.187194 ip-10-0-133-160 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 17:31:34.187194 ip-10-0-133-160 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:31:34.187967 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.187265    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 17:31:34.191630 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191607    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:34.191630 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191623    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:34.191630 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191627    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:34.191630 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191631    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:34.191630 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191634    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:34.191630 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191638    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191641    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191644    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191647    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191650    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191653    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191656    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191659    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191661    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191664    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191667    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191670    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191672    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191674    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191677    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191679    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191682    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191685    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191687    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191690    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:34.191846 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191693    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191695    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191698    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191700    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191703    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191705    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191708    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191711    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191713    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191716    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191718    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191721    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191724    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191726    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191730    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191733    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191737    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191740    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191742    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191745    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:34.192323 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191747    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191750    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191753    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191755    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191758    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191763    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191767    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191770    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191773    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191776    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191778    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191781    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191784    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191787    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191789    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191792    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191795    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191798    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191801    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:34.192835 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191803    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191807    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191809    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191812    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191814    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191817    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191819    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191823    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191825    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191828    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191831    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191833    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191836    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191838    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191841    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191843    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191846    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191848    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191851    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191854    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:34.193296 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191857    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191860    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191864    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191867    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191871    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191875    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191877    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191880    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191884    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191886    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191889    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191892    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191895    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191898    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.191900    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192641    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192649    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192652    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192655    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:34.193822 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192659    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192662    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192666    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192668    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192671    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192673    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192676    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192679    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192681    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192684    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192687    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192689    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192692    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192695    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192698    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192701    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192703    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192706    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192708    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:34.194281 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192711    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192715    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192718    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192722    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192725    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192728    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192731    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192733    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192736    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192739    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192742    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192745    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192748    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192751    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192755    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192757    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192760    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192763    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192765    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192768    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:34.194764 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192771    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192773    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192776    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192778    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192781    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192783    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192786    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192789    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192792    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192805    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192809    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192812    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192814    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192817    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192820    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192823    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192826    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192828    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192831    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192834    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:34.195254 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192838    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192842    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192844    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192847    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192850    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192855    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192858    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192860    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192863    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192867    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192870    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192873    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192876    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192879    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192882    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192885    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192889    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192891    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192894    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:34.195757 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192896    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192900    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192903    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192906    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192909    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192912    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192914    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192917    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192920    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192923    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192925    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192928    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192930    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192933    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192936    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192938    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.192941    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193321    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193327    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193330    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:34.196250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193332    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193335    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193339    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193341    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193344    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193347    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193349    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193352    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193355    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193357    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193360    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193362    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193365    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193368    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193371    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193375    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193379    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193383    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193386    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:34.196753 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193389    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193392    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193394    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193397    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193400    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193403    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193406    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193409    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193412    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193415    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193420    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193423    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193426    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193429    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193432    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193435    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193438    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193441    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193443    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193446    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:34.197231 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193448    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193451    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193453    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193456    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193459    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193462    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193464    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193467    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193470    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193473    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193475    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193478    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193480    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193483    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193486    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193489    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193491    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193494    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193496    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193499    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:34.197821 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193501    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193504    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193508    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193510    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193513    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193528    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193531    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193533    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193536    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193538    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193541    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193543    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193546    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193549    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193552    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193554    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193557    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193559    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193562    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193565    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:34.198324 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193570    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193572    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193575    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193578    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193582    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193585    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193588    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193590    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193593    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193596    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193598    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193601    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193604    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193606    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193610    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193613    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.193616    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193693    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193726    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193731    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193736    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 17:31:34.198831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193740    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193743    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193748    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193753    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193757    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193759    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193763    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193766    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193769    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193772    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193775    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193778    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193786    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193789    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193793    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193796    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193799    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193802    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193805    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193809    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193812    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193815    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193818    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193821    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 17:31:34.199383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193824    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193828    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193832    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193835    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193839    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193842    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193845    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193848    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193850    2559 flags.go:64] FLAG: --enable-server="true"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193853    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193857    2559 flags.go:64] FLAG: --event-burst="100"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193862    2559 flags.go:64] FLAG: --event-qps="50"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193864    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193867    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193870    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193874    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193877    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193880    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193882    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193886    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193888    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193892    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193895    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193897    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193900    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 17:31:34.199978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193903    2559 flags.go:64] FLAG: --feature-gates=""
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193907    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193910    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193912    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193915    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193918    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193921    2559 flags.go:64] FLAG: --help="false"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193924    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193928    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193931    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193934    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193937    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193940    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193943    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193946    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193948    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193951    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193954    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193958    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193961    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193964    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193967    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193970    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193972    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 17:31:34.200644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193975    2559 flags.go:64] FLAG: --lock-file=""
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193978    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193981    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193984    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193989    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193992    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193995    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.193998    2559 flags.go:64] FLAG: --logging-format="text"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194001    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194004    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194007    2559 flags.go:64] FLAG: --manifest-url=""
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194009    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194014    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194017    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194021    2559 flags.go:64] FLAG: --max-pods="110"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194023    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194027    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194030    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194033    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194036    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194039    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194042    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194049    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194052    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194055    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 17:31:34.201237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194058    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194062    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194067    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194070    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194073    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194076    2559 flags.go:64] FLAG: --port="10250"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194079    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194082    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac80acc656da5cf3"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194085    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194088    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194091    2559 flags.go:64] FLAG: --register-node="true"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194094    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194097    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194101    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194104    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194106    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194110    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194113    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194116    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194119    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194121    2559 flags.go:64] FLAG: --runonce="false"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194124    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194127    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194130    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194133    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 17:31:34.201867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194136    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194139    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194142    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194145    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194148    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194150    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194153    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194156    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194160    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194163    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194166    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194171    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194174    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194177    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194181    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194184    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194186    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194189    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194192    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194195    2559 flags.go:64] FLAG: --v="2"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194199    2559 flags.go:64] FLAG: --version="false"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194203    2559 flags.go:64] FLAG: --vmodule=""
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194206    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194210    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194336    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:34.202484 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194340    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194344    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194347    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194349    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194352    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194355    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194358    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194360    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194363    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194365    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194368    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194371    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194373    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194376    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194378    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194382    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194385    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194388    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194390    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194393    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:34.203146 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194395    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194398    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194400    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194403    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194405    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194408    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194410    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194413    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194415    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194419    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194422    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194426    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194429    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194432    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194434    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194437    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194440    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194443    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194448    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:34.203655 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194451    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194455    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194458    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194460    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194463    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194466    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194468    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194471    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194475    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194477    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194480    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194483    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194485    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194488    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194490    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194504    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194507    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194510    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194512    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194526    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:34.204112 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194529    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194532    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194534    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194537    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194540    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194543    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194545    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194548    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194552    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194555    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194558    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194562    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194565    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194568    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194571    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194574    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194577    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194579    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194582    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:34.204599 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194585    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194589    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194592    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194595    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194598    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194601    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194603    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194606    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194608    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194611    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194614    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194616    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194619    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194621    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194624    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194627    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194630    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194633    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194635    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:34.205067 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.194638    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.194646    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.201552    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.201569    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.201588    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.201594    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201650    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201656    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201660    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201664    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201667    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201671    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201674    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201677    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:34.205664 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201680    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201682    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201685    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201688    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201691    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201693    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201696    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201698    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201702    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201704    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201707    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201710    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201714    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201718    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201721    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201724    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201727    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201729    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201732    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:34.206065 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201735    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201739    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201742    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201745    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201747    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201750    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201753    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201756    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201759    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201761    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201764    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201767    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201770    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201772    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201775    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201778    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201781    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201783    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201786    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201789    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:34.206587 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201792    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201794    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201797    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201800    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201803    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201806    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201809    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201811    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201814    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201817    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201819    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201822    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201825    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201829    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201832    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201835    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201838    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201841    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201843    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:34.207066 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201846    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201849    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201851    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201854    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201856    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201859    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201862    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201864    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201867    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201870    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201872    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201875    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201878    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201881    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201884    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201887    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201889    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201892    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201895    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201898    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:34.207541 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201900    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201903    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201906    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201908    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201911    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201913    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201917    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201919    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201922    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201925    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201928    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201930    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.201933    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.201938    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202047    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:31:34.208033 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202052    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202055    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202059    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202062    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202064    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202067    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202070    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202072    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202075    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202078    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202080    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202083    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202086    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202089    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202092    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202094    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202097    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202099    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202102    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:31:34.208404 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202105    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202107    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202110    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202112    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202115    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202117    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202120    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202123    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202126    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202128    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202131    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202134    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202136    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202139    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202141    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202144    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202147    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202149    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202152    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202155    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:31:34.208888 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202157    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202160    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202163    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202165    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202168    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202171    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202174    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202177    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202179    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202182    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202185    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202187    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202190    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202193    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202196    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202199    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202202    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202205    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202207    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202210    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:31:34.209373 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202212    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202216    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202219    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202221    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202224    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202227    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202229    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202232    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202234    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202237    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202240    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202244    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202247    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202250    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202253    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202256    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202259    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202262    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202265    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202268    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:31:34.209891 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202271    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202274    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202277    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202281    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202283    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202286    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202289    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202291    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202294    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202297    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202299    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202302    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202304    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202307    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202310    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202312    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202315    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202317    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:31:34.210378 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:34.202320    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:31:34.211236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.202325    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:31:34.211236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.202437    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 17:31:34.211236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.204426    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 17:31:34.211236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.205452    2559 server.go:1019] "Starting client certificate rotation"
Sep 17 17:31:34.211236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.205549    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:31:34.211236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.205592    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:31:34.211236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.208547    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:31:34.212391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.212155    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:31:34.216593 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.216577    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 17 17:31:34.221876 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.221862    2559 log.go:25] "Validated CRI v1 image API"
Sep 17 17:31:34.222758 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.222741    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 17:31:34.225883 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.225866    2559 fs.go:135] Filesystem UUIDs: map[614a5622-e3d6-4a25-95c3-81a219bdd517:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a8dae13e-16a4-4fa0-85ff-c09e772180e2:/dev/nvme0n1p4]
Sep 17 17:31:34.225938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.225883    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 17:31:34.230071 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.229968    2559 manager.go:216] Machine: {Timestamp:2026-09-17 17:31:34.229486432 +0000 UTC m=+2.007324058 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100040 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20595f826f2e28130d192b5c8c8ae0 SystemUUID:ec20595f-826f-2e28-130d-192b5c8c8ae0 BootID:5e0df99c-95af-4fac-82cf-4dffe65d3d63 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d9:69:ef:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d9:69:ef:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:19:a3:d4:7b:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 17:31:34.230071 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.230067    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 17:31:34.230187 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.230139    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 17:31:34.232031 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.232011    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 17:31:34.232168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.232034    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 17:31:34.233186 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.233176    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 17:31:34.233237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.233188    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 17:31:34.233237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.233195    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:31:34.233237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.233213    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:31:34.233322 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.233283    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 17:31:34.236325 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236314    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:31:34.236444 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236434    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 17:31:34.236487 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236467    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 17:31:34.236487 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236483    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 17:31:34.236571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236494    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 17:31:34.236571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236504    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 17 17:31:34.236571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236512    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 17:31:34.236861 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236849    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:31:34.236899 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.236876    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:31:34.241733 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.241717    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 17:31:34.243933 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.243908    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 17:31:34.244015 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.243948    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 17:31:34.244377 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.244354    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:31:34.244964 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.244950    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 17:31:34.245019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.244969    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 17:31:34.245019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.244977    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 17:31:34.245019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.244984    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 17:31:34.245019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.244995    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 17:31:34.245019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245000    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 17:31:34.245019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245015    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 17:31:34.245019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245020    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 17:31:34.245278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245035    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 17:31:34.245278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245041    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 17:31:34.245278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245052    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 17:31:34.245278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245060    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 17:31:34.245278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245082    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 17:31:34.245278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.245087    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 17:31:34.249894 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.249861    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 17:31:34.250009 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.249908    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 17:31:34.250101 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.250081    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 17:31:34.250402 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.250389    2559 server.go:1268] "Started kubelet"
Sep 17 17:31:34.250491 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.250457    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 17:31:34.250564 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.250496    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 17:31:34.250610 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.250590    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 17:31:34.251306 ip-10-0-133-160 systemd[1]: Started Kubernetes Kubelet.
Sep 17 17:31:34.251995 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.251487    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 17:31:34.251995 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.251623    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 17:31:34.256383 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.256357    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 17:31:34.257908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.257895    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 17:31:34.257980 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.257915    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 17:31:34.258113 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.258078    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.258532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.258457    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 17:31:34.258532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.258458    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 17:31:34.258532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.258498    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 17:31:34.258702 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.258610    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 17:31:34.258702 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.258618    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 17:31:34.258965 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.258948    2559 factory.go:55] Registering systemd factory
Sep 17 17:31:34.258965 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.258967    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 17 17:31:34.259195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.259180    2559 factory.go:153] Registering CRI-O factory
Sep 17 17:31:34.259254 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.259197    2559 factory.go:223] Registration of the crio container factory successfully
Sep 17 17:31:34.259305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.259258    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 17:31:34.259305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.259289    2559 factory.go:103] Registering Raw factory
Sep 17 17:31:34.259305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.259304    2559 manager.go:1196] Started watching for new ooms in manager
Sep 17 17:31:34.259939 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.259924    2559 manager.go:349] Starting recovery of all containers
Sep 17 17:31:34.260979 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.260949    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 17:31:34.261146 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.261106    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 17:31:34.282356 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.282333    2559 manager.go:354] Recovery completed
Sep 17 17:31:34.286908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.286893    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:34.288477 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.287544    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-160.ec2.internal.18d62c0337482af0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-160.ec2.internal,UID:ip-10-0-133-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-160.ec2.internal,},FirstTimestamp:2026-09-17 17:31:34.250351344 +0000 UTC m=+2.028188969,LastTimestamp:2026-09-17 17:31:34.250351344 +0000 UTC m=+2.028188969,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-160.ec2.internal,}"
Sep 17 17:31:34.288892 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.288876    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:34.288958 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.288907    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:34.288958 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.288920    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:34.289499 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.289479    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 17:31:34.289499 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.289492    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 17:31:34.289634 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.289511    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:31:34.289634 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.289535    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:34.290247 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.290228    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:34.290314 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.290263    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:34.290314 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.290275    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:34.290673 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.290631    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mh6gb"
Sep 17 17:31:34.290790 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.290779    2559 policy_none.go:49] "None policy: Start"
Sep 17 17:31:34.290825 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.290796    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 17:31:34.290825 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.290807    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 17:31:34.292148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.292133    2559 policy_none.go:47] "Start"
Sep 17 17:31:34.301895 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.301824    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-160.ec2.internal.18d62c033994427b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-160.ec2.internal,UID:ip-10-0-133-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-160.ec2.internal,},FirstTimestamp:2026-09-17 17:31:34.288892539 +0000 UTC m=+2.066730166,LastTimestamp:2026-09-17 17:31:34.288892539 +0000 UTC m=+2.066730166,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-160.ec2.internal,}"
Sep 17 17:31:34.307044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.307022    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mh6gb"
Sep 17 17:31:34.309527 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.309430    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-160.ec2.internal.18d62c0339949709  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-160.ec2.internal,UID:ip-10-0-133-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-160.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-160.ec2.internal,},FirstTimestamp:2026-09-17 17:31:34.288914185 +0000 UTC m=+2.066751814,LastTimestamp:2026-09-17 17:31:34.288914185 +0000 UTC m=+2.066751814,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-160.ec2.internal,}"
Sep 17 17:31:34.312550 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.312445    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-160.ec2.internal.18d62c033994c014  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-160.ec2.internal,UID:ip-10-0-133-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-160.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-160.ec2.internal,},FirstTimestamp:2026-09-17 17:31:34.288924692 +0000 UTC m=+2.066762318,LastTimestamp:2026-09-17 17:31:34.288924692 +0000 UTC m=+2.066762318,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-160.ec2.internal,}"
Sep 17 17:31:34.332145 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.332126    2559 manager.go:337] "Starting Device Plugin manager"
Sep 17 17:31:34.332248 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.332178    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 17:31:34.332248 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.332194    2559 server.go:87] "Starting device plugin registration server"
Sep 17 17:31:34.332443 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.332432    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 17:31:34.332489 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.332453    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 17:31:34.332739 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.332548    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 17:31:34.332869 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.332823    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 17:31:34.332869 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.332836    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 17:31:34.333246 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.333228    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 17:31:34.333302 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.333272    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.391650 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.391613    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 17:31:34.392768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.392746    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 17:31:34.392824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.392807    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 17:31:34.392868 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.392832    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 17:31:34.392912 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.392903    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 17:31:34.395444 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.395423    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:34.432584 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.432556    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:34.433507 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.433490    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:34.433610 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.433529    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:34.433610 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.433546    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:34.433610 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.433571    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.441629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.441589    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.441629 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.441610    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-160.ec2.internal\": node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.466908 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.466880    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.494064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.494027    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"]
Sep 17 17:31:34.494162 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.494104    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:34.495122 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.495107    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:34.495215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.495141    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:34.495215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.495156    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:34.496423 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.496407    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:34.496567 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.496552    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.496621 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.496589    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:34.497229 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.497196    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:34.497229 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.497227    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:34.497369 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.497201    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:34.497369 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.497243    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:34.497369 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.497257    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:34.497369 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.497272    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:34.498401 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.498388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.498440 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.498410    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:34.499009 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.498991    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:34.499088 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.499017    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:34.499088 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.499028    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:34.524220 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.524200    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-160.ec2.internal\" not found" node="ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.528703 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.528685    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-160.ec2.internal\" not found" node="ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.560300 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.560272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7b7a7384449df783f830280a3100b44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-160.ec2.internal\" (UID: \"c7b7a7384449df783f830280a3100b44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.560408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.560309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.560408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.560357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.566941 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.566921    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.660510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.660488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.660621 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.660531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.660621 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.660550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7b7a7384449df783f830280a3100b44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-160.ec2.internal\" (UID: \"c7b7a7384449df783f830280a3100b44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.660621 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.660582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.660621 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.660614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.660747 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.660615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7b7a7384449df783f830280a3100b44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-160.ec2.internal\" (UID: \"c7b7a7384449df783f830280a3100b44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.667574 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.667556    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.768411 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.768384    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.827598 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.827562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.832113 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:34.831940    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:34.869269 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.869237    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:34.969848 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:34.969815    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:35.070311 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:35.070240    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:35.170829 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:35.170799    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:35.204980 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.204953    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 17:31:35.205397 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.205086    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 17:31:35.271038 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:35.271013    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:35.312372 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.312333    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:26:34 +0000 UTC" deadline="2028-04-21 06:13:21.593754301 +0000 UTC"
Sep 17 17:31:35.312372 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.312376    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13956h41m46.281381581s"
Sep 17 17:31:35.371966 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:35.371900    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:35.471598 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:35.471564    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732aa783476ab15c97c9ae702301de31.slice/crio-3adf485eed4c35ca67dece12657e70417df97b89fd5125eeb3d5098043848d98 WatchSource:0}: Error finding container 3adf485eed4c35ca67dece12657e70417df97b89fd5125eeb3d5098043848d98: Status 404 returned error can't find the container with id 3adf485eed4c35ca67dece12657e70417df97b89fd5125eeb3d5098043848d98
Sep 17 17:31:35.471954 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:35.471939    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 17 17:31:35.472012 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:35.471963    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b7a7384449df783f830280a3100b44.slice/crio-97e4314e2e7f2aa05341ec16b4c1d86aa42300d8d1c1b1ae3a225cb059c339f9 WatchSource:0}: Error finding container 97e4314e2e7f2aa05341ec16b4c1d86aa42300d8d1c1b1ae3a225cb059c339f9: Status 404 returned error can't find the container with id 97e4314e2e7f2aa05341ec16b4c1d86aa42300d8d1c1b1ae3a225cb059c339f9
Sep 17 17:31:35.479681 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.479667    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:31:35.500497 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.500477    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:31:35.501330 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.501316    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:31:35.501390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.501343    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:31:35.501390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.501354    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:31:35.523576 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.523557    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:35.559019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.558998    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:35.567633 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.567609    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:31:35.569166 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.569153    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 17 17:31:35.581397 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.581383    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:31:35.647297 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.647235    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:35.732083 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:35.732057    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:36.237584 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.237548    2559 apiserver.go:52] "Watching apiserver"
Sep 17 17:31:36.245586 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.245558    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 17:31:36.245955 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.245925    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-88nns","kube-system/global-pull-secret-syncer-q4x64","kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk","openshift-cluster-node-tuning-operator/tuned-jcvv5","openshift-image-registry/node-ca-lb54v","openshift-multus/multus-additional-cni-plugins-qld8b","openshift-multus/multus-ktffb","openshift-multus/network-metrics-daemon-tv9r5","kube-system/konnectivity-agent-7gbrd","openshift-dns/node-resolver-rsfzf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal","openshift-network-diagnostics/network-check-target-l8mpm","openshift-network-operator/iptables-alerter-8bs2p"]
Sep 17 17:31:36.247455 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.247429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.248624 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.248602    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:36.248725 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.248680    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:36.249929 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.249907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.251138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.250691    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 17:31:36.251138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.250811    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bjgfm\""
Sep 17 17:31:36.251138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.250852    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 17:31:36.251138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.250935    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 17:31:36.251138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.251066    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 17:31:36.251138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.251101    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 17:31:36.251581 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.251290    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.253155 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.253000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.253804 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.253786    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v8vpq\""
Sep 17 17:31:36.253899 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.253814    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:31:36.254403 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.254382    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 17:31:36.254778 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.254739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kjffg\""
Sep 17 17:31:36.254843 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.254787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.255243 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.255225    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 17:31:36.255316 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.255302    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 17:31:36.255927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.255911    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 17:31:36.256623 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.256606    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tkjl5\""
Sep 17 17:31:36.256896 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.256879    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 17:31:36.257146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.257012    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:31:36.257146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.257081    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 17:31:36.257853 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.257825    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:36.258006 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.257975    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:36.258095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.258077    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 17:31:36.259045 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.259027    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 17:31:36.259774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.259348    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.259774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.259450    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 17:31:36.260470 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.260449    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5m2wp\""
Sep 17 17:31:36.260700 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.260680    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 17:31:36.260827 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.260806    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.260938 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.260866    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:36.262119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.262101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.263614 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.263601    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.264967 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.264950    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.267445 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.267326    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 17:31:36.267753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.267731    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 17:31:36.267841 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.267824    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 17:31:36.267983 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.267963    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 17:31:36.268076 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.268006    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r767r\""
Sep 17 17:31:36.268829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.268654    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 17:31:36.268829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.268803    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qbmlk\""
Sep 17 17:31:36.268829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.268825    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hk6h6\""
Sep 17 17:31:36.269024 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.268863    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 17:31:36.269024 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.268932    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 17:31:36.269127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.269063    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 17:31:36.269127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.269065    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 17:31:36.269233 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.269137    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 17:31:36.269233 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.269197    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 17:31:36.269413 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.269397    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bm94f\""
Sep 17 17:31:36.270070 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-run\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-var-lib-kubelet\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.270158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.270311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270161    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-registration-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.270311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cd6j\" (UniqueName: \"kubernetes.io/projected/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-kube-api-access-8cd6j\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.270311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysctl-conf\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spf2p\" (UniqueName: \"kubernetes.io/projected/68d45bd7-e033-4fa6-8256-01036f2d28ec-kube-api-access-spf2p\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-tuned\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f70ab124-950a-49c5-bace-36954153b7a8-serviceca\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.270311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckn49\" (UniqueName: \"kubernetes.io/projected/f70ab124-950a-49c5-bace-36954153b7a8-kube-api-access-ckn49\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270322    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-socket-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysctl-d\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-cni-binary-copy\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-systemd-units\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-var-lib-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-log-socket\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d45bd7-e033-4fa6-8256-01036f2d28ec-tmp\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f70ab124-950a-49c5-bace-36954153b7a8-host\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-sys-fs\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85jz6\" (UniqueName: \"kubernetes.io/projected/02327afa-0086-45ea-b42c-25008b885900-kube-api-access-85jz6\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-host-slash\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-modprobe-d\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.270638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysconfig\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-host\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-system-cni-dir\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-cnibin\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-ovn\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-node-log\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-cni-bin\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-cni-netd\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-env-overrides\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.270986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-ovnkube-script-lib\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-sys\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwl26\" (UniqueName: \"kubernetes.io/projected/ad8edb03-2df1-418a-98bb-260f47c43c52-kube-api-access-zwl26\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-run-netns\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-iptables-alerter-script\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-systemd\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-slash\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gslj4\" (UniqueName: \"kubernetes.io/projected/4fee2f26-af6a-47ef-a183-f3414e107775-kube-api-access-gslj4\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-lib-modules\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-etc-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-run-ovn-kubernetes\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02327afa-0086-45ea-b42c-25008b885900-ovn-node-metrics-cert\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-device-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-ovnkube-config\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-kubernetes\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txqzt\" (UniqueName: \"kubernetes.io/projected/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-kube-api-access-txqzt\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.271975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-kubelet\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.272771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.271539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-systemd\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.281844 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.281819    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:31:36.309909 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.309887    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:31:36.318266 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.318243    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6grjl"
Sep 17 17:31:36.328258 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.328237    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6grjl"
Sep 17 17:31:36.359464 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.359392    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 17:31:36.372139 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-iptables-alerter-script\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.372295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372149    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-systemd\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.372295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-slash\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.372295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-cnibin\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.372295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-cni-bin\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.372295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-hostroot\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.372571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372372    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-slash\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.372571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372427    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-multus-certs\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.372571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-systemd\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.372571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gslj4\" (UniqueName: \"kubernetes.io/projected/4fee2f26-af6a-47ef-a183-f3414e107775-kube-api-access-gslj4\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:36.372571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-lib-modules\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.372571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-etc-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-run-ovn-kubernetes\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02327afa-0086-45ea-b42c-25008b885900-ovn-node-metrics-cert\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-cni-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372773    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-iptables-alerter-script\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-run-ovn-kubernetes\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-lib-modules\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-etc-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.372830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-device-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-device-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/830a05c7-e115-47ac-83c4-240716a535a5-agent-certs\") pod \"konnectivity-agent-7gbrd\" (UID: \"830a05c7-e115-47ac-83c4-240716a535a5\") " pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-tmp-dir\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.372992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8229b2b-a44d-4f96-a34a-b269c857681f-kubelet-config\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2dvs\" (UniqueName: \"kubernetes.io/projected/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-kube-api-access-t2dvs\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-ovnkube-config\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-kubernetes\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txqzt\" (UniqueName: \"kubernetes.io/projected/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-kube-api-access-txqzt\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-kubelet\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373128    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-kubernetes\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-systemd\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-run\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373198    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-systemd\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-var-lib-kubelet\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.373332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-registration-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cd6j\" (UniqueName: \"kubernetes.io/projected/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-kube-api-access-8cd6j\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysctl-conf\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spf2p\" (UniqueName: \"kubernetes.io/projected/68d45bd7-e033-4fa6-8256-01036f2d28ec-kube-api-access-spf2p\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-cni-binary-copy\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-kubelet\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373457    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-k8s-cni-cncf-io\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-conf-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-tuned\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-run\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f70ab124-950a-49c5-bace-36954153b7a8-serviceca\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckn49\" (UniqueName: \"kubernetes.io/projected/f70ab124-950a-49c5-bace-36954153b7a8-kube-api-access-ckn49\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-socket-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-hosts-file\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.374127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-netns\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373651    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-ovnkube-config\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-cni-multus\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysctl-d\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-cni-binary-copy\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-systemd-units\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-var-lib-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-log-socket\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysctl-conf\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/830a05c7-e115-47ac-83c4-240716a535a5-konnectivity-ca\") pod \"konnectivity-agent-7gbrd\" (UID: \"830a05c7-e115-47ac-83c4-240716a535a5\") " pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373894    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8229b2b-a44d-4f96-a34a-b269c857681f-dbus\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-kubelet\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d45bd7-e033-4fa6-8256-01036f2d28ec-tmp\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f70ab124-950a-49c5-bace-36954153b7a8-host\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-sys-fs\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374002    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.373710    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.374973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jz6\" (UniqueName: \"kubernetes.io/projected/02327afa-0086-45ea-b42c-25008b885900-kube-api-access-85jz6\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-etc-kubernetes\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-host-slash\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f70ab124-950a-49c5-bace-36954153b7a8-serviceca\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-modprobe-d\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysconfig\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-systemd-units\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-host\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-sys-fs\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-system-cni-dir\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-cnibin\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-system-cni-dir\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-var-lib-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-ovn\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374461    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-log-socket\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:36.375774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-cni-binary-copy\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-registration-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374579    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-socket-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysctl-d\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f70ab124-950a-49c5-bace-36954153b7a8-host\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374655    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-modprobe-d\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374748    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-var-lib-kubelet\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.374764    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374841    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-ovn\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374858    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374885    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-host-slash\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-sysconfig\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-host\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-node-log\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad8edb03-2df1-418a-98bb-260f47c43c52-cnibin\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.374967    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:36.874947264 +0000 UTC m=+4.652784894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.374989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-cni-bin\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.376551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-cni-netd\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-env-overrides\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llrfj\" (UniqueName: \"kubernetes.io/projected/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-kube-api-access-llrfj\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375143    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-node-log\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-socket-dir-parent\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-cni-netd\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-ovnkube-script-lib\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-cni-bin\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-env-overrides\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-sys\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-daemon-config\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02327afa-0086-45ea-b42c-25008b885900-ovnkube-script-lib\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwl26\" (UniqueName: \"kubernetes.io/projected/ad8edb03-2df1-418a-98bb-260f47c43c52-kube-api-access-zwl26\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad8edb03-2df1-418a-98bb-260f47c43c52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-run-netns\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.377354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375821    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.378158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68d45bd7-e033-4fa6-8256-01036f2d28ec-sys\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.378158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-system-cni-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.378158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-host-run-netns\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.378158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.375988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02327afa-0086-45ea-b42c-25008b885900-run-openvswitch\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.378158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.377106    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02327afa-0086-45ea-b42c-25008b885900-ovn-node-metrics-cert\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.378158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.377361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68d45bd7-e033-4fa6-8256-01036f2d28ec-etc-tuned\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.378158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.377454    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d45bd7-e033-4fa6-8256-01036f2d28ec-tmp\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.381985 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.381964    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:36.381985 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.381988    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:36.382174 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.382001    2559 projected.go:196] Error preparing data for projected volume kube-api-access-mbz6v for pod openshift-network-diagnostics/network-check-target-l8mpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:36.382174 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.382061    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v podName:8bc06536-f275-4dde-ada9-edc78d9b110a nodeName:}" failed. No retries permitted until 2026-09-17 17:31:36.882045038 +0000 UTC m=+4.659882654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mbz6v" (UniqueName: "kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v") pod "network-check-target-l8mpm" (UID: "8bc06536-f275-4dde-ada9-edc78d9b110a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:36.387022 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.386995    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gslj4\" (UniqueName: \"kubernetes.io/projected/4fee2f26-af6a-47ef-a183-f3414e107775-kube-api-access-gslj4\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:36.388825 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.388698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txqzt\" (UniqueName: \"kubernetes.io/projected/6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d-kube-api-access-txqzt\") pod \"aws-ebs-csi-driver-node-x4rbk\" (UID: \"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.388928 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.388861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cd6j\" (UniqueName: \"kubernetes.io/projected/bb68c757-b2b5-4194-9b57-4dc8fc67eacb-kube-api-access-8cd6j\") pod \"iptables-alerter-8bs2p\" (UID: \"bb68c757-b2b5-4194-9b57-4dc8fc67eacb\") " pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.390484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.390459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckn49\" (UniqueName: \"kubernetes.io/projected/f70ab124-950a-49c5-bace-36954153b7a8-kube-api-access-ckn49\") pod \"node-ca-lb54v\" (UID: \"f70ab124-950a-49c5-bace-36954153b7a8\") " pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.391185 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.391166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwl26\" (UniqueName: \"kubernetes.io/projected/ad8edb03-2df1-418a-98bb-260f47c43c52-kube-api-access-zwl26\") pod \"multus-additional-cni-plugins-qld8b\" (UID: \"ad8edb03-2df1-418a-98bb-260f47c43c52\") " pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.391985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.391949    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spf2p\" (UniqueName: \"kubernetes.io/projected/68d45bd7-e033-4fa6-8256-01036f2d28ec-kube-api-access-spf2p\") pod \"tuned-jcvv5\" (UID: \"68d45bd7-e033-4fa6-8256-01036f2d28ec\") " pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.391985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.391971    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85jz6\" (UniqueName: \"kubernetes.io/projected/02327afa-0086-45ea-b42c-25008b885900-kube-api-access-85jz6\") pod \"ovnkube-node-88nns\" (UID: \"02327afa-0086-45ea-b42c-25008b885900\") " pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.398408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.398360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal" event={"ID":"c7b7a7384449df783f830280a3100b44","Type":"ContainerStarted","Data":"97e4314e2e7f2aa05341ec16b4c1d86aa42300d8d1c1b1ae3a225cb059c339f9"}
Sep 17 17:31:36.399693 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.399670    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" event={"ID":"732aa783476ab15c97c9ae702301de31","Type":"ContainerStarted","Data":"3adf485eed4c35ca67dece12657e70417df97b89fd5125eeb3d5098043848d98"}
Sep 17 17:31:36.476275 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-cni-binary-copy\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476275 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-k8s-cni-cncf-io\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-conf-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-k8s-cni-cncf-io\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-hosts-file\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-netns\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-cni-multus\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/830a05c7-e115-47ac-83c4-240716a535a5-konnectivity-ca\") pod \"konnectivity-agent-7gbrd\" (UID: \"830a05c7-e115-47ac-83c4-240716a535a5\") " pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8229b2b-a44d-4f96-a34a-b269c857681f-dbus\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476494    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-hosts-file\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.476540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476498    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-conf-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-netns\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-cni-multus\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-kubelet\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-etc-kubernetes\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476681    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llrfj\" (UniqueName: \"kubernetes.io/projected/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-kube-api-access-llrfj\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-kubelet\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476705    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8229b2b-a44d-4f96-a34a-b269c857681f-dbus\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476743    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-etc-kubernetes\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.476806    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-socket-dir-parent\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.476862    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret podName:b8229b2b-a44d-4f96-a34a-b269c857681f nodeName:}" failed. No retries permitted until 2026-09-17 17:31:36.976844517 +0000 UTC m=+4.754682146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret") pod "global-pull-secret-syncer-q4x64" (UID: "b8229b2b-a44d-4f96-a34a-b269c857681f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-socket-dir-parent\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476902    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-daemon-config\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-system-cni-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-cnibin\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-cni-bin\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.476956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-hostroot\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476966    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-cni-binary-copy\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-multus-certs\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.476998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-cni-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/830a05c7-e115-47ac-83c4-240716a535a5-agent-certs\") pod \"konnectivity-agent-7gbrd\" (UID: \"830a05c7-e115-47ac-83c4-240716a535a5\") " pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-tmp-dir\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477037    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-cnibin\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8229b2b-a44d-4f96-a34a-b269c857681f-kubelet-config\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2dvs\" (UniqueName: \"kubernetes.io/projected/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-kube-api-access-t2dvs\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-run-multus-certs\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-host-var-lib-cni-bin\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477084    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/830a05c7-e115-47ac-83c4-240716a535a5-konnectivity-ca\") pod \"konnectivity-agent-7gbrd\" (UID: \"830a05c7-e115-47ac-83c4-240716a535a5\") " pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8229b2b-a44d-4f96-a34a-b269c857681f-kubelet-config\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-cni-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-system-cni-dir\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-hostroot\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-tmp-dir\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.477706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.477553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-multus-daemon-config\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.479748 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.479726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/830a05c7-e115-47ac-83c4-240716a535a5-agent-certs\") pod \"konnectivity-agent-7gbrd\" (UID: \"830a05c7-e115-47ac-83c4-240716a535a5\") " pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.486667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.486645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llrfj\" (UniqueName: \"kubernetes.io/projected/759dded7-4bac-4cfc-bf37-3fa3fb29e77e-kube-api-access-llrfj\") pod \"node-resolver-rsfzf\" (UID: \"759dded7-4bac-4cfc-bf37-3fa3fb29e77e\") " pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.487191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.487173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2dvs\" (UniqueName: \"kubernetes.io/projected/2187be27-fd1a-4ed4-90f1-4af3b8db4e03-kube-api-access-t2dvs\") pod \"multus-ktffb\" (UID: \"2187be27-fd1a-4ed4-90f1-4af3b8db4e03\") " pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.570824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.570782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qld8b"
Sep 17 17:31:36.577173 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.577147    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8bs2p"
Sep 17 17:31:36.587677 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.587651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk"
Sep 17 17:31:36.592659 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.592632    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jcvv5"
Sep 17 17:31:36.601175 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.601156    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lb54v"
Sep 17 17:31:36.607935 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.607914    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:31:36.613445 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.613412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:36.619112 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.619095    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsfzf"
Sep 17 17:31:36.623654 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.623633    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktffb"
Sep 17 17:31:36.879778 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.879697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:36.879946 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.879826    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:36.879946 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.879897    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:37.879878985 +0000 UTC m=+5.657716615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:36.980753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.980717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:36.980903 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:36.980777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:36.980977 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.980894    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:36.981028 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.980976    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret podName:b8229b2b-a44d-4f96-a34a-b269c857681f nodeName:}" failed. No retries permitted until 2026-09-17 17:31:37.980954769 +0000 UTC m=+5.758792391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret") pod "global-pull-secret-syncer-q4x64" (UID: "b8229b2b-a44d-4f96-a34a-b269c857681f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:36.981028 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.980900    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:36.981028 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.981004    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:36.981028 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.981016    2559 projected.go:196] Error preparing data for projected volume kube-api-access-mbz6v for pod openshift-network-diagnostics/network-check-target-l8mpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:36.981228 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:36.981062    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v podName:8bc06536-f275-4dde-ada9-edc78d9b110a nodeName:}" failed. No retries permitted until 2026-09-17 17:31:37.981048907 +0000 UTC m=+5.758886522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbz6v" (UniqueName: "kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v") pod "network-check-target-l8mpm" (UID: "8bc06536-f275-4dde-ada9-edc78d9b110a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:37.288274 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.288244    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759dded7_4bac_4cfc_bf37_3fa3fb29e77e.slice/crio-e53bf1860baf2c1fdc15570c35f5a338c6003c5f8751a607d741a309bba52c7e WatchSource:0}: Error finding container e53bf1860baf2c1fdc15570c35f5a338c6003c5f8751a607d741a309bba52c7e: Status 404 returned error can't find the container with id e53bf1860baf2c1fdc15570c35f5a338c6003c5f8751a607d741a309bba52c7e
Sep 17 17:31:37.288860 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.288708    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2187be27_fd1a_4ed4_90f1_4af3b8db4e03.slice/crio-035e24e1a00b81669ff407c1ee943ee3b2ab09c9025154dda7812bab134016cb WatchSource:0}: Error finding container 035e24e1a00b81669ff407c1ee943ee3b2ab09c9025154dda7812bab134016cb: Status 404 returned error can't find the container with id 035e24e1a00b81669ff407c1ee943ee3b2ab09c9025154dda7812bab134016cb
Sep 17 17:31:37.294794 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.294775    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d45bd7_e033_4fa6_8256_01036f2d28ec.slice/crio-05f61679c10bf22a9783e96e044f77582e5e1879e42567a8a70a30cec3828007 WatchSource:0}: Error finding container 05f61679c10bf22a9783e96e044f77582e5e1879e42567a8a70a30cec3828007: Status 404 returned error can't find the container with id 05f61679c10bf22a9783e96e044f77582e5e1879e42567a8a70a30cec3828007
Sep 17 17:31:37.296064 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.296043    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830a05c7_e115_47ac_83c4_240716a535a5.slice/crio-5f50098520ce0bc64de5274db58b271865e70c1ccd021e8ff2525096ab975171 WatchSource:0}: Error finding container 5f50098520ce0bc64de5274db58b271865e70c1ccd021e8ff2525096ab975171: Status 404 returned error can't find the container with id 5f50098520ce0bc64de5274db58b271865e70c1ccd021e8ff2525096ab975171
Sep 17 17:31:37.297925 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.297906    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02327afa_0086_45ea_b42c_25008b885900.slice/crio-1b84a0a530bd4a81789bc34c72c6a4f3924df019aa3ddf8ed88e83a799e4a957 WatchSource:0}: Error finding container 1b84a0a530bd4a81789bc34c72c6a4f3924df019aa3ddf8ed88e83a799e4a957: Status 404 returned error can't find the container with id 1b84a0a530bd4a81789bc34c72c6a4f3924df019aa3ddf8ed88e83a799e4a957
Sep 17 17:31:37.298292 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.298268    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa44f83_72d1_4a7b_8dc1_b1c702ebfa9d.slice/crio-7f2f894ad47a386dfc9d0ffadc666bd03b5b5b7fdd40f5a33d6f8b9bdf3167df WatchSource:0}: Error finding container 7f2f894ad47a386dfc9d0ffadc666bd03b5b5b7fdd40f5a33d6f8b9bdf3167df: Status 404 returned error can't find the container with id 7f2f894ad47a386dfc9d0ffadc666bd03b5b5b7fdd40f5a33d6f8b9bdf3167df
Sep 17 17:31:37.299101 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.299076    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70ab124_950a_49c5_bace_36954153b7a8.slice/crio-3703eacf95250b60e10013628d6472167ea978098d9f19668bacd5a6dcceb55f WatchSource:0}: Error finding container 3703eacf95250b60e10013628d6472167ea978098d9f19668bacd5a6dcceb55f: Status 404 returned error can't find the container with id 3703eacf95250b60e10013628d6472167ea978098d9f19668bacd5a6dcceb55f
Sep 17 17:31:37.301134 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.300888    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8edb03_2df1_418a_98bb_260f47c43c52.slice/crio-6ffb52615b5fa14c9911f761b7cfecc2f68871c998aecddbb5f46b9e5e0f2911 WatchSource:0}: Error finding container 6ffb52615b5fa14c9911f761b7cfecc2f68871c998aecddbb5f46b9e5e0f2911: Status 404 returned error can't find the container with id 6ffb52615b5fa14c9911f761b7cfecc2f68871c998aecddbb5f46b9e5e0f2911
Sep 17 17:31:37.302205 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:31:37.302165    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb68c757_b2b5_4194_9b57_4dc8fc67eacb.slice/crio-d48a7a730c02093a6981661a0458a5129a8613a0afe07551434a71363a04ad06 WatchSource:0}: Error finding container d48a7a730c02093a6981661a0458a5129a8613a0afe07551434a71363a04ad06: Status 404 returned error can't find the container with id d48a7a730c02093a6981661a0458a5129a8613a0afe07551434a71363a04ad06
Sep 17 17:31:37.329908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.329865    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:26:36 +0000 UTC" deadline="2028-05-01 02:07:09.988159181 +0000 UTC"
Sep 17 17:31:37.329908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.329906    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14192h35m32.65825633s"
Sep 17 17:31:37.405577 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.405545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal" event={"ID":"c7b7a7384449df783f830280a3100b44","Type":"ContainerStarted","Data":"cdfcd9d362bef63d79a049ac3b5c9380444d30583a981d122d1e0dda3f06f004"}
Sep 17 17:31:37.408638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.408610    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8bs2p" event={"ID":"bb68c757-b2b5-4194-9b57-4dc8fc67eacb","Type":"ContainerStarted","Data":"d48a7a730c02093a6981661a0458a5129a8613a0afe07551434a71363a04ad06"}
Sep 17 17:31:37.409873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.409845    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerStarted","Data":"6ffb52615b5fa14c9911f761b7cfecc2f68871c998aecddbb5f46b9e5e0f2911"}
Sep 17 17:31:37.411006 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.410985    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk" event={"ID":"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d","Type":"ContainerStarted","Data":"7f2f894ad47a386dfc9d0ffadc666bd03b5b5b7fdd40f5a33d6f8b9bdf3167df"}
Sep 17 17:31:37.411993 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.411976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lb54v" event={"ID":"f70ab124-950a-49c5-bace-36954153b7a8","Type":"ContainerStarted","Data":"3703eacf95250b60e10013628d6472167ea978098d9f19668bacd5a6dcceb55f"}
Sep 17 17:31:37.413772 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.413754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jcvv5" event={"ID":"68d45bd7-e033-4fa6-8256-01036f2d28ec","Type":"ContainerStarted","Data":"05f61679c10bf22a9783e96e044f77582e5e1879e42567a8a70a30cec3828007"}
Sep 17 17:31:37.414801 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.414783    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktffb" event={"ID":"2187be27-fd1a-4ed4-90f1-4af3b8db4e03","Type":"ContainerStarted","Data":"035e24e1a00b81669ff407c1ee943ee3b2ab09c9025154dda7812bab134016cb"}
Sep 17 17:31:37.419232 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.419198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"1b84a0a530bd4a81789bc34c72c6a4f3924df019aa3ddf8ed88e83a799e4a957"}
Sep 17 17:31:37.421388 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.421370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gbrd" event={"ID":"830a05c7-e115-47ac-83c4-240716a535a5","Type":"ContainerStarted","Data":"5f50098520ce0bc64de5274db58b271865e70c1ccd021e8ff2525096ab975171"}
Sep 17 17:31:37.423615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.423595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsfzf" event={"ID":"759dded7-4bac-4cfc-bf37-3fa3fb29e77e","Type":"ContainerStarted","Data":"e53bf1860baf2c1fdc15570c35f5a338c6003c5f8751a607d741a309bba52c7e"}
Sep 17 17:31:37.886927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.886510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:37.886927 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.886788    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:37.886927 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.886866    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:39.886845705 +0000 UTC m=+7.664683342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:37.988175 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.988133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:37.988372 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:37.988237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:37.988372 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.988363    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:37.988483 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.988427    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret podName:b8229b2b-a44d-4f96-a34a-b269c857681f nodeName:}" failed. No retries permitted until 2026-09-17 17:31:39.988408323 +0000 UTC m=+7.766245950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret") pod "global-pull-secret-syncer-q4x64" (UID: "b8229b2b-a44d-4f96-a34a-b269c857681f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:37.988992 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.988536    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:37.988992 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.988552    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:37.988992 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.988564    2559 projected.go:196] Error preparing data for projected volume kube-api-access-mbz6v for pod openshift-network-diagnostics/network-check-target-l8mpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:37.988992 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:37.988602    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v podName:8bc06536-f275-4dde-ada9-edc78d9b110a nodeName:}" failed. No retries permitted until 2026-09-17 17:31:39.988589536 +0000 UTC m=+7.766427149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbz6v" (UniqueName: "kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v") pod "network-check-target-l8mpm" (UID: "8bc06536-f275-4dde-ada9-edc78d9b110a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:38.331111 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.330992    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:26:36 +0000 UTC" deadline="2028-04-22 03:23:28.55824975 +0000 UTC"
Sep 17 17:31:38.331111 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.331057    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13977h51m50.22719681s"
Sep 17 17:31:38.393680 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.393649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:38.393860 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.393658    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:38.393860 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:38.393783    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:38.393860 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.393812    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:38.394013 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:38.393915    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:38.394013 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:38.394000    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:38.444626 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.443797    2559 generic.go:356] "Generic (PLEG): container finished" podID="732aa783476ab15c97c9ae702301de31" containerID="98711135f8cc46027c9d1a3979df457303ddd64d366b6572afb633b8150eda61" exitCode=0
Sep 17 17:31:38.444626 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.444568    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" event={"ID":"732aa783476ab15c97c9ae702301de31","Type":"ContainerDied","Data":"98711135f8cc46027c9d1a3979df457303ddd64d366b6572afb633b8150eda61"}
Sep 17 17:31:38.473159 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:38.473108    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal" podStartSLOduration=3.47308884 podStartE2EDuration="3.47308884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:37.427810886 +0000 UTC m=+5.205648520" watchObservedRunningTime="2026-09-17 17:31:38.47308884 +0000 UTC m=+6.250926476"
Sep 17 17:31:39.460596 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:39.460554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" event={"ID":"732aa783476ab15c97c9ae702301de31","Type":"ContainerStarted","Data":"c0244c49b42bfa81117d930ea77e0cf07f88f82d20c493bbcb7209e0cb7235ba"}
Sep 17 17:31:39.914467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:39.914428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:39.914711 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:39.914635    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:39.914775 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:39.914717    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:43.914696893 +0000 UTC m=+11.692534523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:40.015135 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:40.015095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:40.015320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:40.015165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:40.015320 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.015307    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:40.015430 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.015326    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:40.015430 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.015338    2559 projected.go:196] Error preparing data for projected volume kube-api-access-mbz6v for pod openshift-network-diagnostics/network-check-target-l8mpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:40.015430 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.015411    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v podName:8bc06536-f275-4dde-ada9-edc78d9b110a nodeName:}" failed. No retries permitted until 2026-09-17 17:31:44.015391676 +0000 UTC m=+11.793229292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbz6v" (UniqueName: "kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v") pod "network-check-target-l8mpm" (UID: "8bc06536-f275-4dde-ada9-edc78d9b110a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:40.016291 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.015840    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:40.016291 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.015897    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret podName:b8229b2b-a44d-4f96-a34a-b269c857681f nodeName:}" failed. No retries permitted until 2026-09-17 17:31:44.015880521 +0000 UTC m=+11.793718143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret") pod "global-pull-secret-syncer-q4x64" (UID: "b8229b2b-a44d-4f96-a34a-b269c857681f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:40.393932 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:40.393899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:40.394106 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.394045    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:40.394390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:40.394364    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:40.394509 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.394475    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:40.394509 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:40.394496    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:40.394708 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:40.394609    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:42.394429 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:42.393979    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:42.394429 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:42.393979    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:42.394429 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:42.393982    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:42.394429 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:42.394122    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:42.394429 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:42.394234    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:42.394429 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:42.394311    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:43.946600 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:43.946563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:43.947078 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:43.946753    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:43.947078 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:43.946840    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:31:51.946817441 +0000 UTC m=+19.724655067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:44.047936 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:44.047896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:44.048125 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:44.047962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:44.048125 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.048043    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:44.048125 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.048073    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:44.048125 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.048089    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:44.048125 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.048101    2559 projected.go:196] Error preparing data for projected volume kube-api-access-mbz6v for pod openshift-network-diagnostics/network-check-target-l8mpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:44.048125 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.048114    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret podName:b8229b2b-a44d-4f96-a34a-b269c857681f nodeName:}" failed. No retries permitted until 2026-09-17 17:31:52.048095918 +0000 UTC m=+19.825933554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret") pod "global-pull-secret-syncer-q4x64" (UID: "b8229b2b-a44d-4f96-a34a-b269c857681f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:44.048427 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.048174    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v podName:8bc06536-f275-4dde-ada9-edc78d9b110a nodeName:}" failed. No retries permitted until 2026-09-17 17:31:52.048162667 +0000 UTC m=+19.826000294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbz6v" (UniqueName: "kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v") pod "network-check-target-l8mpm" (UID: "8bc06536-f275-4dde-ada9-edc78d9b110a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:44.394696 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:44.394659    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:44.394893 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.394846    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:44.395023 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:44.394898    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:44.395078 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.395029    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:44.395128 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:44.395086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:44.395187 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:44.395168    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:46.393248 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:46.393205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:46.393248 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:46.393205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:46.393780 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:46.393223    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:46.393780 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:46.393345    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:46.393780 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:46.393400    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:46.393780 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:46.393488    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:48.393559 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:48.393510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:48.394020 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:48.393528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:48.394020 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:48.393748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:48.394240 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:48.394058    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:48.394366 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:48.394098    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:48.394366 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:48.394219    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:50.393528 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:50.393471    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:50.393528 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:50.393497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:50.393528 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:50.393475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:50.394069 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:50.393633    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:50.394069 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:50.393695    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:50.394069 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:50.393791    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:52.006670 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:52.006630    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:52.007121 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.006790    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:52.007121 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.006860    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:32:08.006838034 +0000 UTC m=+35.784675663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:31:52.107153 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:52.107118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:52.107327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:52.107176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:52.107327 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.107265    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:52.107327 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.107293    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:31:52.107327 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.107316    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:31:52.107327 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.107330    2559 projected.go:196] Error preparing data for projected volume kube-api-access-mbz6v for pod openshift-network-diagnostics/network-check-target-l8mpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:52.107621 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.107337    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret podName:b8229b2b-a44d-4f96-a34a-b269c857681f nodeName:}" failed. No retries permitted until 2026-09-17 17:32:08.107314917 +0000 UTC m=+35.885152531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret") pod "global-pull-secret-syncer-q4x64" (UID: "b8229b2b-a44d-4f96-a34a-b269c857681f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:31:52.107621 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.107371    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v podName:8bc06536-f275-4dde-ada9-edc78d9b110a nodeName:}" failed. No retries permitted until 2026-09-17 17:32:08.10735795 +0000 UTC m=+35.885195563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbz6v" (UniqueName: "kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v") pod "network-check-target-l8mpm" (UID: "8bc06536-f275-4dde-ada9-edc78d9b110a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:31:52.393393 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:52.393281    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:52.393594 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:52.393287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:52.393594 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:52.393447    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:52.393594 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.393421    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:52.393594 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.393555    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:52.394158 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:52.393656    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:54.393788 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:54.393765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:54.394084 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:54.393817    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:54.394084 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:54.393868    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:54.394084 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:54.393916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:54.394084 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:54.394036    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:54.394230 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:54.394122    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:55.493822 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.493559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsfzf" event={"ID":"759dded7-4bac-4cfc-bf37-3fa3fb29e77e","Type":"ContainerStarted","Data":"35b4f7c364332556342234a338d11f3f298957313a002cc6b3468977613b96b1"}
Sep 17 17:31:55.495182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.495161    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad8edb03-2df1-418a-98bb-260f47c43c52" containerID="a76c3c1b42be088a61590fc6c7423f88beba1316724e944c75c549156a02a68a" exitCode=0
Sep 17 17:31:55.495243 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.495231    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerDied","Data":"a76c3c1b42be088a61590fc6c7423f88beba1316724e944c75c549156a02a68a"}
Sep 17 17:31:55.497006 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.496980    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk" event={"ID":"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d","Type":"ContainerStarted","Data":"932a64a77dd67f2fd4a61ef8ae4af3adab810a9895446b2b5a9b4eea1e15b509"}
Sep 17 17:31:55.498819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.498768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lb54v" event={"ID":"f70ab124-950a-49c5-bace-36954153b7a8","Type":"ContainerStarted","Data":"e0cd5496f84d1e4f592b393dec87dd57e09f961b749807203978022214e91dbb"}
Sep 17 17:31:55.500509 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.500480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jcvv5" event={"ID":"68d45bd7-e033-4fa6-8256-01036f2d28ec","Type":"ContainerStarted","Data":"e5cfc99a42d0844c0942770a2c47d3ae54e478fc0606e2f87bf533f127eb8f1e"}
Sep 17 17:31:55.501996 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.501972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktffb" event={"ID":"2187be27-fd1a-4ed4-90f1-4af3b8db4e03","Type":"ContainerStarted","Data":"2c258e3263bbb20c8d85f1ef1ac25b2c1091d17f4ad3167367a2ad42f67ed798"}
Sep 17 17:31:55.504492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.504475    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:31:55.504814 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.504796    2559 generic.go:356] "Generic (PLEG): container finished" podID="02327afa-0086-45ea-b42c-25008b885900" containerID="2c7c6610cea7b0409191baea42fe41510e3eceb1eae3e567163ccc562c96a86e" exitCode=1
Sep 17 17:31:55.504884 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.504817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"0c182605d28161fda618bd6784369c40caa8e15561ff9b5f8cf09726441b5514"}
Sep 17 17:31:55.504923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.504885    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"1e5b58b5e86089f80ac8ccd3ab8de877e094daabfd2b82fe7d8ccdf5e57c5ccd"}
Sep 17 17:31:55.504923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.504917    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"c9a27991436a2dff90eaa8bfcff83aa0fb8ef62e0a74a9c0b0a27eae7cc8a4a4"}
Sep 17 17:31:55.505001 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.504947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"409c44216f7327507f721adf8987c5b3add13d2e368f36e63f1d9062b0505038"}
Sep 17 17:31:55.505001 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.504982    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerDied","Data":"2c7c6610cea7b0409191baea42fe41510e3eceb1eae3e567163ccc562c96a86e"}
Sep 17 17:31:55.505069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.505012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"3279c4c9175ddc3ab773dbc2df59b491eca689c62f1350e67e07bfb163889dc4"}
Sep 17 17:31:55.506330 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.506310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gbrd" event={"ID":"830a05c7-e115-47ac-83c4-240716a535a5","Type":"ContainerStarted","Data":"8d1e9a8362bda1dbaaf2df74cd7936573bd903ad3bd23cbf2d959b79214fe04c"}
Sep 17 17:31:55.520512 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.520464    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rsfzf" podStartSLOduration=4.358025506 podStartE2EDuration="21.520452481s" totalImagesPullingTime="17.162426975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:55.520254033 +0000 UTC m=+23.298091662" watchObservedRunningTime="2026-09-17 17:31:55.520452481 +0000 UTC m=+23.298290116"
Sep 17 17:31:55.520649 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.520573    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" podStartSLOduration=20.520565595 podStartE2EDuration="20.520565595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:39.488558761 +0000 UTC m=+7.266396396" watchObservedRunningTime="2026-09-17 17:31:55.520565595 +0000 UTC m=+23.298403232"
Sep 17 17:31:55.614106 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.613890    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jcvv5" podStartSLOduration=4.45917189 podStartE2EDuration="21.613869527s" totalImagesPullingTime="17.154697637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:55.613653895 +0000 UTC m=+23.391491529" watchObservedRunningTime="2026-09-17 17:31:55.613869527 +0000 UTC m=+23.391707165"
Sep 17 17:31:55.642363 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.642303    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7gbrd" podStartSLOduration=4.557350786 podStartE2EDuration="21.642278014s" totalImagesPullingTime="17.084927228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:55.638641479 +0000 UTC m=+23.416479116" watchObservedRunningTime="2026-09-17 17:31:55.642278014 +0000 UTC m=+23.420115651"
Sep 17 17:31:55.684068 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.684013    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lb54v" podStartSLOduration=4.532065681 podStartE2EDuration="21.683996397s" totalImagesPullingTime="17.151930716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:55.659297727 +0000 UTC m=+23.437135363" watchObservedRunningTime="2026-09-17 17:31:55.683996397 +0000 UTC m=+23.461834079"
Sep 17 17:31:55.843421 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.843379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:31:55.948535 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:55.948482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:31:56.049175 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.049138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:31:56.113467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.113440    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 17:31:56.347736 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.347578    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:31:56.113461792Z","UUID":"24428797-6080-4309-a8b6-47e5a72cbc08","Handler":null,"Name":"","Endpoint":""}
Sep 17 17:31:56.349772 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.349750    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 17:31:56.349924 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.349789    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 17:31:56.393252 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.393154    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:56.393408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.393157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:56.393408 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:56.393292    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:56.393408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.393307    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:56.393408 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:56.393393    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:56.393614 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:56.393489    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:56.510925 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.510884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8bs2p" event={"ID":"bb68c757-b2b5-4194-9b57-4dc8fc67eacb","Type":"ContainerStarted","Data":"cb3ba7d8c09a75379c2d4cbf0fd270b1a9eb8951fd3c4c1c75d94733185e6f5a"}
Sep 17 17:31:56.513188 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.513139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk" event={"ID":"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d","Type":"ContainerStarted","Data":"ab27c9b825269c33f5e2ac4ffe86a6f81d6acc1ba2d94f99e0e8bb141ae7aea1"}
Sep 17 17:31:56.533858 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.533792    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ktffb" podStartSLOduration=5.078347022 podStartE2EDuration="22.533769576s" totalImagesPullingTime="17.455422554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:55.684177186 +0000 UTC m=+23.462014845" watchObservedRunningTime="2026-09-17 17:31:56.533769576 +0000 UTC m=+24.311607211"
Sep 17 17:31:56.534153 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.534130    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8bs2p" podStartSLOduration=5.382125301 podStartE2EDuration="22.534122618s" totalImagesPullingTime="17.151997317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:56.533722205 +0000 UTC m=+24.311559841" watchObservedRunningTime="2026-09-17 17:31:56.534122618 +0000 UTC m=+24.311960253"
Sep 17 17:31:56.678818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.678718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:31:56.768890 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:56.768834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:31:57.518037 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:57.517997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk" event={"ID":"6aa44f83-72d1-4a7b-8dc1-b1c702ebfa9d","Type":"ContainerStarted","Data":"98c075ea88e343d2b54fbad4f7dfcdbd358bc80b10ac69d20eb7eda610a29f80"}
Sep 17 17:31:57.521293 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:57.521275    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:31:57.523280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:57.521970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"e460f291901610cd9d61c3d043ef6dc2a7b92eb691dd5bfcdd886f23d710c94a"}
Sep 17 17:31:57.542439 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:57.542397    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4rbk" podStartSLOduration=4.407287351 podStartE2EDuration="23.542381777s" totalImagesPullingTime="19.135094426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:57.541393053 +0000 UTC m=+25.319230683" watchObservedRunningTime="2026-09-17 17:31:57.542381777 +0000 UTC m=+25.320219411"
Sep 17 17:31:58.393756 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:58.393720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:31:58.393931 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:58.393720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:31:58.393931 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:58.393835    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:31:58.393931 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:58.393921    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:31:58.394030 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:58.393720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:31:58.394030 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:31:58.393997    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:31:59.031250 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:59.031214    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:59.031910 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:59.031887    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:59.526576 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:59.526549    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:59.527044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:59.527021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7gbrd"
Sep 17 17:31:59.616723 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:31:59.616692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:00.393316 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:00.393283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:00.393774 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:00.393404    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:32:00.393774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:00.393462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:00.393774 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:00.393586    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:32:00.393774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:00.393283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:00.393774 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:00.393701    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:32:01.455102 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.454939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:01.532574 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.532541    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad8edb03-2df1-418a-98bb-260f47c43c52" containerID="19bdbb3908269afa81c701f0b3ae8774e0bccd68b1f2f7e5ad9011f6333cd246" exitCode=0
Sep 17 17:32:01.532732 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.532642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerDied","Data":"19bdbb3908269afa81c701f0b3ae8774e0bccd68b1f2f7e5ad9011f6333cd246"}
Sep 17 17:32:01.536037 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.536021    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:32:01.536433 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.536410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"70f61f04c78b2789ee21a3e11f8eb82e08ccfd616955302758bdc10add4f727b"}
Sep 17 17:32:01.536731 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.536712    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:32:01.536803 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.536789    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:32:01.536874 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.536840    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:32:01.536874 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.536854    2559 scope.go:117] "RemoveContainer" containerID="2c7c6610cea7b0409191baea42fe41510e3eceb1eae3e567163ccc562c96a86e"
Sep 17 17:32:01.552502 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.552482    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:32:01.552679 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.552655    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:32:01.559185 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:01.559165    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:02.393289 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.393265    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:02.393398 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.393265    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:02.393398 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.393375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:02.393398 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:02.393378    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:32:02.393564 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:02.393459    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:32:02.393564 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:02.393548    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:32:02.542602 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.542488    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:32:02.543087 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.542899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" event={"ID":"02327afa-0086-45ea-b42c-25008b885900","Type":"ContainerStarted","Data":"b1d7e6307f10fa94c433c2e6e663c4716d86b33662dcc572cf0312696570d7e4"}
Sep 17 17:32:02.544947 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.544920    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad8edb03-2df1-418a-98bb-260f47c43c52" containerID="e453c820a444d95cca943c06bc4de3ea85e110a2b811c36c79c4f84284e42499" exitCode=0
Sep 17 17:32:02.545058 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.544960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerDied","Data":"e453c820a444d95cca943c06bc4de3ea85e110a2b811c36c79c4f84284e42499"}
Sep 17 17:32:02.618679 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.618631    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-88nns" podStartSLOduration=11.461688902 podStartE2EDuration="28.618615191s" totalImagesPullingTime="17.156926289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:02.59323975 +0000 UTC m=+30.371077385" watchObservedRunningTime="2026-09-17 17:32:02.618615191 +0000 UTC m=+30.396452826"
Sep 17 17:32:02.618977 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.618958    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q4x64"]
Sep 17 17:32:02.619096 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.619084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:02.619196 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:02.619176    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:32:02.622409 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.622386    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tv9r5"]
Sep 17 17:32:02.622505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.622492    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:02.622644 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:02.622622    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:32:02.625250 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.625227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l8mpm"]
Sep 17 17:32:02.625330 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:02.625313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:02.625421 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:02.625398    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:32:03.549509 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:03.549472    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad8edb03-2df1-418a-98bb-260f47c43c52" containerID="b61a10dc8073456df3ceb7f1cc5655a060ea744715c3e38a645d1c7227fc5227" exitCode=0
Sep 17 17:32:03.549918 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:03.549550    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerDied","Data":"b61a10dc8073456df3ceb7f1cc5655a060ea744715c3e38a645d1c7227fc5227"}
Sep 17 17:32:04.394902 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:04.394867    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:04.395086 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:04.394952    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:04.395086 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:04.394987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:04.395086 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:04.395012    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:32:04.395199 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:04.395079    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:32:04.395199 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:04.395164    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:32:06.225587 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:06.225540    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:06.290771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:06.290738    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:06.393537 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:06.393487    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:06.393697 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:06.393500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:06.393697 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:06.393500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:06.393697 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:06.393643    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8mpm" podUID="8bc06536-f275-4dde-ada9-edc78d9b110a"
Sep 17 17:32:06.393842 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:06.393711    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4x64" podUID="b8229b2b-a44d-4f96-a34a-b269c857681f"
Sep 17 17:32:06.393842 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:06.393810    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv9r5" podUID="4fee2f26-af6a-47ef-a183-f3414e107775"
Sep 17 17:32:07.652207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.652181    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeReady"
Sep 17 17:32:07.652601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.652320    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 17:32:07.713787 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.713763    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tdcgr"]
Sep 17 17:32:07.716733 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.716708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.717334 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.717316    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hl7ml"]
Sep 17 17:32:07.719841 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.719819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 17:32:07.719841 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.719832    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fv9xq\""
Sep 17 17:32:07.719991 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.719955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:07.720046 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.720007    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 17:32:07.722849 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.722827    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mkhl7\""
Sep 17 17:32:07.723110 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.723061    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 17:32:07.723110 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.723093    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 17:32:07.723572 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.723416    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 17:32:07.741407 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.738921    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hl7ml"]
Sep 17 17:32:07.745037 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.743128    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tdcgr"]
Sep 17 17:32:07.823185 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.823153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26901103-f82e-4a36-a715-b5331da026ae-config-volume\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.823279 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.823192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwdcg\" (UniqueName: \"kubernetes.io/projected/26901103-f82e-4a36-a715-b5331da026ae-kube-api-access-nwdcg\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.823279 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.823223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq472\" (UniqueName: \"kubernetes.io/projected/6050df6b-3301-4f75-b63d-8ca8693abf23-kube-api-access-lq472\") pod \"ingress-canary-hl7ml\" (UID: \"6050df6b-3301-4f75-b63d-8ca8693abf23\") " pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:07.823387 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.823360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26901103-f82e-4a36-a715-b5331da026ae-tmp-dir\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.823425 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.823402    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6050df6b-3301-4f75-b63d-8ca8693abf23-cert\") pod \"ingress-canary-hl7ml\" (UID: \"6050df6b-3301-4f75-b63d-8ca8693abf23\") " pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:07.823479 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.823429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.924490 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.924461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq472\" (UniqueName: \"kubernetes.io/projected/6050df6b-3301-4f75-b63d-8ca8693abf23-kube-api-access-lq472\") pod \"ingress-canary-hl7ml\" (UID: \"6050df6b-3301-4f75-b63d-8ca8693abf23\") " pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:07.924600 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.924536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26901103-f82e-4a36-a715-b5331da026ae-tmp-dir\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.924600 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.924556    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6050df6b-3301-4f75-b63d-8ca8693abf23-cert\") pod \"ingress-canary-hl7ml\" (UID: \"6050df6b-3301-4f75-b63d-8ca8693abf23\") " pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:07.924600 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.924572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.924738 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.924604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26901103-f82e-4a36-a715-b5331da026ae-config-volume\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.924738 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.924622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwdcg\" (UniqueName: \"kubernetes.io/projected/26901103-f82e-4a36-a715-b5331da026ae-kube-api-access-nwdcg\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.924738 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:07.924699    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:07.924881 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:07.924772    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:32:08.424751179 +0000 UTC m=+36.202588809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:07.925044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.925022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26901103-f82e-4a36-a715-b5331da026ae-tmp-dir\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.925242 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.925218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26901103-f82e-4a36-a715-b5331da026ae-config-volume\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.928654 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.928505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6050df6b-3301-4f75-b63d-8ca8693abf23-cert\") pod \"ingress-canary-hl7ml\" (UID: \"6050df6b-3301-4f75-b63d-8ca8693abf23\") " pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:07.929527 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.929497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:07.935228 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.935207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwdcg\" (UniqueName: \"kubernetes.io/projected/26901103-f82e-4a36-a715-b5331da026ae-kube-api-access-nwdcg\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:07.936114 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:07.936099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq472\" (UniqueName: \"kubernetes.io/projected/6050df6b-3301-4f75-b63d-8ca8693abf23-kube-api-access-lq472\") pod \"ingress-canary-hl7ml\" (UID: \"6050df6b-3301-4f75-b63d-8ca8693abf23\") " pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:08.025320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.025285    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:08.025472 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.025435    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:32:08.025511 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.025499    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:32:40.025483155 +0000 UTC m=+67.803320775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:32:08.030069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.030040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:08.040818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.040795    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hl7ml"
Sep 17 17:32:08.126017 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.125986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:08.126193 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.126038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:08.126193 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.126170    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:32:08.126293 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.126251    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret podName:b8229b2b-a44d-4f96-a34a-b269c857681f nodeName:}" failed. No retries permitted until 2026-09-17 17:32:40.126231207 +0000 UTC m=+67.904068824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret") pod "global-pull-secret-syncer-q4x64" (UID: "b8229b2b-a44d-4f96-a34a-b269c857681f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:32:08.126293 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.126178    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:32:08.126293 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.126285    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:32:08.126442 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.126297    2559 projected.go:196] Error preparing data for projected volume kube-api-access-mbz6v for pod openshift-network-diagnostics/network-check-target-l8mpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:32:08.126442 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.126340    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v podName:8bc06536-f275-4dde-ada9-edc78d9b110a nodeName:}" failed. No retries permitted until 2026-09-17 17:32:40.126327769 +0000 UTC m=+67.904165382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbz6v" (UniqueName: "kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v") pod "network-check-target-l8mpm" (UID: "8bc06536-f275-4dde-ada9-edc78d9b110a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:32:08.324743 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.324671    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hl7ml"]
Sep 17 17:32:08.327838 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:32:08.327810    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6050df6b_3301_4f75_b63d_8ca8693abf23.slice/crio-09b9706b06cb277b6600c9448b5d4ed085d13ab2b56d4b1e16d63ce9929a955a WatchSource:0}: Error finding container 09b9706b06cb277b6600c9448b5d4ed085d13ab2b56d4b1e16d63ce9929a955a: Status 404 returned error can't find the container with id 09b9706b06cb277b6600c9448b5d4ed085d13ab2b56d4b1e16d63ce9929a955a
Sep 17 17:32:08.394105 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.394066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:08.394299 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.394067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:08.394299 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.394256    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:08.397199 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.397175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjh79\""
Sep 17 17:32:08.397329 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.397244    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:32:08.397399 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.397384    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:32:08.398072 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.398055    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-js6ht\""
Sep 17 17:32:08.398194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.398081    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:32:08.398194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.398148    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:32:08.428971 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.428945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:08.429102 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.429086    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:08.429155 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:08.429145    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:32:09.429131152 +0000 UTC m=+37.206968764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:08.562896 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.562860    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hl7ml" event={"ID":"6050df6b-3301-4f75-b63d-8ca8693abf23","Type":"ContainerStarted","Data":"09b9706b06cb277b6600c9448b5d4ed085d13ab2b56d4b1e16d63ce9929a955a"}
Sep 17 17:32:08.565629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.565601    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad8edb03-2df1-418a-98bb-260f47c43c52" containerID="1b64e38ea8b91b65b1228ed841876501624b1344a25940ced57959203111da2c" exitCode=0
Sep 17 17:32:08.565767 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:08.565663    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerDied","Data":"1b64e38ea8b91b65b1228ed841876501624b1344a25940ced57959203111da2c"}
Sep 17 17:32:09.436472 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:09.436429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:09.437293 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:09.436575    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:09.437293 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:09.436639    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:32:11.436622654 +0000 UTC m=+39.214460268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:09.571761 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:09.571731    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad8edb03-2df1-418a-98bb-260f47c43c52" containerID="98e43e5ea28a1bf11ad3fad906c448edbe91f3a8dec231bcf15fd5789e23d996" exitCode=0
Sep 17 17:32:09.571933 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:09.571798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerDied","Data":"98e43e5ea28a1bf11ad3fad906c448edbe91f3a8dec231bcf15fd5789e23d996"}
Sep 17 17:32:10.577846 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:10.577606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qld8b" event={"ID":"ad8edb03-2df1-418a-98bb-260f47c43c52","Type":"ContainerStarted","Data":"78aecb5bfba977458de5d9b5e1b21133e11c5fc17b6d1a27a00b24f2d5f988c4"}
Sep 17 17:32:10.609956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:10.609897    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qld8b" podStartSLOduration=8.777171243 podStartE2EDuration="36.609876533s" totalImagesPullingTime="27.83270529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:10.608468174 +0000 UTC m=+38.386305808" watchObservedRunningTime="2026-09-17 17:32:10.609876533 +0000 UTC m=+38.387714168"
Sep 17 17:32:10.736272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:10.736228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:10.811946 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:10.811852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:11.452040 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:11.452001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:11.452212 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:11.452171    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:11.452251 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:11.452237    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:32:15.452222238 +0000 UTC m=+43.230059851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:11.581913 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:11.581876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hl7ml" event={"ID":"6050df6b-3301-4f75-b63d-8ca8693abf23","Type":"ContainerStarted","Data":"5ef89dc36abd2081efdafdd6b239a89175c898a84f2c9f1675b27b3ed11d6537"}
Sep 17 17:32:11.602771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:11.602708    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hl7ml" podStartSLOduration=2.394694661 podStartE2EDuration="4.60269381s" totalImagesPullingTime="2.207999149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:11.601987864 +0000 UTC m=+39.379825501" watchObservedRunningTime="2026-09-17 17:32:11.60269381 +0000 UTC m=+39.380531444"
Sep 17 17:32:12.934035 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:12.934003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:13.042215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:13.042159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:14.142263 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:14.142225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:14.241227 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:14.241184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:15.481942 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:15.481900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:15.482425 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:15.482077    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:15.482425 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:15.482162    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:32:23.482141678 +0000 UTC m=+51.259979291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:23.536629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:23.536580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:23.537220 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:23.536718    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:23.537220 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:23.536808    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:32:39.536786366 +0000 UTC m=+67.314623980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:33.560225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:33.560195    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88nns"
Sep 17 17:32:33.772614 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:33.772242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:34.836676 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:34.836637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:32:39.546296 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:39.546255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:32:39.546797 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:39.546364    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:32:39.546797 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:39.546418    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:11.546403467 +0000 UTC m=+99.324241080 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:32:40.049905 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.049869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:32:40.053210 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.053191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:32:40.060726 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:40.060709    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:32:40.060785 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:32:40.060775    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs podName:4fee2f26-af6a-47ef-a183-f3414e107775 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:44.060759124 +0000 UTC m=+131.838596737 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs") pod "network-metrics-daemon-tv9r5" (UID: "4fee2f26-af6a-47ef-a183-f3414e107775") : secret "metrics-daemon-secret" not found
Sep 17 17:32:40.150913 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.150877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:40.151066 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.150927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:40.153821 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.153798    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:32:40.154050 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.154034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:32:40.163719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.163701    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:32:40.164227 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.164207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8229b2b-a44d-4f96-a34a-b269c857681f-original-pull-secret\") pod \"global-pull-secret-syncer-q4x64\" (UID: \"b8229b2b-a44d-4f96-a34a-b269c857681f\") " pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:40.174029 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.174008    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbz6v\" (UniqueName: \"kubernetes.io/projected/8bc06536-f275-4dde-ada9-edc78d9b110a-kube-api-access-mbz6v\") pod \"network-check-target-l8mpm\" (UID: \"8bc06536-f275-4dde-ada9-edc78d9b110a\") " pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:40.213506 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.213476    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjh79\""
Sep 17 17:32:40.215507 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.215493    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4x64"
Sep 17 17:32:40.222397 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.222376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:40.498799 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.498770    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q4x64"]
Sep 17 17:32:40.499355 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.499334    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l8mpm"]
Sep 17 17:32:40.501501 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:32:40.501476    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8229b2b_a44d_4f96_a34a_b269c857681f.slice/crio-d8fe480b7fc1c2f63782b9eb3b8e28d40b886f0fed09c0f7655c6ddbcb53a9ce WatchSource:0}: Error finding container d8fe480b7fc1c2f63782b9eb3b8e28d40b886f0fed09c0f7655c6ddbcb53a9ce: Status 404 returned error can't find the container with id d8fe480b7fc1c2f63782b9eb3b8e28d40b886f0fed09c0f7655c6ddbcb53a9ce
Sep 17 17:32:40.501956 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:32:40.501938    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc06536_f275_4dde_ada9_edc78d9b110a.slice/crio-ad56792a88eeefa63e23a7f637fa6c659cf216cef5703dca10c5d92145b5a5b0 WatchSource:0}: Error finding container ad56792a88eeefa63e23a7f637fa6c659cf216cef5703dca10c5d92145b5a5b0: Status 404 returned error can't find the container with id ad56792a88eeefa63e23a7f637fa6c659cf216cef5703dca10c5d92145b5a5b0
Sep 17 17:32:40.650269 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.650235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l8mpm" event={"ID":"8bc06536-f275-4dde-ada9-edc78d9b110a","Type":"ContainerStarted","Data":"ad56792a88eeefa63e23a7f637fa6c659cf216cef5703dca10c5d92145b5a5b0"}
Sep 17 17:32:40.651364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:40.651336    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q4x64" event={"ID":"b8229b2b-a44d-4f96-a34a-b269c857681f","Type":"ContainerStarted","Data":"d8fe480b7fc1c2f63782b9eb3b8e28d40b886f0fed09c0f7655c6ddbcb53a9ce"}
Sep 17 17:32:45.666285 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:45.666247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l8mpm" event={"ID":"8bc06536-f275-4dde-ada9-edc78d9b110a","Type":"ContainerStarted","Data":"99c7efff1f3503d00a2ccce0221d3f85a91bf9a574d58711254d7456703f4a41"}
Sep 17 17:32:45.666784 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:45.666377    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:32:45.667821 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:45.667797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q4x64" event={"ID":"b8229b2b-a44d-4f96-a34a-b269c857681f","Type":"ContainerStarted","Data":"907f2e1d582c9d1b3618884997a253b0c2c97917309f3d5dabe80ffc07ed73bb"}
Sep 17 17:32:45.682662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:45.682620    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l8mpm" podStartSLOduration=67.407122911 podStartE2EDuration="1m11.682608525s" totalImagesPullingTime="4.275485614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:45.682182931 +0000 UTC m=+73.460020566" watchObservedRunningTime="2026-09-17 17:32:45.682608525 +0000 UTC m=+73.460446161"
Sep 17 17:32:45.697514 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:32:45.697473    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q4x64" podStartSLOduration=67.414472387 podStartE2EDuration="1m11.697460907s" totalImagesPullingTime="4.28298852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:45.696693348 +0000 UTC m=+73.474530985" watchObservedRunningTime="2026-09-17 17:32:45.697460907 +0000 UTC m=+73.475298541"
Sep 17 17:33:00.944750 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:00.944640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:05.307110 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.307075    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f5955c464-h8wlh"]
Sep 17 17:33:05.310875 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.310856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.313753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.313716    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 17 17:33:05.313753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.313747    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-stmfx\""
Sep 17 17:33:05.313925 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.313716    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.313925 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.313808    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 17 17:33:05.313925 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.313866    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.314163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.314147    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 17 17:33:05.314236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.314158    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 17 17:33:05.322653 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.322629    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f5955c464-h8wlh"]
Sep 17 17:33:05.408618 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.408581    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-z9tfg"]
Sep 17 17:33:05.411028 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.411013    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"]
Sep 17 17:33:05.411152 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.411135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.413637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.413616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.414137 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.414096    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 17:33:05.414137 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.414131    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 17:33:05.414329 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.414104    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.414329 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.414099    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.414329 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.414104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k4gsd\""
Sep 17 17:33:05.417546 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.417527    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 17:33:05.418025 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.418012    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.418098 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.418033    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.418570 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.418547    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 17:33:05.418671 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.418633    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fm56d\""
Sep 17 17:33:05.421075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.421047    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 17:33:05.421976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.421954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.422163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.422135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-stats-auth\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.422272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.422198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-default-certificate\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.422272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.422233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.422272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.422268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bplbt\" (UniqueName: \"kubernetes.io/projected/f840393b-d324-47b2-bdf4-9546ade943ae-kube-api-access-bplbt\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.427274 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.427102    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"]
Sep 17 17:33:05.428237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.428215    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-z9tfg"]
Sep 17 17:33:05.494013 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.493982    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:05.512529 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.512476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"]
Sep 17 17:33:05.515262 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.515247    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"]
Sep 17 17:33:05.515389 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.515368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.517963 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.517935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.518659 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.518640    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 17:33:05.518755 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.518642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b46nb\""
Sep 17 17:33:05.519188 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.519175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 17:33:05.519278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.519262    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.519857 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.519841    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.520418 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.520401    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:33:05.520510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.520402    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 17:33:05.520775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.520725    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 17:33:05.520775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.520740    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 17:33:05.520775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.520766    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qnzqr\""
Sep 17 17:33:05.522675 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-stats-auth\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.522764 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-tmp\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.522764 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.522764 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-default-certificate\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.522927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.522927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.522927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrfq\" (UniqueName: \"kubernetes.io/projected/4179cf38-2212-4632-82db-c90a051d0468-kube-api-access-nbrfq\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.522927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bplbt\" (UniqueName: \"kubernetes.io/projected/f840393b-d324-47b2-bdf4-9546ade943ae-kube-api-access-bplbt\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.522927 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:05.522866    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 17:33:05.522927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.522884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.522927 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:05.522910    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:06.022895829 +0000 UTC m=+93.800733483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : secret "router-metrics-certs-default" not found
Sep 17 17:33:05.523268 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.523109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-serving-cert\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.523268 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.523142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q5vs\" (UniqueName: \"kubernetes.io/projected/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-kube-api-access-6q5vs\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.523268 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.523186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-snapshots\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.523268 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.523249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.523466 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.523273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4179cf38-2212-4632-82db-c90a051d0468-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.523466 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:05.523401    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:06.023384491 +0000 UTC m=+93.801222122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : configmap references non-existent config key: service-ca.crt
Sep 17 17:33:05.525078 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.525060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-stats-auth\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.525182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.525097    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-default-certificate\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.533670 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.533648    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"]
Sep 17 17:33:05.536908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.536887    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"]
Sep 17 17:33:05.539716 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.539693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bplbt\" (UniqueName: \"kubernetes.io/projected/f840393b-d324-47b2-bdf4-9546ade943ae-kube-api-access-bplbt\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:05.598241 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.598157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:05.624316 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.624316 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrfq\" (UniqueName: \"kubernetes.io/projected/4179cf38-2212-4632-82db-c90a051d0468-kube-api-access-nbrfq\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.624541 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e2960d0-70bf-4e2e-b475-7056b0aeb225-config\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.624541 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.624541 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjlzj\" (UniqueName: \"kubernetes.io/projected/5e2960d0-70bf-4e2e-b475-7056b0aeb225-kube-api-access-tjlzj\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.624541 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624502    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5443ffee-2e98-43f9-b155-4e2ba193356a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.624713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-serving-cert\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.624713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624595    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q5vs\" (UniqueName: \"kubernetes.io/projected/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-kube-api-access-6q5vs\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.624713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4r7\" (UniqueName: \"kubernetes.io/projected/5443ffee-2e98-43f9-b155-4e2ba193356a-kube-api-access-kj4r7\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.624713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-snapshots\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.624713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2960d0-70bf-4e2e-b475-7056b0aeb225-serving-cert\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.624948 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5443ffee-2e98-43f9-b155-4e2ba193356a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.624948 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4179cf38-2212-4632-82db-c90a051d0468-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.624948 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-tmp\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.625088 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.625088 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.624999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.625197 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:05.625119    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:05.625247 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:05.625197    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls podName:4179cf38-2212-4632-82db-c90a051d0468 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:06.125177136 +0000 UTC m=+93.903014756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tcwdp" (UID: "4179cf38-2212-4632-82db-c90a051d0468") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:05.625247 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.625228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-tmp\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.625358 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.625317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-snapshots\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.625417 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.625390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.625576 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.625557    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4179cf38-2212-4632-82db-c90a051d0468-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.627103 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.627087    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-serving-cert\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.637813 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.637784    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q5vs\" (UniqueName: \"kubernetes.io/projected/3a112cc5-b12f-4e93-9cd7-89fdbbdafef3-kube-api-access-6q5vs\") pod \"insights-operator-6f9c644dd9-z9tfg\" (UID: \"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3\") " pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.640295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.640271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrfq\" (UniqueName: \"kubernetes.io/projected/4179cf38-2212-4632-82db-c90a051d0468-kube-api-access-nbrfq\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:05.722162 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.722133    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg"
Sep 17 17:33:05.725471 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.725442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e2960d0-70bf-4e2e-b475-7056b0aeb225-config\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.725471 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.725474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjlzj\" (UniqueName: \"kubernetes.io/projected/5e2960d0-70bf-4e2e-b475-7056b0aeb225-kube-api-access-tjlzj\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.725659 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.725502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5443ffee-2e98-43f9-b155-4e2ba193356a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.725659 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.725559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4r7\" (UniqueName: \"kubernetes.io/projected/5443ffee-2e98-43f9-b155-4e2ba193356a-kube-api-access-kj4r7\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.725659 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.725596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2960d0-70bf-4e2e-b475-7056b0aeb225-serving-cert\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.725659 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.725635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5443ffee-2e98-43f9-b155-4e2ba193356a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.726212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.726187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e2960d0-70bf-4e2e-b475-7056b0aeb225-config\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.726314 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.726287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5443ffee-2e98-43f9-b155-4e2ba193356a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.727924 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.727903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2960d0-70bf-4e2e-b475-7056b0aeb225-serving-cert\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.727981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.727908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5443ffee-2e98-43f9-b155-4e2ba193356a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.734370 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.734346    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjlzj\" (UniqueName: \"kubernetes.io/projected/5e2960d0-70bf-4e2e-b475-7056b0aeb225-kube-api-access-tjlzj\") pod \"service-ca-operator-57cdc4b768-hhtmn\" (UID: \"5e2960d0-70bf-4e2e-b475-7056b0aeb225\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.734597 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.734575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4r7\" (UniqueName: \"kubernetes.io/projected/5443ffee-2e98-43f9-b155-4e2ba193356a-kube-api-access-kj4r7\") pod \"kube-storage-version-migrator-operator-55889f7b47-fqb8c\" (UID: \"5443ffee-2e98-43f9-b155-4e2ba193356a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.826087 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.826040    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"
Sep 17 17:33:05.836229 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.836209    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"
Sep 17 17:33:05.992172 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:05.992136    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-z9tfg"]
Sep 17 17:33:05.994847 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:05.994817    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a112cc5_b12f_4e93_9cd7_89fdbbdafef3.slice/crio-0f625cac84aebecddc5c87e7a1c817a52de2aa07aced7c50b793ac2fd0bf3e20 WatchSource:0}: Error finding container 0f625cac84aebecddc5c87e7a1c817a52de2aa07aced7c50b793ac2fd0bf3e20: Status 404 returned error can't find the container with id 0f625cac84aebecddc5c87e7a1c817a52de2aa07aced7c50b793ac2fd0bf3e20
Sep 17 17:33:06.027425 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.027397    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:06.027585 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.027458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:06.027585 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:06.027570    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 17:33:06.027661 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:06.027588    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:07.027570244 +0000 UTC m=+94.805407857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : configmap references non-existent config key: service-ca.crt
Sep 17 17:33:06.027661 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:06.027611    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:07.027600114 +0000 UTC m=+94.805437727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : secret "router-metrics-certs-default" not found
Sep 17 17:33:06.099132 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.099104    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c"]
Sep 17 17:33:06.102269 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:06.102242    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5443ffee_2e98_43f9_b155_4e2ba193356a.slice/crio-8b6c329c33dd704df65679568f4aebd0d07c538f5f34d97714d41dfb1eaa2b19 WatchSource:0}: Error finding container 8b6c329c33dd704df65679568f4aebd0d07c538f5f34d97714d41dfb1eaa2b19: Status 404 returned error can't find the container with id 8b6c329c33dd704df65679568f4aebd0d07c538f5f34d97714d41dfb1eaa2b19
Sep 17 17:33:06.116477 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.116453    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn"]
Sep 17 17:33:06.119062 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:06.119040    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2960d0_70bf_4e2e_b475_7056b0aeb225.slice/crio-62abb8ddeed9ca01e3b2dad067598d3f2d2c9f803a65401dcc762baeccc04e52 WatchSource:0}: Error finding container 62abb8ddeed9ca01e3b2dad067598d3f2d2c9f803a65401dcc762baeccc04e52: Status 404 returned error can't find the container with id 62abb8ddeed9ca01e3b2dad067598d3f2d2c9f803a65401dcc762baeccc04e52
Sep 17 17:33:06.128511 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.128457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:06.128604 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:06.128594    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:06.128647 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:06.128639    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls podName:4179cf38-2212-4632-82db-c90a051d0468 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:07.128626681 +0000 UTC m=+94.906464293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tcwdp" (UID: "4179cf38-2212-4632-82db-c90a051d0468") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:06.725163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.725111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg" event={"ID":"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3","Type":"ContainerStarted","Data":"0f625cac84aebecddc5c87e7a1c817a52de2aa07aced7c50b793ac2fd0bf3e20"}
Sep 17 17:33:06.726712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.726680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn" event={"ID":"5e2960d0-70bf-4e2e-b475-7056b0aeb225","Type":"ContainerStarted","Data":"62abb8ddeed9ca01e3b2dad067598d3f2d2c9f803a65401dcc762baeccc04e52"}
Sep 17 17:33:06.728313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:06.728257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c" event={"ID":"5443ffee-2e98-43f9-b155-4e2ba193356a","Type":"ContainerStarted","Data":"8b6c329c33dd704df65679568f4aebd0d07c538f5f34d97714d41dfb1eaa2b19"}
Sep 17 17:33:07.037169 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:07.037115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:07.037364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:07.037218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:07.037432 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:07.037363    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 17:33:07.037432 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:07.037428    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:09.037409953 +0000 UTC m=+96.815247571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : secret "router-metrics-certs-default" not found
Sep 17 17:33:07.037694 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:07.037672    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:09.037657618 +0000 UTC m=+96.815495244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : configmap references non-existent config key: service-ca.crt
Sep 17 17:33:07.138058 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:07.137971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:07.138382 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:07.138091    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:07.138382 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:07.138173    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls podName:4179cf38-2212-4632-82db-c90a051d0468 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:09.138152863 +0000 UTC m=+96.915990482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tcwdp" (UID: "4179cf38-2212-4632-82db-c90a051d0468") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:08.311347 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:08.311297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:08.387197 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:08.387154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:09.054528 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.054488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:09.054745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.054574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:09.054745 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:09.054689    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 17:33:09.054745 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:09.054706    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.054681641 +0000 UTC m=+100.832519257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : configmap references non-existent config key: service-ca.crt
Sep 17 17:33:09.054745 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:09.054739    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.05472904 +0000 UTC m=+100.832566659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : secret "router-metrics-certs-default" not found
Sep 17 17:33:09.155665 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.155579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:09.155827 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:09.155749    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:09.155827 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:09.155814    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls podName:4179cf38-2212-4632-82db-c90a051d0468 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.155795073 +0000 UTC m=+100.933632702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tcwdp" (UID: "4179cf38-2212-4632-82db-c90a051d0468") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:09.739228 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.739193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg" event={"ID":"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3","Type":"ContainerStarted","Data":"7b7ae2ff2a9b22f9b60f7a61323d49878a312461ae1a19e904f4342e6b6feb08"}
Sep 17 17:33:09.740968 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.740941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn" event={"ID":"5e2960d0-70bf-4e2e-b475-7056b0aeb225","Type":"ContainerStarted","Data":"97e2cfe9400454b74d6ae3a7065e8e5607c283ac59056a81e066aab86e64adcb"}
Sep 17 17:33:09.742482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.742457    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c" event={"ID":"5443ffee-2e98-43f9-b155-4e2ba193356a","Type":"ContainerStarted","Data":"9adaf8c7cfb5e5e462e78ee73ce9cc387433150bd452d4e2b4e49297c12f3943"}
Sep 17 17:33:09.777693 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.777637    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg" podStartSLOduration=1.92486977 podStartE2EDuration="4.777617737s" totalImagesPullingTime="2.852747967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:09.775556911 +0000 UTC m=+97.553394546" watchObservedRunningTime="2026-09-17 17:33:09.777617737 +0000 UTC m=+97.555455374"
Sep 17 17:33:09.790508 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.790476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:09.808949 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.808887    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c" podStartSLOduration=2.060454855 podStartE2EDuration="4.808867445s" totalImagesPullingTime="2.74841259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:09.808211315 +0000 UTC m=+97.586048950" watchObservedRunningTime="2026-09-17 17:33:09.808867445 +0000 UTC m=+97.586705080"
Sep 17 17:33:09.840073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.840037    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"]
Sep 17 17:33:09.840239 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.840122    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn" podStartSLOduration=2.105868959 podStartE2EDuration="4.840102839s" totalImagesPullingTime="2.73423388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:09.839071779 +0000 UTC m=+97.616909415" watchObservedRunningTime="2026-09-17 17:33:09.840102839 +0000 UTC m=+97.617940475"
Sep 17 17:33:09.843325 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.843304    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"
Sep 17 17:33:09.845985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.845793    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 17:33:09.845985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.845933    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 17:33:09.845985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.845939    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hw4mk\""
Sep 17 17:33:09.856539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.856447    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"]
Sep 17 17:33:09.887588 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.887539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:09.962027 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.961993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms7wk\" (UniqueName: \"kubernetes.io/projected/352c32dd-8226-421c-b2fa-22211b55209b-kube-api-access-ms7wk\") pod \"migrator-76794cbd6c-dwt52\" (UID: \"352c32dd-8226-421c-b2fa-22211b55209b\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"
Sep 17 17:33:09.993932 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:09.993860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:10.063257 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.063214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms7wk\" (UniqueName: \"kubernetes.io/projected/352c32dd-8226-421c-b2fa-22211b55209b-kube-api-access-ms7wk\") pod \"migrator-76794cbd6c-dwt52\" (UID: \"352c32dd-8226-421c-b2fa-22211b55209b\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"
Sep 17 17:33:10.081766 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.081732    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms7wk\" (UniqueName: \"kubernetes.io/projected/352c32dd-8226-421c-b2fa-22211b55209b-kube-api-access-ms7wk\") pod \"migrator-76794cbd6c-dwt52\" (UID: \"352c32dd-8226-421c-b2fa-22211b55209b\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"
Sep 17 17:33:10.103415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.103389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:10.141295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.141262    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vb6rr"]
Sep 17 17:33:10.144460 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.144439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.150560 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.150531    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 17:33:10.150999 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.150847    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 17:33:10.151166 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.151140    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tztbm\""
Sep 17 17:33:10.153215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.153198    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"
Sep 17 17:33:10.164620 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.164595    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vb6rr"]
Sep 17 17:33:10.205532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.205487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:10.266647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.265246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpqwl\" (UniqueName: \"kubernetes.io/projected/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-api-access-cpqwl\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.266647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.265349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.266647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.265382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-crio-socket\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.266647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.265415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-data-volume\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.266647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.265499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.366701 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.366660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpqwl\" (UniqueName: \"kubernetes.io/projected/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-api-access-cpqwl\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.366856 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.366726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.366856 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.366746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-crio-socket\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.366856 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.366760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-data-volume\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.366856 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.366805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.367023 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.366888    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:10.367023 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.366924    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.367023 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.366893    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-crio-socket\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.367023 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.366972    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:10.866952169 +0000 UTC m=+98.644789796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:10.367023 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.366993    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:10.86698277 +0000 UTC m=+98.644820384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.367215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.367188    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-data-volume\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.377342 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.377316    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpqwl\" (UniqueName: \"kubernetes.io/projected/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-api-access-cpqwl\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.439207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.439168    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52"]
Sep 17 17:33:10.441656 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:10.441626    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352c32dd_8226_421c_b2fa_22211b55209b.slice/crio-4dd474f305c6fbe2f7517a1cb200fb9411521edbbd284effe513bd3682bc49a6 WatchSource:0}: Error finding container 4dd474f305c6fbe2f7517a1cb200fb9411521edbbd284effe513bd3682bc49a6: Status 404 returned error can't find the container with id 4dd474f305c6fbe2f7517a1cb200fb9411521edbbd284effe513bd3682bc49a6
Sep 17 17:33:10.612819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.612736    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:10.746701 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.746659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52" event={"ID":"352c32dd-8226-421c-b2fa-22211b55209b","Type":"ContainerStarted","Data":"4dd474f305c6fbe2f7517a1cb200fb9411521edbbd284effe513bd3682bc49a6"}
Sep 17 17:33:10.843031 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.843001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:10.870552 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.870457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.870715 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.870573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:10.870715 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.870585    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:10.870715 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.870648    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:11.870629178 +0000 UTC m=+99.648466809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:10.870949 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.870930    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.871028 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:10.871011    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:11.870990853 +0000 UTC m=+99.648828480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:10.944036 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:10.943996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:11.314697 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.314662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:11.412573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.412546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:11.578410 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.578387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:33:11.578573 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:11.578552    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:33:11.578638 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:11.578628    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls podName:26901103-f82e-4a36-a715-b5331da026ae nodeName:}" failed. No retries permitted until 2026-09-17 17:34:15.578606592 +0000 UTC m=+163.356444221 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls") pod "dns-default-tdcgr" (UID: "26901103-f82e-4a36-a715-b5331da026ae") : secret "dns-default-metrics-tls" not found
Sep 17 17:33:11.751771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.751734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52" event={"ID":"352c32dd-8226-421c-b2fa-22211b55209b","Type":"ContainerStarted","Data":"0645ecb90b5638f93494b5b362403d1fb647a81e8afe4dcb358319e42a0c6e8b"}
Sep 17 17:33:11.752200 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.751786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52" event={"ID":"352c32dd-8226-421c-b2fa-22211b55209b","Type":"ContainerStarted","Data":"d20fd4b6f2f67935746c9d68922ce1f743d1c883e774dac5f61beb7b6474904f"}
Sep 17 17:33:11.771748 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.771698    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-dwt52" podStartSLOduration=1.767202052 podStartE2EDuration="2.77168275s" totalImagesPullingTime="1.004480698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:11.770868215 +0000 UTC m=+99.548705850" watchObservedRunningTime="2026-09-17 17:33:11.77168275 +0000 UTC m=+99.549520386"
Sep 17 17:33:11.860276 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.860190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:11.881231 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.881203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:11.881357 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:11.881328    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:11.881392 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:11.881353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:11.881426 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:11.881395    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.881376307 +0000 UTC m=+101.659213938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:11.881466 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:11.881448    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:11.881501 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:11.881497    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:13.881486572 +0000 UTC m=+101.659324184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:12.836506 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:12.836479    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsfzf_759dded7-4bac-4cfc-bf37-3fa3fb29e77e/dns-node-resolver/0.log"
Sep 17 17:33:13.026728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.026696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:13.092034 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.091946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:13.092188 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.092097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:13.092188 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.092105    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 17:33:13.092188 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.092170    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:21.092153806 +0000 UTC m=+108.869991419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : secret "router-metrics-certs-default" not found
Sep 17 17:33:13.092289 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.092205    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:21.092194234 +0000 UTC m=+108.870031846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : configmap references non-existent config key: service-ca.crt
Sep 17 17:33:13.123573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.123547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:13.192653 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.192618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:13.192809 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.192772    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:13.192858 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.192846    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls podName:4179cf38-2212-4632-82db-c90a051d0468 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:21.19282951 +0000 UTC m=+108.970667123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tcwdp" (UID: "4179cf38-2212-4632-82db-c90a051d0468") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:13.897916 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.897874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:13.898277 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.897951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:13.898277 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.898030    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:13.898277 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.898055    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:13.898277 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.898103    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:17.898088439 +0000 UTC m=+105.675926056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:13.898277 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:13.898118    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:17.898112538 +0000 UTC m=+105.675950150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:13.912054 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:13.912025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:14.041336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:14.041312    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lb54v_f70ab124-950a-49c5-bace-36954153b7a8/node-ca/0.log"
Sep 17 17:33:14.636700 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:14.636662    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hl7ml_6050df6b-3301-4f75-b63d-8ca8693abf23/serve-healthcheck-canary/0.log"
Sep 17 17:33:15.037191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:15.037162    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-dwt52_352c32dd-8226-421c-b2fa-22211b55209b/migrator/0.log"
Sep 17 17:33:15.239912 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:15.239884    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-dwt52_352c32dd-8226-421c-b2fa-22211b55209b/graceful-termination/0.log"
Sep 17 17:33:15.436840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:15.436747    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-fqb8c_5443ffee-2e98-43f9-b155-4e2ba193356a/kube-storage-version-migrator-operator/0.log"
Sep 17 17:33:16.163452 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:16.163423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:16.263237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:16.263201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:16.363651 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:16.363621    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:16.485974 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:16.485888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:16.568729 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:16.568697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:16.673088 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:16.673059    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l8mpm"
Sep 17 17:33:16.780977 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:16.780947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:17.269299 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:17.269267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:17.665535 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:17.665436    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:17.866277 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:17.866248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:17.931231 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:17.931149    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:17.931231 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:17.931215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:17.931454 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:17.931275    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:33:17.931454 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:17.931305    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:17.931454 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:17.931338    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:25.931322791 +0000 UTC m=+113.709160422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : configmap "kube-rbac-proxy" not found
Sep 17 17:33:17.931454 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:17.931352    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:25.931345651 +0000 UTC m=+113.709183265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:18.255969 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:18.255939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:19.089221 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:19.089189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:19.266575 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:19.266546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:19.666629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:19.666599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:19.880380 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:19.880347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:20.060346 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:20.060311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:20.130177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:20.130141    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:20.263954 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:20.263920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:20.602304 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:20.602275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:21.060750 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.060718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:21.157839 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.157803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:21.158238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.157914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:21.158238 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:21.158086    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle podName:f840393b-d324-47b2-bdf4-9546ade943ae nodeName:}" failed. No retries permitted until 2026-09-17 17:33:37.158069592 +0000 UTC m=+124.935907205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle") pod "router-default-5f5955c464-h8wlh" (UID: "f840393b-d324-47b2-bdf4-9546ade943ae") : configmap references non-existent config key: service-ca.crt
Sep 17 17:33:21.160151 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.160135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f840393b-d324-47b2-bdf4-9546ade943ae-metrics-certs\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:21.259327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.259293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:21.259477 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:21.259414    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:21.259534 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:21.259477    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls podName:4179cf38-2212-4632-82db-c90a051d0468 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:37.259463356 +0000 UTC m=+125.037300982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tcwdp" (UID: "4179cf38-2212-4632-82db-c90a051d0468") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:33:21.287031 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.287004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:21.375788 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.375708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:21.477991 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.477959    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:21.862726 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:21.862691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:22.458291 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:22.458259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:22.805773 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:22.805737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:22.907037 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:22.906999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:23.007701 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:23.007670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:23.107595 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:23.107499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:23.463819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:23.463746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:23.867120 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:23.867085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:24.081050 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:24.081013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:25.072664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:25.072630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:25.263575 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:25.263546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:25.667552 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:25.667505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:25.866150 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:25.866114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:26.001029 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:26.000995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:26.001199 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:26.001148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:26.001302 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:26.001284    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:26.001358 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:26.001349    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls podName:0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:42.001333397 +0000 UTC m=+129.779171051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vb6rr" (UID: "0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:33:26.001563 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:26.001545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:26.468488 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:26.468405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:26.733179 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:26.733086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:26.887742 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:26.887709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:28.708374 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:28.708341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:28.770430 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:28.770400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:31.335145 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:31.335113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:31.405858 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:31.405822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:31.629300 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:31.629215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:31.972380 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:31.972290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:32.031947 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:32.031922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:32.182338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:32.182309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:32.245433 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:32.245368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:32.389633 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:32.389606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:32.988208 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:32.988162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:33.123667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:33.123635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:33.224570 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:33.224537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:34.010163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.010133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:34.075745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.075719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:34.975869 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.975837    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"]
Sep 17 17:33:34.978894 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.978873    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:34.982265 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.982243    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 17:33:34.983153 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.983129    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-24hkh\""
Sep 17 17:33:34.983241 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.983180    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 17:33:34.993648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:34.993625    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"]
Sep 17 17:33:35.071015 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.070986    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:35.104381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.104348    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6765487b5c-k7qgk"]
Sep 17 17:33:35.106602 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.106583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.109719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.109696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b7bq9\""
Sep 17 17:33:35.109830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.109815    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 17:33:35.109904 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.109889    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 17:33:35.110377 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.110363    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 17:33:35.118044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.118026    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 17:33:35.125422 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.125402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6765487b5c-k7qgk"]
Sep 17 17:33:35.158798 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.158769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:35.172730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.172703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/855bb4fd-a8a4-43b3-b72f-f969248355f7-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2xr62\" (UID: \"855bb4fd-a8a4-43b3-b72f-f969248355f7\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:35.172842 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.172736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/855bb4fd-a8a4-43b3-b72f-f969248355f7-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-2xr62\" (UID: \"855bb4fd-a8a4-43b3-b72f-f969248355f7\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:35.227306 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.227228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.273579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/855bb4fd-a8a4-43b3-b72f-f969248355f7-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2xr62\" (UID: \"855bb4fd-a8a4-43b3-b72f-f969248355f7\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-ca-trust-extracted\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/855bb4fd-a8a4-43b3-b72f-f969248355f7-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-2xr62\" (UID: \"855bb4fd-a8a4-43b3-b72f-f969248355f7\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-image-registry-private-configuration\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-registry-tls\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s224x\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-kube-api-access-s224x\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274822    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-registry-certificates\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-trusted-ca\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-installation-pull-secrets\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.274914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-bound-sa-token\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.275652    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/855bb4fd-a8a4-43b3-b72f-f969248355f7-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-2xr62\" (UID: \"855bb4fd-a8a4-43b3-b72f-f969248355f7\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:35.277510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.276645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/855bb4fd-a8a4-43b3-b72f-f969248355f7-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2xr62\" (UID: \"855bb4fd-a8a4-43b3-b72f-f969248355f7\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:35.288076 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.288055    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"
Sep 17 17:33:35.375803 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.375768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-image-registry-private-configuration\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.375979 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.375815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-registry-tls\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.376039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.376000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s224x\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-kube-api-access-s224x\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.376095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.376041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-registry-certificates\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.376095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.376069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-trusted-ca\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.376095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.376085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-installation-pull-secrets\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.376267 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.376103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-bound-sa-token\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.376267 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.376138    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-ca-trust-extracted\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.377044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.377020    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-ca-trust-extracted\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.377482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.377460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-trusted-ca\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.377612 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.377586    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-registry-certificates\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.378283 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.378256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-installation-pull-secrets\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.378451 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.378434    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-registry-tls\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.378492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.378475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-image-registry-private-configuration\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.385559 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.385540    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-bound-sa-token\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.386945 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.386927    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s224x\" (UniqueName: \"kubernetes.io/projected/20dd6a07-fa8a-416c-8f53-a26b28b1bc4a-kube-api-access-s224x\") pod \"image-registry-6765487b5c-k7qgk\" (UID: \"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a\") " pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.415453 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.415429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.558975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.558952    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-2xr62"]
Sep 17 17:33:35.561118 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:35.561086    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855bb4fd_a8a4_43b3_b72f_f969248355f7.slice/crio-3c18c05599eaec472c7bc92830198ecd1d7e6bca54e0c38d70a314019bf7df51 WatchSource:0}: Error finding container 3c18c05599eaec472c7bc92830198ecd1d7e6bca54e0c38d70a314019bf7df51: Status 404 returned error can't find the container with id 3c18c05599eaec472c7bc92830198ecd1d7e6bca54e0c38d70a314019bf7df51
Sep 17 17:33:35.689401 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.689369    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6765487b5c-k7qgk"]
Sep 17 17:33:35.691867 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:35.691838    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20dd6a07_fa8a_416c_8f53_a26b28b1bc4a.slice/crio-ed740d51c31ea18f7a0c929ac76db8ae0b9116db158ddc9444f3d7563e03f481 WatchSource:0}: Error finding container ed740d51c31ea18f7a0c929ac76db8ae0b9116db158ddc9444f3d7563e03f481: Status 404 returned error can't find the container with id ed740d51c31ea18f7a0c929ac76db8ae0b9116db158ddc9444f3d7563e03f481
Sep 17 17:33:35.824122 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.824029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62" event={"ID":"855bb4fd-a8a4-43b3-b72f-f969248355f7","Type":"ContainerStarted","Data":"3c18c05599eaec472c7bc92830198ecd1d7e6bca54e0c38d70a314019bf7df51"}
Sep 17 17:33:35.825474 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.825447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk" event={"ID":"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a","Type":"ContainerStarted","Data":"c7ba458477da5df5dbdea7b4cd1218a4c6e7e47a652e10b8bdaa7224467464a5"}
Sep 17 17:33:35.825620 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.825498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk" event={"ID":"20dd6a07-fa8a-416c-8f53-a26b28b1bc4a","Type":"ContainerStarted","Data":"ed740d51c31ea18f7a0c929ac76db8ae0b9116db158ddc9444f3d7563e03f481"}
Sep 17 17:33:35.825620 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.825558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:33:35.852611 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:35.852553    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk" podStartSLOduration=0.852532223 podStartE2EDuration="852.532223ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:35.851919302 +0000 UTC m=+123.629756938" watchObservedRunningTime="2026-09-17 17:33:35.852532223 +0000 UTC m=+123.630369849"
Sep 17 17:33:36.830559 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:36.830450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62" event={"ID":"855bb4fd-a8a4-43b3-b72f-f969248355f7","Type":"ContainerStarted","Data":"c8a972a299e6da669ce8e907d0596f8003ff9973fc47cc65f2fcadb4b099d5b2"}
Sep 17 17:33:36.855829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:36.855767    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2xr62" podStartSLOduration=1.899298768 podStartE2EDuration="2.855745374s" totalImagesPullingTime="956.446606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:36.854827565 +0000 UTC m=+124.632665200" watchObservedRunningTime="2026-09-17 17:33:36.855745374 +0000 UTC m=+124.633583011"
Sep 17 17:33:36.986669 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:36.986631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:37.044704 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.044672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:37.191645 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.191561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:37.192143 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.192124    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f840393b-d324-47b2-bdf4-9546ade943ae-service-ca-bundle\") pod \"router-default-5f5955c464-h8wlh\" (UID: \"f840393b-d324-47b2-bdf4-9546ade943ae\") " pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:37.292391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.292336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:37.294892 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.294868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4179cf38-2212-4632-82db-c90a051d0468-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tcwdp\" (UID: \"4179cf38-2212-4632-82db-c90a051d0468\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:37.422493 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.422465    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-stmfx\""
Sep 17 17:33:37.430768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.430743    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:37.532811 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.532784    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fm56d\""
Sep 17 17:33:37.540596 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.540576    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"
Sep 17 17:33:37.709619 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.709581    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f5955c464-h8wlh"]
Sep 17 17:33:37.713024 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:37.712998    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf840393b_d324_47b2_bdf4_9546ade943ae.slice/crio-742fc40f8fda32d2a927cc2bedc9a270f3e745242b1351eeda37a109d5c9cffd WatchSource:0}: Error finding container 742fc40f8fda32d2a927cc2bedc9a270f3e745242b1351eeda37a109d5c9cffd: Status 404 returned error can't find the container with id 742fc40f8fda32d2a927cc2bedc9a270f3e745242b1351eeda37a109d5c9cffd
Sep 17 17:33:37.829490 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.829457    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp"]
Sep 17 17:33:37.833029 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:37.833000    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4179cf38_2212_4632_82db_c90a051d0468.slice/crio-fe507201bd752158e300a60ddc54d8c79f8c2cdf5153e286302bc1a8ae5aca79 WatchSource:0}: Error finding container fe507201bd752158e300a60ddc54d8c79f8c2cdf5153e286302bc1a8ae5aca79: Status 404 returned error can't find the container with id fe507201bd752158e300a60ddc54d8c79f8c2cdf5153e286302bc1a8ae5aca79
Sep 17 17:33:37.835411 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.835385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f5955c464-h8wlh" event={"ID":"f840393b-d324-47b2-bdf4-9546ade943ae","Type":"ContainerStarted","Data":"b48424603e2ac186227eeca3f02f6d196778b93377682e7f5bae3af022907036"}
Sep 17 17:33:37.835529 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.835430    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f5955c464-h8wlh" event={"ID":"f840393b-d324-47b2-bdf4-9546ade943ae","Type":"ContainerStarted","Data":"742fc40f8fda32d2a927cc2bedc9a270f3e745242b1351eeda37a109d5c9cffd"}
Sep 17 17:33:37.860452 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:37.860402    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f5955c464-h8wlh" podStartSLOduration=32.860387375 podStartE2EDuration="32.860387375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:37.859944787 +0000 UTC m=+125.637782419" watchObservedRunningTime="2026-09-17 17:33:37.860387375 +0000 UTC m=+125.638225009"
Sep 17 17:33:38.431928 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:38.431896    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:38.434512 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:38.434490    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:38.841067 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:38.841028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp" event={"ID":"4179cf38-2212-4632-82db-c90a051d0468","Type":"ContainerStarted","Data":"fe507201bd752158e300a60ddc54d8c79f8c2cdf5153e286302bc1a8ae5aca79"}
Sep 17 17:33:38.841557 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:38.841284    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:38.842610 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:38.842588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f5955c464-h8wlh"
Sep 17 17:33:39.621462 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:39.621386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:39.727681 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:39.727647    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:39.812745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:39.812707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:39.846422 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:39.846389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp" event={"ID":"4179cf38-2212-4632-82db-c90a051d0468","Type":"ContainerStarted","Data":"9f678fd3473b0a8c079808f3f979c5795e33c249cd95386b53089f544d3cb1a6"}
Sep 17 17:33:39.867046 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:39.867002    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tcwdp" podStartSLOduration=33.413112639 podStartE2EDuration="34.866986902s" totalImagesPullingTime="1.453874263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:39.86618976 +0000 UTC m=+127.644027397" watchObservedRunningTime="2026-09-17 17:33:39.866986902 +0000 UTC m=+127.644824600"
Sep 17 17:33:39.911481 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:39.911407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:42.032743 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.032703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:42.034982 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.034960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6rr\" (UID: \"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7\") " pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:42.256859 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.256826    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tztbm\""
Sep 17 17:33:42.264968 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.264949    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vb6rr"
Sep 17 17:33:42.556712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.556637    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vb6rr"]
Sep 17 17:33:42.559540 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:42.559497    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b52a3ca_a3c8_4dbb_ab70_c7d464e2f1f7.slice/crio-0f3fd353560eb35484c7c00fb9f1a863c7e1ff9627271cf958334a8bc7148b55 WatchSource:0}: Error finding container 0f3fd353560eb35484c7c00fb9f1a863c7e1ff9627271cf958334a8bc7148b55: Status 404 returned error can't find the container with id 0f3fd353560eb35484c7c00fb9f1a863c7e1ff9627271cf958334a8bc7148b55
Sep 17 17:33:42.802754 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.802721    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:42.858134 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.858058    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6rr" event={"ID":"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7","Type":"ContainerStarted","Data":"426be119d5bb90cf84fa9c741284e473eaa175236cef18f895134eb9fca33867"}
Sep 17 17:33:42.858134 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.858112    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6rr" event={"ID":"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7","Type":"ContainerStarted","Data":"0f3fd353560eb35484c7c00fb9f1a863c7e1ff9627271cf958334a8bc7148b55"}
Sep 17 17:33:42.912556 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:42.912508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:43.130719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:43.130645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:43.862406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:43.862371    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6rr" event={"ID":"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7","Type":"ContainerStarted","Data":"720e9cde3f829d72cfce77078b7e3ceb7834a38500c0e6b0f6ccaf8fb9f28a5c"}
Sep 17 17:33:44.150405 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:44.150321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:33:44.152882 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:44.152852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fee2f26-af6a-47ef-a183-f3414e107775-metrics-certs\") pod \"network-metrics-daemon-tv9r5\" (UID: \"4fee2f26-af6a-47ef-a183-f3414e107775\") " pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:33:44.407439 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:44.407368    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-js6ht\""
Sep 17 17:33:44.414658 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:44.414633    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv9r5"
Sep 17 17:33:44.863939 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:44.863910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tv9r5"]
Sep 17 17:33:44.867295 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:44.867268    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fee2f26_af6a_47ef_a183_f3414e107775.slice/crio-a84bfc44bfe40ffae9712c418d44a4d02d9d15fd444d3713d8c703c90b5a358a WatchSource:0}: Error finding container a84bfc44bfe40ffae9712c418d44a4d02d9d15fd444d3713d8c703c90b5a358a: Status 404 returned error can't find the container with id a84bfc44bfe40ffae9712c418d44a4d02d9d15fd444d3713d8c703c90b5a358a
Sep 17 17:33:44.868169 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:44.868144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6rr" event={"ID":"0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7","Type":"ContainerStarted","Data":"b43f605477c9874696bc8c25ac2b30a64591ed761f2a09f90912830ddeaca398"}
Sep 17 17:33:44.891002 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:44.890955    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vb6rr" podStartSLOduration=32.954879343 podStartE2EDuration="34.890939495s" totalImagesPullingTime="1.936060152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:33:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:44.889119083 +0000 UTC m=+132.666956719" watchObservedRunningTime="2026-09-17 17:33:44.890939495 +0000 UTC m=+132.668777129"
Sep 17 17:33:45.873912 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:45.873869    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tv9r5" event={"ID":"4fee2f26-af6a-47ef-a183-f3414e107775","Type":"ContainerStarted","Data":"b8dfa0a3f447190ea08e4d8fb09551ac6b8519d94cf6be3585d567137a93d22d"}
Sep 17 17:33:45.874372 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:45.873947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tv9r5" event={"ID":"4fee2f26-af6a-47ef-a183-f3414e107775","Type":"ContainerStarted","Data":"a84bfc44bfe40ffae9712c418d44a4d02d9d15fd444d3713d8c703c90b5a358a"}
Sep 17 17:33:46.878475 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:46.878433    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tv9r5" event={"ID":"4fee2f26-af6a-47ef-a183-f3414e107775","Type":"ContainerStarted","Data":"4fb7dc2a87c9dde436188e7b3ef4dca2043c8a684bb7f0346b6f1383e62aecb7"}
Sep 17 17:33:46.899664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:46.896624    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tv9r5" podStartSLOduration=132.023026076 podStartE2EDuration="2m12.896601465s" totalImagesPullingTime="873.575389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:46.896326169 +0000 UTC m=+134.674163805" watchObservedRunningTime="2026-09-17 17:33:46.896601465 +0000 UTC m=+134.674439101"
Sep 17 17:33:47.011802 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:47.011772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:47.099807 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:47.099774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:49.854844 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:49.854817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:49.956489 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:49.956451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:53.419857 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:53.419825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:53.484064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:53.484039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:53.898285 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:53.898252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:55.420144 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:55.420098    2559 patch_prober.go:28] interesting pod/image-registry-6765487b5c-k7qgk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 17:33:55.420550 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:55.420162    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk" podUID="20dd6a07-fa8a-416c-8f53-a26b28b1bc4a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:33:55.946893 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:55.946857    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.156271 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.156236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.226493 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.226416    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-6shrt"]
Sep 17 17:33:56.229809 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.229792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.233824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.233787    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qd94s\""
Sep 17 17:33:56.233824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.233802    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 17 17:33:56.234040 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.233831    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 17:33:56.234040 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.233899    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 17 17:33:56.234163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.234145    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 17 17:33:56.249124 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.249089    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-6shrt"]
Sep 17 17:33:56.263716 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.263685    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tjqfb"]
Sep 17 17:33:56.264959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.264934    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.267422 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.267402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.274304 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.274276    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 17:33:56.274407 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.274296    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 17:33:56.274780 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.274756    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 17:33:56.274780 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.274776    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xkwcs\""
Sep 17 17:33:56.347976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.347943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.347976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.347984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-wtmp\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tjvs\" (UniqueName: \"kubernetes.io/projected/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-api-access-4tjvs\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.348212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xswft\" (UniqueName: \"kubernetes.io/projected/6952b611-7d9f-4440-a148-c7600df46cd1-kube-api-access-xswft\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-sys\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dece29b-723c-4cd6-8d28-80a6e877524a-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.348212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-textfile\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348187    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-root\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348550 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348550 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6952b611-7d9f-4440-a148-c7600df46cd1-metrics-client-ca\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.348550 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dece29b-723c-4cd6-8d28-80a6e877524a-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.348550 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.348550 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.348550 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.348500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.365990 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.365960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.449706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-wtmp\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjvs\" (UniqueName: \"kubernetes.io/projected/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-api-access-4tjvs\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xswft\" (UniqueName: \"kubernetes.io/projected/6952b611-7d9f-4440-a148-c7600df46cd1-kube-api-access-xswft\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-sys\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:56.449924    2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dece29b-723c-4cd6-8d28-80a6e877524a-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.449986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-textfile\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:56.450013    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-tls podName:6dece29b-723c-4cd6-8d28-80a6e877524a nodeName:}" failed. No retries permitted until 2026-09-17 17:33:56.949990904 +0000 UTC m=+144.727828523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-6shrt" (UID: "6dece29b-723c-4cd6-8d28-80a6e877524a") : secret "kube-state-metrics-tls" not found
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450049    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-sys\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-root\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-root\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.450195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6952b611-7d9f-4440-a148-c7600df46cd1-metrics-client-ca\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dece29b-723c-4cd6-8d28-80a6e877524a-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450263    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-textfile\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450011    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-wtmp\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:56.450356    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:56.450403    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls podName:6952b611-7d9f-4440-a148-c7600df46cd1 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:56.950388259 +0000 UTC m=+144.728225886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls") pod "node-exporter-tjqfb" (UID: "6952b611-7d9f-4440-a148-c7600df46cd1") : secret "node-exporter-tls" not found
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dece29b-723c-4cd6-8d28-80a6e877524a-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.451032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.450803    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6952b611-7d9f-4440-a148-c7600df46cd1-metrics-client-ca\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.451332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.451078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dece29b-723c-4cd6-8d28-80a6e877524a-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.452474 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.452450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.452643 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.452586    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.462468 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.462444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xswft\" (UniqueName: \"kubernetes.io/projected/6952b611-7d9f-4440-a148-c7600df46cd1-kube-api-access-xswft\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.462608 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.462480    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tjvs\" (UniqueName: \"kubernetes.io/projected/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-api-access-4tjvs\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.463856 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.463831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.589843 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.589814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.690721 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.690692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.812453 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.812420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.835602 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.835571    2559 patch_prober.go:28] interesting pod/image-registry-6765487b5c-k7qgk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 17:33:56.835789 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.835627    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk" podUID="20dd6a07-fa8a-416c-8f53-a26b28b1bc4a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:33:56.937712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.937623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:56.954589 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.954557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:56.954776 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.954623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:56.954776 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:56.954726    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 17:33:56.954880 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:56.954787    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls podName:6952b611-7d9f-4440-a148-c7600df46cd1 nodeName:}" failed. No retries permitted until 2026-09-17 17:33:57.954772472 +0000 UTC m=+145.732610084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls") pod "node-exporter-tjqfb" (UID: "6952b611-7d9f-4440-a148-c7600df46cd1") : secret "node-exporter-tls" not found
Sep 17 17:33:56.957155 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:56.957128    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dece29b-723c-4cd6-8d28-80a6e877524a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-6shrt\" (UID: \"6dece29b-723c-4cd6-8d28-80a6e877524a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:57.139216 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.139180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt"
Sep 17 17:33:57.214310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.214274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:57.306610 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.306580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:57.309335 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.309311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 17:33:57.313131 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.313115    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.315632 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.315606    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 17:33:57.315812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.315679    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kgwsb\""
Sep 17 17:33:57.315943 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.315839    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 17:33:57.315943 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.315889    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 17:33:57.316111 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.316030    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 17:33:57.316191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.316112    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 17:33:57.316191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.316119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 17:33:57.316191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.316136    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 17:33:57.316191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.316139    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 17:33:57.321454 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.316796    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 17:33:57.333237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.333213    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 17:33:57.357944 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.357906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.357979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-config-volume\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358146    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69288e4e-fd41-4910-a78f-0d38feb6e19a-config-out\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358349 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358349 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358349 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358349 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mn5\" (UniqueName: \"kubernetes.io/projected/69288e4e-fd41-4910-a78f-0d38feb6e19a-kube-api-access-v7mn5\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358499 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358499 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-web-config\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.358695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.358494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69288e4e-fd41-4910-a78f-0d38feb6e19a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.423080 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.423050    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-6shrt"]
Sep 17 17:33:57.423434 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.423413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:57.425877 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:57.425853    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dece29b_723c_4cd6_8d28_80a6e877524a.slice/crio-71b0337661eb2dcd1500d198ff4091e2533e7d269af422636d6225bd746b25f3 WatchSource:0}: Error finding container 71b0337661eb2dcd1500d198ff4091e2533e7d269af422636d6225bd746b25f3: Status 404 returned error can't find the container with id 71b0337661eb2dcd1500d198ff4091e2533e7d269af422636d6225bd746b25f3
Sep 17 17:33:57.460045 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.459965    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460045 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.459999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-web-config\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460045 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69288e4e-fd41-4910-a78f-0d38feb6e19a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460494 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460494 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460494 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460494 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-config-volume\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460494 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460494 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:33:57.460448    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-trusted-ca-bundle podName:69288e4e-fd41-4910-a78f-0d38feb6e19a nodeName:}" failed. No retries permitted until 2026-09-17 17:33:57.960423654 +0000 UTC m=+145.738261284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "69288e4e-fd41-4910-a78f-0d38feb6e19a") : configmap references non-existent config key: ca-bundle.crt
Sep 17 17:33:57.460817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69288e4e-fd41-4910-a78f-0d38feb6e19a-config-out\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460977 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.460977 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.460874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mn5\" (UniqueName: \"kubernetes.io/projected/69288e4e-fd41-4910-a78f-0d38feb6e19a-kube-api-access-v7mn5\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.461073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.461054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.461149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.461126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.463406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.463375    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69288e4e-fd41-4910-a78f-0d38feb6e19a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.463817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.463791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69288e4e-fd41-4910-a78f-0d38feb6e19a-config-out\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.463965 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.463947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.464063 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.463951    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.464391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.464369    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.464762 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.464743    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-web-config\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.464983 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.464941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-config-volume\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.465315 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.465297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.465478 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.465457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69288e4e-fd41-4910-a78f-0d38feb6e19a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.470015 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.469994    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mn5\" (UniqueName: \"kubernetes.io/projected/69288e4e-fd41-4910-a78f-0d38feb6e19a-kube-api-access-v7mn5\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.546203 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.546165    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:57.915366 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.915330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt" event={"ID":"6dece29b-723c-4cd6-8d28-80a6e877524a","Type":"ContainerStarted","Data":"71b0337661eb2dcd1500d198ff4091e2533e7d269af422636d6225bd746b25f3"}
Sep 17 17:33:57.965096 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.965061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.965302 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.965140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:57.966090 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.966060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69288e4e-fd41-4910-a78f-0d38feb6e19a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69288e4e-fd41-4910-a78f-0d38feb6e19a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:57.968044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:57.968021    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6952b611-7d9f-4440-a148-c7600df46cd1-node-exporter-tls\") pod \"node-exporter-tjqfb\" (UID: \"6952b611-7d9f-4440-a148-c7600df46cd1\") " pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:58.046878 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.046844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:58.076897 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.076855    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjqfb"
Sep 17 17:33:58.090120 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:58.090082    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6952b611_7d9f_4440_a148_c7600df46cd1.slice/crio-e95517c21a80329ddbcb989e679f7c0d508de442d45ffcb9bdf05bf6ee615bb8 WatchSource:0}: Error finding container e95517c21a80329ddbcb989e679f7c0d508de442d45ffcb9bdf05bf6ee615bb8: Status 404 returned error can't find the container with id e95517c21a80329ddbcb989e679f7c0d508de442d45ffcb9bdf05bf6ee615bb8
Sep 17 17:33:58.147458 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.147422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:58.227418 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.227334    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:33:58.524488 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.524456    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 17:33:58.562467 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:33:58.562435    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69288e4e_fd41_4910_a78f_0d38feb6e19a.slice/crio-deabba43ed731c8bd46f56aa554ca2c8dd851cee21f46ecac838db0e4ef84444 WatchSource:0}: Error finding container deabba43ed731c8bd46f56aa554ca2c8dd851cee21f46ecac838db0e4ef84444: Status 404 returned error can't find the container with id deabba43ed731c8bd46f56aa554ca2c8dd851cee21f46ecac838db0e4ef84444
Sep 17 17:33:58.924897 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.924862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt" event={"ID":"6dece29b-723c-4cd6-8d28-80a6e877524a","Type":"ContainerStarted","Data":"8ee491d220bbf16478ab48338298a10018a90f48add10a0eb29d9035eb86dd06"}
Sep 17 17:33:58.925080 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.924943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt" event={"ID":"6dece29b-723c-4cd6-8d28-80a6e877524a","Type":"ContainerStarted","Data":"e88486a1d11e634e5375c5ab4953decfaa3f2cac5f35d11362fca0dba86b9534"}
Sep 17 17:33:58.925080 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.924975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt" event={"ID":"6dece29b-723c-4cd6-8d28-80a6e877524a","Type":"ContainerStarted","Data":"270f9fccf8aa64c60589d85a3b88bbdb66840aee4689a8e6aa4f82ce835e9c75"}
Sep 17 17:33:58.927199 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.927152    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerStarted","Data":"deabba43ed731c8bd46f56aa554ca2c8dd851cee21f46ecac838db0e4ef84444"}
Sep 17 17:33:58.929147 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.929114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjqfb" event={"ID":"6952b611-7d9f-4440-a148-c7600df46cd1","Type":"ContainerStarted","Data":"e95517c21a80329ddbcb989e679f7c0d508de442d45ffcb9bdf05bf6ee615bb8"}
Sep 17 17:33:58.961340 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:58.961279    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-6shrt" podStartSLOduration=1.781878663 podStartE2EDuration="2.961261183s" totalImagesPullingTime="1.17938252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:33:58.96095694 +0000 UTC m=+146.738794576" watchObservedRunningTime="2026-09-17 17:33:58.961261183 +0000 UTC m=+146.739098819"
Sep 17 17:33:59.264476 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.264436    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:59.343478 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.343443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:59.433710 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.433678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:59.868754 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.868724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:33:59.938764 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.938725    2559 generic.go:356] "Generic (PLEG): container finished" podID="6952b611-7d9f-4440-a148-c7600df46cd1" containerID="17d11493cedd5177d6fd97d138030bc8c1a43805c7dccf9af66f58c3f5237e40" exitCode=0
Sep 17 17:33:59.938909 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.938804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjqfb" event={"ID":"6952b611-7d9f-4440-a148-c7600df46cd1","Type":"ContainerDied","Data":"17d11493cedd5177d6fd97d138030bc8c1a43805c7dccf9af66f58c3f5237e40"}
Sep 17 17:33:59.940504 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.940483    2559 generic.go:356] "Generic (PLEG): container finished" podID="69288e4e-fd41-4910-a78f-0d38feb6e19a" containerID="e4b976135f24cf784a8b7444e1ffbac0a1854dc279248cd7eac6fc581f414f12" exitCode=0
Sep 17 17:33:59.940609 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.940545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerDied","Data":"e4b976135f24cf784a8b7444e1ffbac0a1854dc279248cd7eac6fc581f414f12"}
Sep 17 17:33:59.985097 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:33:59.985053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:00.089309 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.089227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:00.658293 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.658257    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"]
Sep 17 17:34:00.661471 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.661453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.665039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.664995    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 17:34:00.665198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.664995    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 17:34:00.665198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.665087    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 17:34:00.665198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.664995    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 17:34:00.665198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.664995    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2zfv5\""
Sep 17 17:34:00.665491 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.665001    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5gf8pskot5qef\""
Sep 17 17:34:00.674097 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.674072    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"]
Sep 17 17:34:00.791386 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.791351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fzwc\" (UniqueName: \"kubernetes.io/projected/ef2353b9-f1a1-4002-8131-cdeb5254ba49-kube-api-access-4fzwc\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.791386 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.791390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ef2353b9-f1a1-4002-8131-cdeb5254ba49-metrics-server-audit-profiles\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.791648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.791414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef2353b9-f1a1-4002-8131-cdeb5254ba49-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.791648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.791466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-secret-metrics-server-client-certs\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.791648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.791550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ef2353b9-f1a1-4002-8131-cdeb5254ba49-audit-log\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.791648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.791583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-secret-metrics-server-tls\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.791648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.791619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-client-ca-bundle\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.892670 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.892634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ef2353b9-f1a1-4002-8131-cdeb5254ba49-audit-log\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.892670 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.892671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-secret-metrics-server-tls\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.892705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-client-ca-bundle\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.892764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fzwc\" (UniqueName: \"kubernetes.io/projected/ef2353b9-f1a1-4002-8131-cdeb5254ba49-kube-api-access-4fzwc\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.892786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ef2353b9-f1a1-4002-8131-cdeb5254ba49-metrics-server-audit-profiles\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.892931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef2353b9-f1a1-4002-8131-cdeb5254ba49-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.892981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-secret-metrics-server-client-certs\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.893066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ef2353b9-f1a1-4002-8131-cdeb5254ba49-audit-log\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.893594    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef2353b9-f1a1-4002-8131-cdeb5254ba49-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.893918 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.893894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ef2353b9-f1a1-4002-8131-cdeb5254ba49-metrics-server-audit-profiles\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.895321 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.895295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-secret-metrics-server-tls\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.895321 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.895311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-client-ca-bundle\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.895483 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.895461    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ef2353b9-f1a1-4002-8131-cdeb5254ba49-secret-metrics-server-client-certs\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.902939 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.902914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fzwc\" (UniqueName: \"kubernetes.io/projected/ef2353b9-f1a1-4002-8131-cdeb5254ba49-kube-api-access-4fzwc\") pod \"metrics-server-7cdb6f78fb-dzhfw\" (UID: \"ef2353b9-f1a1-4002-8131-cdeb5254ba49\") " pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.948310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.948226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjqfb" event={"ID":"6952b611-7d9f-4440-a148-c7600df46cd1","Type":"ContainerStarted","Data":"54d9264d7203fcf685f412e492ac28cc3de4998488814dd3c591f881de3bd306"}
Sep 17 17:34:00.948310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.948286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjqfb" event={"ID":"6952b611-7d9f-4440-a148-c7600df46cd1","Type":"ContainerStarted","Data":"54e5fe23450de2fc8318c6c4efcbe878b2a1ada453c3ac4636bbd742df07bcc2"}
Sep 17 17:34:00.971183 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.971152    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:00.977901 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.977859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:00.983188 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.983138    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tjqfb" podStartSLOduration=3.791414057 podStartE2EDuration="4.983116391s" totalImagesPullingTime="1.119766033s" totalInitContainerRuntime="71.936301ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:00.982643804 +0000 UTC m=+148.760481439" watchObservedRunningTime="2026-09-17 17:34:00.983116391 +0000 UTC m=+148.760954027"
Sep 17 17:34:00.988119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.988093    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"]
Sep 17 17:34:00.991987 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.991964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:00.995168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.995144    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lf9hc\""
Sep 17 17:34:00.995341 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:00.995326    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 17:34:01.002906 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.002883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"]
Sep 17 17:34:01.050272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.050243    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:01.094431 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.094400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g7hw\" (UniqueName: \"kubernetes.io/projected/c7484083-69b5-4b0e-a9c4-faf4ebcdb603-kube-api-access-7g7hw\") pod \"monitoring-plugin-5984459ff8-7fp56\" (UID: \"c7484083-69b5-4b0e-a9c4-faf4ebcdb603\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:01.094640 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.094474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7484083-69b5-4b0e-a9c4-faf4ebcdb603-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-7fp56\" (UID: \"c7484083-69b5-4b0e-a9c4-faf4ebcdb603\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:01.143060 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.143006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:01.195402 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.195362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g7hw\" (UniqueName: \"kubernetes.io/projected/c7484083-69b5-4b0e-a9c4-faf4ebcdb603-kube-api-access-7g7hw\") pod \"monitoring-plugin-5984459ff8-7fp56\" (UID: \"c7484083-69b5-4b0e-a9c4-faf4ebcdb603\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:01.195626 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.195432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7484083-69b5-4b0e-a9c4-faf4ebcdb603-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-7fp56\" (UID: \"c7484083-69b5-4b0e-a9c4-faf4ebcdb603\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:01.198412 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.198350    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7484083-69b5-4b0e-a9c4-faf4ebcdb603-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-7fp56\" (UID: \"c7484083-69b5-4b0e-a9c4-faf4ebcdb603\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:01.205978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.205955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g7hw\" (UniqueName: \"kubernetes.io/projected/c7484083-69b5-4b0e-a9c4-faf4ebcdb603-kube-api-access-7g7hw\") pod \"monitoring-plugin-5984459ff8-7fp56\" (UID: \"c7484083-69b5-4b0e-a9c4-faf4ebcdb603\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:01.303371 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.303330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:01.589986 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.589828    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"]
Sep 17 17:34:01.592457 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:34:01.592423    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7484083_69b5_4b0e_a9c4_faf4ebcdb603.slice/crio-bdb3e47fa7448ccdbc73e0b6392df20b4b44364f5e731dc309745efc25eb4e1c WatchSource:0}: Error finding container bdb3e47fa7448ccdbc73e0b6392df20b4b44364f5e731dc309745efc25eb4e1c: Status 404 returned error can't find the container with id bdb3e47fa7448ccdbc73e0b6392df20b4b44364f5e731dc309745efc25eb4e1c
Sep 17 17:34:01.593660 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.593639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"]
Sep 17 17:34:01.596161 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:34:01.596132    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2353b9_f1a1_4002_8131_cdeb5254ba49.slice/crio-087c0d7483219a831203743715e9e3981c850474f76927cca613240bf1326b45 WatchSource:0}: Error finding container 087c0d7483219a831203743715e9e3981c850474f76927cca613240bf1326b45: Status 404 returned error can't find the container with id 087c0d7483219a831203743715e9e3981c850474f76927cca613240bf1326b45
Sep 17 17:34:01.956107 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.956070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerStarted","Data":"c090a3c918ec767e5f12d194a7b8ce6c9a38b140c88b076619aba5dc1ead7f23"}
Sep 17 17:34:01.956586 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.956155    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerStarted","Data":"5effd2dd20c0fe53e823d96a6e8d34d4e7e7b450f32fcade9cef905a98f99297"}
Sep 17 17:34:01.956586 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.956198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerStarted","Data":"39f9888afb67b89ffff1fca61e42ade970728b74d7f1172ef2e10df1189f08f3"}
Sep 17 17:34:01.956586 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.956228    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerStarted","Data":"8439c0f6076400e92b3ee34490cb4387edcc63b3e46d68331a75a7280224c8d0"}
Sep 17 17:34:01.956586 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.956259    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerStarted","Data":"6c12b1979befc1e21a4e9890c9c206c79a71f255c49603b15a693c859a034a87"}
Sep 17 17:34:01.957416 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.957392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56" event={"ID":"c7484083-69b5-4b0e-a9c4-faf4ebcdb603","Type":"ContainerStarted","Data":"bdb3e47fa7448ccdbc73e0b6392df20b4b44364f5e731dc309745efc25eb4e1c"}
Sep 17 17:34:01.958505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:01.958485    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw" event={"ID":"ef2353b9-f1a1-4002-8131-cdeb5254ba49","Type":"ContainerStarted","Data":"087c0d7483219a831203743715e9e3981c850474f76927cca613240bf1326b45"}
Sep 17 17:34:02.667598 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:02.667545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:02.790337 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:02.790291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:02.884321 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:02.884237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:03.678934 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:03.678898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:03.968115 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:03.968021    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56" event={"ID":"c7484083-69b5-4b0e-a9c4-faf4ebcdb603","Type":"ContainerStarted","Data":"7803810c6f1d573e5ea5e5e69f940fe47f60e521f187b6e610d4e30cd4ad78db"}
Sep 17 17:34:03.968278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:03.968210    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:03.969771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:03.969742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw" event={"ID":"ef2353b9-f1a1-4002-8131-cdeb5254ba49","Type":"ContainerStarted","Data":"44b4c5d63d5c5797aff1b3322046fb6184144ccf3eb4189055431dc4a7b71bd5"}
Sep 17 17:34:03.973148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:03.973127    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56"
Sep 17 17:34:03.973357 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:03.973339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69288e4e-fd41-4910-a78f-0d38feb6e19a","Type":"ContainerStarted","Data":"0137c4088c97b76233524605a13603db14628583f86459472199bc59ed649c4b"}
Sep 17 17:34:03.985828 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:03.985780    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-7fp56" podStartSLOduration=2.3330948449999998 podStartE2EDuration="3.985764289s" totalImagesPullingTime="1.652669444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:03.984112045 +0000 UTC m=+151.761949680" watchObservedRunningTime="2026-09-17 17:34:03.985764289 +0000 UTC m=+151.763601924"
Sep 17 17:34:04.029739 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:04.029688    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw" podStartSLOduration=2.377817119 podStartE2EDuration="4.029671837s" totalImagesPullingTime="1.651854718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:04.028091678 +0000 UTC m=+151.805929314" watchObservedRunningTime="2026-09-17 17:34:04.029671837 +0000 UTC m=+151.807509543"
Sep 17 17:34:04.067680 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:04.067618    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.853464664 podStartE2EDuration="7.067593067s" totalImagesPullingTime="4.199342152s" totalInitContainerRuntime="14.786251ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:33:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:04.065924163 +0000 UTC m=+151.843761830" watchObservedRunningTime="2026-09-17 17:34:04.067593067 +0000 UTC m=+151.845430702"
Sep 17 17:34:04.749249 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:04.749196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:04.850149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:04.850104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:05.420367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:05.420332    2559 patch_prober.go:28] interesting pod/image-registry-6765487b5c-k7qgk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 17:34:05.420547 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:05.420390    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk" podUID="20dd6a07-fa8a-416c-8f53-a26b28b1bc4a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:34:06.582753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:06.582719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:06.664915 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:06.664882    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:06.835427 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:06.835343    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6765487b5c-k7qgk"
Sep 17 17:34:06.969182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:06.969140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:07.042818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:07.042783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:07.359601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:07.359570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:07.457071 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:07.457035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:08.261813 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:08.261775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:08.361492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:08.361461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:10.734355 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:34:10.734321    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tdcgr" podUID="26901103-f82e-4a36-a715-b5331da026ae"
Sep 17 17:34:11.002064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:11.002037    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:34:11.216297 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:11.216267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:11.350907 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:11.350836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:11.450089 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:11.450060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:13.715485 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:13.715456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:13.815264 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:13.815233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:15.625581 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:15.625546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:34:15.628078 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:15.628049    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26901103-f82e-4a36-a715-b5331da026ae-metrics-tls\") pod \"dns-default-tdcgr\" (UID: \"26901103-f82e-4a36-a715-b5331da026ae\") " pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:34:15.682633 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:15.682602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:15.780367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:15.780338    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:15.806352 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:15.806320    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fv9xq\""
Sep 17 17:34:15.814305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:15.814280    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:34:16.093899 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:16.093785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tdcgr"]
Sep 17 17:34:16.096393 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:34:16.096365    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26901103_f82e_4a36_a715_b5331da026ae.slice/crio-2d0ae3c3b1c77d817eafae77f408ff58be4556595f9eb47b4a0709839e40b6a9 WatchSource:0}: Error finding container 2d0ae3c3b1c77d817eafae77f408ff58be4556595f9eb47b4a0709839e40b6a9: Status 404 returned error can't find the container with id 2d0ae3c3b1c77d817eafae77f408ff58be4556595f9eb47b4a0709839e40b6a9
Sep 17 17:34:17.026928 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:17.026888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tdcgr" event={"ID":"26901103-f82e-4a36-a715-b5331da026ae","Type":"ContainerStarted","Data":"2d0ae3c3b1c77d817eafae77f408ff58be4556595f9eb47b4a0709839e40b6a9"}
Sep 17 17:34:17.730468 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:17.730425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:17.831862 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:17.831830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:17.933949 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:17.933913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:18.032638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:18.032605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tdcgr" event={"ID":"26901103-f82e-4a36-a715-b5331da026ae","Type":"ContainerStarted","Data":"8a3b8d2336d1ca0ec95156d3b3b84b586692c06a1f93ddab9283da5ec3645f88"}
Sep 17 17:34:18.033035 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:18.032658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tdcgr" event={"ID":"26901103-f82e-4a36-a715-b5331da026ae","Type":"ContainerStarted","Data":"87066bca4dc2bc8fbe28f5c75d3e1a7ffaf0644d53c7ffa388cc5a3f25f13082"}
Sep 17 17:34:18.033035 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:18.032696    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:34:20.972043 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:20.972004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:20.972449 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:20.972070    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:22.653182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:22.653150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:22.755678 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:22.755645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:28.039203 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:28.039170    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tdcgr"
Sep 17 17:34:28.070719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:28.070660    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tdcgr" podStartSLOduration=139.372465385 podStartE2EDuration="2m21.070644117s" totalImagesPullingTime="1.698178732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:18.054063308 +0000 UTC m=+165.831900942" watchObservedRunningTime="2026-09-17 17:34:28.070644117 +0000 UTC m=+175.848481752"
Sep 17 17:34:35.098884 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:35.098847    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a112cc5-b12f-4e93-9cd7-89fdbbdafef3" containerID="7b7ae2ff2a9b22f9b60f7a61323d49878a312461ae1a19e904f4342e6b6feb08" exitCode=0
Sep 17 17:34:35.099386 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:35.098921    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg" event={"ID":"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3","Type":"ContainerDied","Data":"7b7ae2ff2a9b22f9b60f7a61323d49878a312461ae1a19e904f4342e6b6feb08"}
Sep 17 17:34:35.099386 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:35.099332    2559 scope.go:117] "RemoveContainer" containerID="7b7ae2ff2a9b22f9b60f7a61323d49878a312461ae1a19e904f4342e6b6feb08"
Sep 17 17:34:35.100569 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:35.100538    2559 generic.go:356] "Generic (PLEG): container finished" podID="5e2960d0-70bf-4e2e-b475-7056b0aeb225" containerID="97e2cfe9400454b74d6ae3a7065e8e5607c283ac59056a81e066aab86e64adcb" exitCode=0
Sep 17 17:34:35.100693 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:35.100569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn" event={"ID":"5e2960d0-70bf-4e2e-b475-7056b0aeb225","Type":"ContainerDied","Data":"97e2cfe9400454b74d6ae3a7065e8e5607c283ac59056a81e066aab86e64adcb"}
Sep 17 17:34:35.100854 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:35.100841    2559 scope.go:117] "RemoveContainer" containerID="97e2cfe9400454b74d6ae3a7065e8e5607c283ac59056a81e066aab86e64adcb"
Sep 17 17:34:36.106984 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:36.106950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-z9tfg" event={"ID":"3a112cc5-b12f-4e93-9cd7-89fdbbdafef3","Type":"ContainerStarted","Data":"207c50ec949893393909ef3e045fb311f054811fb74bf9e283aa7b2e28499477"}
Sep 17 17:34:36.108827 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:36.108804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhtmn" event={"ID":"5e2960d0-70bf-4e2e-b475-7056b0aeb225","Type":"ContainerStarted","Data":"a53dafc837451df326f1d971aeb0af8a917210f271c4a9e12a98ae6a64dbd95e"}
Sep 17 17:34:37.259657 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:37.259621    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:37.328100 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:37.328070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:40.125825 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:40.125790    2559 generic.go:356] "Generic (PLEG): container finished" podID="5443ffee-2e98-43f9-b155-4e2ba193356a" containerID="9adaf8c7cfb5e5e462e78ee73ce9cc387433150bd452d4e2b4e49297c12f3943" exitCode=0
Sep 17 17:34:40.126213 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:40.125862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c" event={"ID":"5443ffee-2e98-43f9-b155-4e2ba193356a","Type":"ContainerDied","Data":"9adaf8c7cfb5e5e462e78ee73ce9cc387433150bd452d4e2b4e49297c12f3943"}
Sep 17 17:34:40.126213 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:40.126201    2559 scope.go:117] "RemoveContainer" containerID="9adaf8c7cfb5e5e462e78ee73ce9cc387433150bd452d4e2b4e49297c12f3943"
Sep 17 17:34:40.977101 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:40.977069    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:40.982648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:40.982621    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cdb6f78fb-dzhfw"
Sep 17 17:34:41.131916 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:41.131881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-fqb8c" event={"ID":"5443ffee-2e98-43f9-b155-4e2ba193356a","Type":"ContainerStarted","Data":"02eca041ecf99148eb3fa0121fad69ba2c08b3956270a2d8dc21b2b993ad92d8"}
Sep 17 17:34:43.715791 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:43.715758    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:43.790680 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:34:43.790647    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:12.616737 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:12.616700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:12.705852 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:12.705815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:18.177242 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:18.177207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:18.258178 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:18.258143    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:24.572790 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:24.572755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:24.652840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:24.652812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:28.734361 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:28.734327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:28.848447 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:28.848418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:28.939982 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:28.939939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:31.427167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:31.427130    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:42.114548 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:42.114503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:42.213057 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:42.213027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:42.293308 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:35:42.293269    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:02.243599 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:02.243501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:02.345790 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:02.345755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:07.096356 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.096324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:07.187103 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.187073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:07.888889 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.888851    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"]
Sep 17 17:36:07.892546 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.892508    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:07.895330 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.895313    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 17:36:07.895423 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.895361    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 17:36:07.896549 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.896534    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nmslq\""
Sep 17 17:36:07.908075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:07.908053    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"]
Sep 17 17:36:08.069123 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.069082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh298\" (UniqueName: \"kubernetes.io/projected/fd5b304d-e932-4b33-b4b9-27836b0d8884-kube-api-access-gh298\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.069123 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.069124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.069338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.069235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.170280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.170180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh298\" (UniqueName: \"kubernetes.io/projected/fd5b304d-e932-4b33-b4b9-27836b0d8884-kube-api-access-gh298\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.170280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.170232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.170791 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.170298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.170791 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.170647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.170791 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.170713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.183270 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.181357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh298\" (UniqueName: \"kubernetes.io/projected/fd5b304d-e932-4b33-b4b9-27836b0d8884-kube-api-access-gh298\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.201719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.201688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:08.479299 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:08.479158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"]
Sep 17 17:36:08.482249 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:36:08.482218    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5b304d_e932_4b33_b4b9_27836b0d8884.slice/crio-4883c7bc8ecde32205c66967237905f68a83547ae1e3bdcee5074d8876a5daea WatchSource:0}: Error finding container 4883c7bc8ecde32205c66967237905f68a83547ae1e3bdcee5074d8876a5daea: Status 404 returned error can't find the container with id 4883c7bc8ecde32205c66967237905f68a83547ae1e3bdcee5074d8876a5daea
Sep 17 17:36:09.481505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:09.481470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj" event={"ID":"fd5b304d-e932-4b33-b4b9-27836b0d8884","Type":"ContainerStarted","Data":"4883c7bc8ecde32205c66967237905f68a83547ae1e3bdcee5074d8876a5daea"}
Sep 17 17:36:15.508092 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:15.508056    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerID="0a508224833a79a8d422dfdcc8bd31b15fbda39a26ad471b3fed340ecf67ee59" exitCode=0
Sep 17 17:36:15.508470 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:15.508145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj" event={"ID":"fd5b304d-e932-4b33-b4b9-27836b0d8884","Type":"ContainerDied","Data":"0a508224833a79a8d422dfdcc8bd31b15fbda39a26ad471b3fed340ecf67ee59"}
Sep 17 17:36:18.522986 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:18.522951    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerID="3749e07e9b8c80b1782962adefcfd2e44c52d5542b17e29315932f662891eca8" exitCode=0
Sep 17 17:36:18.523463 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:18.523002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj" event={"ID":"fd5b304d-e932-4b33-b4b9-27836b0d8884","Type":"ContainerDied","Data":"3749e07e9b8c80b1782962adefcfd2e44c52d5542b17e29315932f662891eca8"}
Sep 17 17:36:25.563089 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:25.563047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj" event={"ID":"fd5b304d-e932-4b33-b4b9-27836b0d8884","Type":"ContainerStarted","Data":"b214edf64313312f2cc53f91d0c3698d16e0cb0e468bf0330e8825942f0fdd4e"}
Sep 17 17:36:25.586359 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:25.586305    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj" podStartSLOduration=3.302733214 podStartE2EDuration="18.586286616s" totalImagesPullingTime="15.283553402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:25.584336312 +0000 UTC m=+293.362173947" watchObservedRunningTime="2026-09-17 17:36:25.586286616 +0000 UTC m=+293.364124275"
Sep 17 17:36:26.569002 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:26.568966    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerID="b214edf64313312f2cc53f91d0c3698d16e0cb0e468bf0330e8825942f0fdd4e" exitCode=0
Sep 17 17:36:26.569368 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:26.569052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj" event={"ID":"fd5b304d-e932-4b33-b4b9-27836b0d8884","Type":"ContainerDied","Data":"b214edf64313312f2cc53f91d0c3698d16e0cb0e468bf0330e8825942f0fdd4e"}
Sep 17 17:36:27.702312 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.702287    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:27.737972 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.737937    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh298\" (UniqueName: \"kubernetes.io/projected/fd5b304d-e932-4b33-b4b9-27836b0d8884-kube-api-access-gh298\") pod \"fd5b304d-e932-4b33-b4b9-27836b0d8884\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") "
Sep 17 17:36:27.738147 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.737994    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-bundle\") pod \"fd5b304d-e932-4b33-b4b9-27836b0d8884\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") "
Sep 17 17:36:27.738147 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.738011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-util\") pod \"fd5b304d-e932-4b33-b4b9-27836b0d8884\" (UID: \"fd5b304d-e932-4b33-b4b9-27836b0d8884\") "
Sep 17 17:36:27.738671 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.738647    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-bundle" (OuterVolumeSpecName: "bundle") pod "fd5b304d-e932-4b33-b4b9-27836b0d8884" (UID: "fd5b304d-e932-4b33-b4b9-27836b0d8884"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:36:27.740250 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.740209    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5b304d-e932-4b33-b4b9-27836b0d8884-kube-api-access-gh298" (OuterVolumeSpecName: "kube-api-access-gh298") pod "fd5b304d-e932-4b33-b4b9-27836b0d8884" (UID: "fd5b304d-e932-4b33-b4b9-27836b0d8884"). InnerVolumeSpecName "kube-api-access-gh298". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:36:27.742387 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.742365    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-util" (OuterVolumeSpecName: "util") pod "fd5b304d-e932-4b33-b4b9-27836b0d8884" (UID: "fd5b304d-e932-4b33-b4b9-27836b0d8884"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:36:27.839543 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.839418    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh298\" (UniqueName: \"kubernetes.io/projected/fd5b304d-e932-4b33-b4b9-27836b0d8884-kube-api-access-gh298\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:36:27.839543 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.839455    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:36:27.839543 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:27.839467    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd5b304d-e932-4b33-b4b9-27836b0d8884-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:36:28.580641 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:28.580596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj" event={"ID":"fd5b304d-e932-4b33-b4b9-27836b0d8884","Type":"ContainerDied","Data":"4883c7bc8ecde32205c66967237905f68a83547ae1e3bdcee5074d8876a5daea"}
Sep 17 17:36:28.580641 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:28.580635    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zpkdj"
Sep 17 17:36:28.580860 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:28.580667    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4883c7bc8ecde32205c66967237905f68a83547ae1e3bdcee5074d8876a5daea"
Sep 17 17:36:32.218579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:32.218547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:33.551890 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:33.551858    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:33.656070 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:33.656035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:34.253816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:34.253781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:34.289945 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:34.289914    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:36:34.290185 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:34.290167    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:36:34.294529 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:34.294495    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 17:36:35.656421 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:35.656385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:36.275944 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.275892    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"]
Sep 17 17:36:36.276209 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.276198    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerName="pull"
Sep 17 17:36:36.276251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.276211    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerName="pull"
Sep 17 17:36:36.276251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.276228    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerName="extract"
Sep 17 17:36:36.276251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.276233    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerName="extract"
Sep 17 17:36:36.276251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.276240    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerName="util"
Sep 17 17:36:36.276251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.276246    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerName="util"
Sep 17 17:36:36.276398 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.276300    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5b304d-e932-4b33-b4b9-27836b0d8884" containerName="extract"
Sep 17 17:36:36.278225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.278210    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.280916 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.280882    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6k782\""
Sep 17 17:36:36.281051 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.280925    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:36:36.281238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.281218    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 17 17:36:36.303414 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.303379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"]
Sep 17 17:36:36.412636 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.412601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdsjh\" (UniqueName: \"kubernetes.io/projected/a9dc557a-6295-4ebd-8d08-d3dd455a27a5-kube-api-access-bdsjh\") pod \"cert-manager-operator-controller-manager-55c444bf86-bflcb\" (UID: \"a9dc557a-6295-4ebd-8d08-d3dd455a27a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.412816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.412721    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9dc557a-6295-4ebd-8d08-d3dd455a27a5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bflcb\" (UID: \"a9dc557a-6295-4ebd-8d08-d3dd455a27a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.513964 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.513925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9dc557a-6295-4ebd-8d08-d3dd455a27a5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bflcb\" (UID: \"a9dc557a-6295-4ebd-8d08-d3dd455a27a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.513964 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.513970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdsjh\" (UniqueName: \"kubernetes.io/projected/a9dc557a-6295-4ebd-8d08-d3dd455a27a5-kube-api-access-bdsjh\") pod \"cert-manager-operator-controller-manager-55c444bf86-bflcb\" (UID: \"a9dc557a-6295-4ebd-8d08-d3dd455a27a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.514317 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.514298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9dc557a-6295-4ebd-8d08-d3dd455a27a5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bflcb\" (UID: \"a9dc557a-6295-4ebd-8d08-d3dd455a27a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.524790 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.524754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdsjh\" (UniqueName: \"kubernetes.io/projected/a9dc557a-6295-4ebd-8d08-d3dd455a27a5-kube-api-access-bdsjh\") pod \"cert-manager-operator-controller-manager-55c444bf86-bflcb\" (UID: \"a9dc557a-6295-4ebd-8d08-d3dd455a27a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.587941 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.587854    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"
Sep 17 17:36:36.883202 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.883125    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb"]
Sep 17 17:36:36.887121 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:36:36.887097    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9dc557a_6295_4ebd_8d08_d3dd455a27a5.slice/crio-206a9c8a0d62b789409a9002278d007c9179a8225ac0d99e407babe5f0a74415 WatchSource:0}: Error finding container 206a9c8a0d62b789409a9002278d007c9179a8225ac0d99e407babe5f0a74415: Status 404 returned error can't find the container with id 206a9c8a0d62b789409a9002278d007c9179a8225ac0d99e407babe5f0a74415
Sep 17 17:36:36.889767 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:36.889750    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:36:37.618253 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:37.618223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb" event={"ID":"a9dc557a-6295-4ebd-8d08-d3dd455a27a5","Type":"ContainerStarted","Data":"206a9c8a0d62b789409a9002278d007c9179a8225ac0d99e407babe5f0a74415"}
Sep 17 17:36:37.851967 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:37.851939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:37.955768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:37.955672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:39.170039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:39.169998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:39.310238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:39.310204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:39.628561 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:39.628506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb" event={"ID":"a9dc557a-6295-4ebd-8d08-d3dd455a27a5","Type":"ContainerStarted","Data":"c9f714a33f0dec2ecf8ffa90180210e1016631eb9687502c0d31ea94a8db7fdb"}
Sep 17 17:36:39.661923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:39.661875    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bflcb" podStartSLOduration=1.959267263 podStartE2EDuration="3.661855136s" totalImagesPullingTime="1.702587873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:39.659069617 +0000 UTC m=+307.436907251" watchObservedRunningTime="2026-09-17 17:36:39.661855136 +0000 UTC m=+307.439692773"
Sep 17 17:36:40.084570 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.084529    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:40.192107 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.192077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:40.762498 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.762464    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"]
Sep 17 17:36:40.764807 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.764791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.768031 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.768003    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 17:36:40.768192 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.768174    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nmslq\""
Sep 17 17:36:40.769137 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.769119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 17:36:40.776838 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.776816    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"]
Sep 17 17:36:40.851695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.851637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h922s\" (UniqueName: \"kubernetes.io/projected/e588172e-ef50-413d-b94e-75ba7bfaf359-kube-api-access-h922s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.851695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.851697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.851938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.851767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.952435 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.952394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.952662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.952449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h922s\" (UniqueName: \"kubernetes.io/projected/e588172e-ef50-413d-b94e-75ba7bfaf359-kube-api-access-h922s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.952662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.952473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.952871 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.952850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.952933 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.952858    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:40.962010 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:40.961985    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h922s\" (UniqueName: \"kubernetes.io/projected/e588172e-ef50-413d-b94e-75ba7bfaf359-kube-api-access-h922s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:41.074605 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:41.074510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:41.207344 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:41.207314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:41.345490 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:41.345466    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"]
Sep 17 17:36:41.348092 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:36:41.348066    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode588172e_ef50_413d_b94e_75ba7bfaf359.slice/crio-ffdb9335d16c4f13d01685f4ce29140a30807356e28a367b0da379b3460c8d58 WatchSource:0}: Error finding container ffdb9335d16c4f13d01685f4ce29140a30807356e28a367b0da379b3460c8d58: Status 404 returned error can't find the container with id ffdb9335d16c4f13d01685f4ce29140a30807356e28a367b0da379b3460c8d58
Sep 17 17:36:41.573776 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:41.573747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:41.638391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:41.638306    2559 generic.go:356] "Generic (PLEG): container finished" podID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerID="bc2f76398ed852584fa8dce6785d5d77025e5fe0004fc301b4e02313bcbd9f3f" exitCode=0
Sep 17 17:36:41.638391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:41.638384    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq" event={"ID":"e588172e-ef50-413d-b94e-75ba7bfaf359","Type":"ContainerDied","Data":"bc2f76398ed852584fa8dce6785d5d77025e5fe0004fc301b4e02313bcbd9f3f"}
Sep 17 17:36:41.638598 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:41.638423    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq" event={"ID":"e588172e-ef50-413d-b94e-75ba7bfaf359","Type":"ContainerStarted","Data":"ffdb9335d16c4f13d01685f4ce29140a30807356e28a367b0da379b3460c8d58"}
Sep 17 17:36:43.650861 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:43.650822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq" event={"ID":"e588172e-ef50-413d-b94e-75ba7bfaf359","Type":"ContainerStarted","Data":"3ee6f70741e7410292930769b9ac75fdcbf257fd9cb1d866c3e19dec4736c53d"}
Sep 17 17:36:44.657119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:44.657082    2559 generic.go:356] "Generic (PLEG): container finished" podID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerID="3ee6f70741e7410292930769b9ac75fdcbf257fd9cb1d866c3e19dec4736c53d" exitCode=0
Sep 17 17:36:44.657552 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:44.657165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq" event={"ID":"e588172e-ef50-413d-b94e-75ba7bfaf359","Type":"ContainerDied","Data":"3ee6f70741e7410292930769b9ac75fdcbf257fd9cb1d866c3e19dec4736c53d"}
Sep 17 17:36:44.830203 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:44.830178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:44.933770 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:44.933704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:45.663376 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.663345    2559 generic.go:356] "Generic (PLEG): container finished" podID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerID="358319c7bb2650f0c190fc6d106514c0d863a91b3834c29d40837381bf2025b1" exitCode=0
Sep 17 17:36:45.663770 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.663414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq" event={"ID":"e588172e-ef50-413d-b94e-75ba7bfaf359","Type":"ContainerDied","Data":"358319c7bb2650f0c190fc6d106514c0d863a91b3834c29d40837381bf2025b1"}
Sep 17 17:36:45.956384 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.956303    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-22d59"]
Sep 17 17:36:45.958637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.958620    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:45.961253 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.961223    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mh927\""
Sep 17 17:36:45.961829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.961811    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 17:36:45.961903 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.961842    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 17:36:45.986723 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:45.986698    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-22d59"]
Sep 17 17:36:46.101607 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.101568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h482f\" (UniqueName: \"kubernetes.io/projected/70a4687d-775e-43f3-8107-93871ea1fc78-kube-api-access-h482f\") pod \"cert-manager-webhook-6486ffd997-22d59\" (UID: \"70a4687d-775e-43f3-8107-93871ea1fc78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:46.101773 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.101626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70a4687d-775e-43f3-8107-93871ea1fc78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-22d59\" (UID: \"70a4687d-775e-43f3-8107-93871ea1fc78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:46.202894 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.202856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70a4687d-775e-43f3-8107-93871ea1fc78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-22d59\" (UID: \"70a4687d-775e-43f3-8107-93871ea1fc78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:46.203112 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.202930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h482f\" (UniqueName: \"kubernetes.io/projected/70a4687d-775e-43f3-8107-93871ea1fc78-kube-api-access-h482f\") pod \"cert-manager-webhook-6486ffd997-22d59\" (UID: \"70a4687d-775e-43f3-8107-93871ea1fc78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:46.225039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.224970    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70a4687d-775e-43f3-8107-93871ea1fc78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-22d59\" (UID: \"70a4687d-775e-43f3-8107-93871ea1fc78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:46.226663 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.226644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h482f\" (UniqueName: \"kubernetes.io/projected/70a4687d-775e-43f3-8107-93871ea1fc78-kube-api-access-h482f\") pod \"cert-manager-webhook-6486ffd997-22d59\" (UID: \"70a4687d-775e-43f3-8107-93871ea1fc78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:46.282462 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.282423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:46.566528 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.566494    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-22d59"]
Sep 17 17:36:46.568593 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:36:46.568564    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70a4687d_775e_43f3_8107_93871ea1fc78.slice/crio-a48a83f7b4867f47c1b8d0e3f67a5f2b27463efdb3ac36b7267cb3c43cb37d70 WatchSource:0}: Error finding container a48a83f7b4867f47c1b8d0e3f67a5f2b27463efdb3ac36b7267cb3c43cb37d70: Status 404 returned error can't find the container with id a48a83f7b4867f47c1b8d0e3f67a5f2b27463efdb3ac36b7267cb3c43cb37d70
Sep 17 17:36:46.669680 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.669644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-22d59" event={"ID":"70a4687d-775e-43f3-8107-93871ea1fc78","Type":"ContainerStarted","Data":"a48a83f7b4867f47c1b8d0e3f67a5f2b27463efdb3ac36b7267cb3c43cb37d70"}
Sep 17 17:36:46.782842 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.782817    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:46.910686 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.910609    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h922s\" (UniqueName: \"kubernetes.io/projected/e588172e-ef50-413d-b94e-75ba7bfaf359-kube-api-access-h922s\") pod \"e588172e-ef50-413d-b94e-75ba7bfaf359\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") "
Sep 17 17:36:46.910686 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.910677    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-util\") pod \"e588172e-ef50-413d-b94e-75ba7bfaf359\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") "
Sep 17 17:36:46.910899 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.910730    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-bundle\") pod \"e588172e-ef50-413d-b94e-75ba7bfaf359\" (UID: \"e588172e-ef50-413d-b94e-75ba7bfaf359\") "
Sep 17 17:36:46.911149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.911123    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-bundle" (OuterVolumeSpecName: "bundle") pod "e588172e-ef50-413d-b94e-75ba7bfaf359" (UID: "e588172e-ef50-413d-b94e-75ba7bfaf359"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:36:46.912663 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.912643    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e588172e-ef50-413d-b94e-75ba7bfaf359-kube-api-access-h922s" (OuterVolumeSpecName: "kube-api-access-h922s") pod "e588172e-ef50-413d-b94e-75ba7bfaf359" (UID: "e588172e-ef50-413d-b94e-75ba7bfaf359"). InnerVolumeSpecName "kube-api-access-h922s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:36:46.995647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:46.995607    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-util" (OuterVolumeSpecName: "util") pod "e588172e-ef50-413d-b94e-75ba7bfaf359" (UID: "e588172e-ef50-413d-b94e-75ba7bfaf359"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:36:47.011720 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:47.011697    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:36:47.011720 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:47.011719    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h922s\" (UniqueName: \"kubernetes.io/projected/e588172e-ef50-413d-b94e-75ba7bfaf359-kube-api-access-h922s\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:36:47.011842 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:47.011730    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e588172e-ef50-413d-b94e-75ba7bfaf359-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:36:47.675766 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:47.675743    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq"
Sep 17 17:36:47.676137 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:47.675743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl6sq" event={"ID":"e588172e-ef50-413d-b94e-75ba7bfaf359","Type":"ContainerDied","Data":"ffdb9335d16c4f13d01685f4ce29140a30807356e28a367b0da379b3460c8d58"}
Sep 17 17:36:47.676137 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:47.675851    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffdb9335d16c4f13d01685f4ce29140a30807356e28a367b0da379b3460c8d58"
Sep 17 17:36:49.685915 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:49.685864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-22d59" event={"ID":"70a4687d-775e-43f3-8107-93871ea1fc78","Type":"ContainerStarted","Data":"641fd422d3c02860b77e1e28a4b98449ad7753d6cf61d4c05f5cbe05c32ed34f"}
Sep 17 17:36:49.686259 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:49.686017    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:49.707908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:49.707846    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-22d59" podStartSLOduration=1.693162714 podStartE2EDuration="4.707825429s" totalImagesPullingTime="3.014662715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:49.705469853 +0000 UTC m=+317.483307545" watchObservedRunningTime="2026-09-17 17:36:49.707825429 +0000 UTC m=+317.485663066"
Sep 17 17:36:50.183957 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:50.183929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:52.937295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:52.937265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:53.055075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:53.055039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.236567 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:54.236509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.336482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:54.336449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:55.692576 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:55.692538    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-22d59"
Sep 17 17:36:58.969596 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:58.969568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:59.067609 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:36:59.067581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:00.075463 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075430    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-92zrf"]
Sep 17 17:37:00.075840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075774    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerName="pull"
Sep 17 17:37:00.075840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075789    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerName="pull"
Sep 17 17:37:00.075840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075804    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerName="util"
Sep 17 17:37:00.075840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075810    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerName="util"
Sep 17 17:37:00.075840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075818    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerName="extract"
Sep 17 17:37:00.075840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075823    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerName="extract"
Sep 17 17:37:00.076016 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.075870    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e588172e-ef50-413d-b94e-75ba7bfaf359" containerName="extract"
Sep 17 17:37:00.078040 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.078023    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.081950 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.081931    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mlplj\""
Sep 17 17:37:00.091645 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.091619    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-92zrf"]
Sep 17 17:37:00.126820 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.126795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr7mt\" (UniqueName: \"kubernetes.io/projected/c61ff4e2-42db-4fe1-8a99-ae211ffe7119-kube-api-access-rr7mt\") pod \"cert-manager-55b4d954d5-92zrf\" (UID: \"c61ff4e2-42db-4fe1-8a99-ae211ffe7119\") " pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.126942 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.126861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c61ff4e2-42db-4fe1-8a99-ae211ffe7119-bound-sa-token\") pod \"cert-manager-55b4d954d5-92zrf\" (UID: \"c61ff4e2-42db-4fe1-8a99-ae211ffe7119\") " pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.227978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.227950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr7mt\" (UniqueName: \"kubernetes.io/projected/c61ff4e2-42db-4fe1-8a99-ae211ffe7119-kube-api-access-rr7mt\") pod \"cert-manager-55b4d954d5-92zrf\" (UID: \"c61ff4e2-42db-4fe1-8a99-ae211ffe7119\") " pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.228107 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.228032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c61ff4e2-42db-4fe1-8a99-ae211ffe7119-bound-sa-token\") pod \"cert-manager-55b4d954d5-92zrf\" (UID: \"c61ff4e2-42db-4fe1-8a99-ae211ffe7119\") " pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.237048 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.237014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c61ff4e2-42db-4fe1-8a99-ae211ffe7119-bound-sa-token\") pod \"cert-manager-55b4d954d5-92zrf\" (UID: \"c61ff4e2-42db-4fe1-8a99-ae211ffe7119\") " pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.237146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.237134    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr7mt\" (UniqueName: \"kubernetes.io/projected/c61ff4e2-42db-4fe1-8a99-ae211ffe7119-kube-api-access-rr7mt\") pod \"cert-manager-55b4d954d5-92zrf\" (UID: \"c61ff4e2-42db-4fe1-8a99-ae211ffe7119\") " pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.392316 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.392231    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-92zrf"
Sep 17 17:37:00.661484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.661411    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"]
Sep 17 17:37:00.664775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.664758    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.664915 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.664890    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-92zrf"]
Sep 17 17:37:00.667490 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:37:00.667465    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc61ff4e2_42db_4fe1_8a99_ae211ffe7119.slice/crio-4c99019e954da75a6004abdbd5d7e6d7650f5c321c13921b63710ade9254148a WatchSource:0}: Error finding container 4c99019e954da75a6004abdbd5d7e6d7650f5c321c13921b63710ade9254148a: Status 404 returned error can't find the container with id 4c99019e954da75a6004abdbd5d7e6d7650f5c321c13921b63710ade9254148a
Sep 17 17:37:00.667623 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.667569    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 17:37:00.667623 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.667607    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 17:37:00.668446 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.668430    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nmslq\""
Sep 17 17:37:00.677974 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.677951    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"]
Sep 17 17:37:00.731592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.731559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.731695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.731618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.731733 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.731692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djsqx\" (UniqueName: \"kubernetes.io/projected/2a04d49f-55ef-4401-9728-213e59298fdc-kube-api-access-djsqx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.737238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.737212    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-92zrf" event={"ID":"c61ff4e2-42db-4fe1-8a99-ae211ffe7119","Type":"ContainerStarted","Data":"c29f76e3e8c9c8d58bf0a7e50e1d91bab0465f7d0a75298f46df8e4368545b18"}
Sep 17 17:37:00.737325 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.737253    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-92zrf" event={"ID":"c61ff4e2-42db-4fe1-8a99-ae211ffe7119","Type":"ContainerStarted","Data":"4c99019e954da75a6004abdbd5d7e6d7650f5c321c13921b63710ade9254148a"}
Sep 17 17:37:00.754440 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.754386    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-92zrf" podStartSLOduration=0.754368629 podStartE2EDuration="754.368629ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:00.754229176 +0000 UTC m=+328.532066812" watchObservedRunningTime="2026-09-17 17:37:00.754368629 +0000 UTC m=+328.532206264"
Sep 17 17:37:00.832231 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.832193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.832381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.832244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.832381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.832291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djsqx\" (UniqueName: \"kubernetes.io/projected/2a04d49f-55ef-4401-9728-213e59298fdc-kube-api-access-djsqx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.832668 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.832647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.832668 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.832660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.841227 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.841197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djsqx\" (UniqueName: \"kubernetes.io/projected/2a04d49f-55ef-4401-9728-213e59298fdc-kube-api-access-djsqx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:00.983334 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:00.983255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:01.255466 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:01.255431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"]
Sep 17 17:37:01.257167 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:37:01.257139    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a04d49f_55ef_4401_9728_213e59298fdc.slice/crio-4314272317be8476f9dd430d7d21c99064388def047554c034275ceb58ca3b29 WatchSource:0}: Error finding container 4314272317be8476f9dd430d7d21c99064388def047554c034275ceb58ca3b29: Status 404 returned error can't find the container with id 4314272317be8476f9dd430d7d21c99064388def047554c034275ceb58ca3b29
Sep 17 17:37:01.272965 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:01.272932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:01.743705 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:01.743622    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a04d49f-55ef-4401-9728-213e59298fdc" containerID="9134ec21ac9ed5989033ea6a4343cb34d2d9ceefe3a1bd49d8b762e027ce2f1a" exitCode=0
Sep 17 17:37:01.743845 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:01.743713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8" event={"ID":"2a04d49f-55ef-4401-9728-213e59298fdc","Type":"ContainerDied","Data":"9134ec21ac9ed5989033ea6a4343cb34d2d9ceefe3a1bd49d8b762e027ce2f1a"}
Sep 17 17:37:01.743845 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:01.743760    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8" event={"ID":"2a04d49f-55ef-4401-9728-213e59298fdc","Type":"ContainerStarted","Data":"4314272317be8476f9dd430d7d21c99064388def047554c034275ceb58ca3b29"}
Sep 17 17:37:02.749771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:02.749740    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a04d49f-55ef-4401-9728-213e59298fdc" containerID="4ff0a24ecbaeb11c2836d3f0d990edd55b881e3d9a234152a3ee5b0cd7bc15f4" exitCode=0
Sep 17 17:37:02.750096 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:02.749816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8" event={"ID":"2a04d49f-55ef-4401-9728-213e59298fdc","Type":"ContainerDied","Data":"4ff0a24ecbaeb11c2836d3f0d990edd55b881e3d9a234152a3ee5b0cd7bc15f4"}
Sep 17 17:37:03.755997 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:03.755962    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a04d49f-55ef-4401-9728-213e59298fdc" containerID="cb2e90b5888191214f0908ee58c0d129f154bdb56af8e6a0f7189ee9bbdbe839" exitCode=0
Sep 17 17:37:03.756384 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:03.756050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8" event={"ID":"2a04d49f-55ef-4401-9728-213e59298fdc","Type":"ContainerDied","Data":"cb2e90b5888191214f0908ee58c0d129f154bdb56af8e6a0f7189ee9bbdbe839"}
Sep 17 17:37:04.890152 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:04.890125    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:04.961030 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:04.961000    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-util\") pod \"2a04d49f-55ef-4401-9728-213e59298fdc\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") "
Sep 17 17:37:04.961180 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:04.961039    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-bundle\") pod \"2a04d49f-55ef-4401-9728-213e59298fdc\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") "
Sep 17 17:37:04.961180 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:04.961069    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djsqx\" (UniqueName: \"kubernetes.io/projected/2a04d49f-55ef-4401-9728-213e59298fdc-kube-api-access-djsqx\") pod \"2a04d49f-55ef-4401-9728-213e59298fdc\" (UID: \"2a04d49f-55ef-4401-9728-213e59298fdc\") "
Sep 17 17:37:04.961790 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:04.961761    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-bundle" (OuterVolumeSpecName: "bundle") pod "2a04d49f-55ef-4401-9728-213e59298fdc" (UID: "2a04d49f-55ef-4401-9728-213e59298fdc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:04.963213 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:04.963190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a04d49f-55ef-4401-9728-213e59298fdc-kube-api-access-djsqx" (OuterVolumeSpecName: "kube-api-access-djsqx") pod "2a04d49f-55ef-4401-9728-213e59298fdc" (UID: "2a04d49f-55ef-4401-9728-213e59298fdc"). InnerVolumeSpecName "kube-api-access-djsqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:37:04.966316 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:04.966283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-util" (OuterVolumeSpecName: "util") pod "2a04d49f-55ef-4401-9728-213e59298fdc" (UID: "2a04d49f-55ef-4401-9728-213e59298fdc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:05.061629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:05.061555    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:37:05.061629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:05.061579    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a04d49f-55ef-4401-9728-213e59298fdc-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:37:05.061629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:05.061589    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djsqx\" (UniqueName: \"kubernetes.io/projected/2a04d49f-55ef-4401-9728-213e59298fdc-kube-api-access-djsqx\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:37:05.767421 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:05.767391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8" event={"ID":"2a04d49f-55ef-4401-9728-213e59298fdc","Type":"ContainerDied","Data":"4314272317be8476f9dd430d7d21c99064388def047554c034275ceb58ca3b29"}
Sep 17 17:37:05.767421 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:05.767408    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvqn8"
Sep 17 17:37:05.767646 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:05.767434    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4314272317be8476f9dd430d7d21c99064388def047554c034275ceb58ca3b29"
Sep 17 17:37:12.335678 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.335642    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"]
Sep 17 17:37:12.336194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.336083    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a04d49f-55ef-4401-9728-213e59298fdc" containerName="pull"
Sep 17 17:37:12.336194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.336101    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a04d49f-55ef-4401-9728-213e59298fdc" containerName="pull"
Sep 17 17:37:12.336194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.336132    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a04d49f-55ef-4401-9728-213e59298fdc" containerName="extract"
Sep 17 17:37:12.336194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.336140    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a04d49f-55ef-4401-9728-213e59298fdc" containerName="extract"
Sep 17 17:37:12.336194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.336158    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a04d49f-55ef-4401-9728-213e59298fdc" containerName="util"
Sep 17 17:37:12.336194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.336166    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a04d49f-55ef-4401-9728-213e59298fdc" containerName="util"
Sep 17 17:37:12.336562 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.336243    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a04d49f-55ef-4401-9728-213e59298fdc" containerName="extract"
Sep 17 17:37:12.338912 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.338892    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.341955 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.341933    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 17:37:12.342059 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.341976    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 17:37:12.342059 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.341933    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nmslq\""
Sep 17 17:37:12.362710 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.362688    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"]
Sep 17 17:37:12.414504 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.414424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.414504 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.414488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkgw9\" (UniqueName: \"kubernetes.io/projected/c33e8915-70e7-4c0b-9f67-ebf562338de0-kube-api-access-dkgw9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.414694 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.414555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.514919 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.514887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.515057 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.514927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.515057 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.514968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkgw9\" (UniqueName: \"kubernetes.io/projected/c33e8915-70e7-4c0b-9f67-ebf562338de0-kube-api-access-dkgw9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.515347 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.515324    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.515383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.515334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.537682 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.537652    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkgw9\" (UniqueName: \"kubernetes.io/projected/c33e8915-70e7-4c0b-9f67-ebf562338de0-kube-api-access-dkgw9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.647801 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.647765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:12.932765 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:12.932741    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"]
Sep 17 17:37:12.935002 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:37:12.934962    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33e8915_70e7_4c0b_9f67_ebf562338de0.slice/crio-228ca493e76593809bd37613a833f5306abf35ff00731506b16b06632b9e5b88 WatchSource:0}: Error finding container 228ca493e76593809bd37613a833f5306abf35ff00731506b16b06632b9e5b88: Status 404 returned error can't find the container with id 228ca493e76593809bd37613a833f5306abf35ff00731506b16b06632b9e5b88
Sep 17 17:37:13.603033 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:13.602991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:13.703923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:13.703889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:13.805963 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:13.805874    2559 generic.go:356] "Generic (PLEG): container finished" podID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerID="ad29a507a286a10fbedfd9885546872bdd3e551d9d8dd37b3516b60977ba5c53" exitCode=0
Sep 17 17:37:13.805963 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:13.805918    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd" event={"ID":"c33e8915-70e7-4c0b-9f67-ebf562338de0","Type":"ContainerDied","Data":"ad29a507a286a10fbedfd9885546872bdd3e551d9d8dd37b3516b60977ba5c53"}
Sep 17 17:37:13.806420 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:13.805972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd" event={"ID":"c33e8915-70e7-4c0b-9f67-ebf562338de0","Type":"ContainerStarted","Data":"228ca493e76593809bd37613a833f5306abf35ff00731506b16b06632b9e5b88"}
Sep 17 17:37:14.243313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:14.243240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:14.812451 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:14.812420    2559 generic.go:356] "Generic (PLEG): container finished" podID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerID="badd5a626d41ab7ee670ac12757e86c7d1dbd05922d09ebfb536d485cccdd896" exitCode=0
Sep 17 17:37:14.812851 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:14.812461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd" event={"ID":"c33e8915-70e7-4c0b-9f67-ebf562338de0","Type":"ContainerDied","Data":"badd5a626d41ab7ee670ac12757e86c7d1dbd05922d09ebfb536d485cccdd896"}
Sep 17 17:37:14.822224 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:14.822196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:14.936487 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:14.936459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:15.067032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.066954    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"]
Sep 17 17:37:15.069325 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.069303    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.073227 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.073206    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jt585\""
Sep 17 17:37:15.073588 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.073571    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 17:37:15.073677 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.073598    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 17:37:15.073677 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.073574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 17:37:15.074632 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.074613    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 17:37:15.131699 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.131669    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"]
Sep 17 17:37:15.133989 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.133962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/681e544b-4503-4fae-9f41-1678769fcfe7-webhook-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.134130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.134038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd4mx\" (UniqueName: \"kubernetes.io/projected/681e544b-4503-4fae-9f41-1678769fcfe7-kube-api-access-jd4mx\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.134130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.134072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681e544b-4503-4fae-9f41-1678769fcfe7-tmp\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.134130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.134097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/681e544b-4503-4fae-9f41-1678769fcfe7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.134130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.134126    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/681e544b-4503-4fae-9f41-1678769fcfe7-manifests\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.234646 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.234614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/681e544b-4503-4fae-9f41-1678769fcfe7-webhook-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.234840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.234678    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd4mx\" (UniqueName: \"kubernetes.io/projected/681e544b-4503-4fae-9f41-1678769fcfe7-kube-api-access-jd4mx\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.234840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.234704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681e544b-4503-4fae-9f41-1678769fcfe7-tmp\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.234840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.234720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/681e544b-4503-4fae-9f41-1678769fcfe7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.234840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.234744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/681e544b-4503-4fae-9f41-1678769fcfe7-manifests\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.235209 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.235182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/681e544b-4503-4fae-9f41-1678769fcfe7-manifests\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.237100 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.237074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681e544b-4503-4fae-9f41-1678769fcfe7-tmp\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.237202 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.237105    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/681e544b-4503-4fae-9f41-1678769fcfe7-webhook-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.237295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.237280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/681e544b-4503-4fae-9f41-1678769fcfe7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.244673 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.244650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd4mx\" (UniqueName: \"kubernetes.io/projected/681e544b-4503-4fae-9f41-1678769fcfe7-kube-api-access-jd4mx\") pod \"opendatahub-operator-controller-manager-584f5b8894-ppd9z\" (UID: \"681e544b-4503-4fae-9f41-1678769fcfe7\") " pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.330239 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.330160    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:15.379287 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.379260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:15.425275 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.424902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:15.524929 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.524893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:15.624971 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.624900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:15.665415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.665332    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"]
Sep 17 17:37:15.667720 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:37:15.667680    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681e544b_4503_4fae_9f41_1678769fcfe7.slice/crio-848a2d9efb1482c910f1972fcb2fb0f171f466414668fc1da9af332cb52a6a22 WatchSource:0}: Error finding container 848a2d9efb1482c910f1972fcb2fb0f171f466414668fc1da9af332cb52a6a22: Status 404 returned error can't find the container with id 848a2d9efb1482c910f1972fcb2fb0f171f466414668fc1da9af332cb52a6a22
Sep 17 17:37:15.734395 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.734371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:15.819802 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.819771    2559 generic.go:356] "Generic (PLEG): container finished" podID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerID="66708d07018077922130d2a3bd25b4c13fcd3ea0163933964cc880e7e3dc1b8d" exitCode=0
Sep 17 17:37:15.820153 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.819842    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd" event={"ID":"c33e8915-70e7-4c0b-9f67-ebf562338de0","Type":"ContainerDied","Data":"66708d07018077922130d2a3bd25b4c13fcd3ea0163933964cc880e7e3dc1b8d"}
Sep 17 17:37:15.821156 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.821134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z" event={"ID":"681e544b-4503-4fae-9f41-1678769fcfe7","Type":"ContainerStarted","Data":"848a2d9efb1482c910f1972fcb2fb0f171f466414668fc1da9af332cb52a6a22"}
Sep 17 17:37:15.826024 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:15.826005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:16.998841 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:16.998811    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:17.051917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.051887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-bundle\") pod \"c33e8915-70e7-4c0b-9f67-ebf562338de0\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") "
Sep 17 17:37:17.052074 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.051978    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkgw9\" (UniqueName: \"kubernetes.io/projected/c33e8915-70e7-4c0b-9f67-ebf562338de0-kube-api-access-dkgw9\") pod \"c33e8915-70e7-4c0b-9f67-ebf562338de0\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") "
Sep 17 17:37:17.052146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.052083    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-util\") pod \"c33e8915-70e7-4c0b-9f67-ebf562338de0\" (UID: \"c33e8915-70e7-4c0b-9f67-ebf562338de0\") "
Sep 17 17:37:17.052941 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.052907    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-bundle" (OuterVolumeSpecName: "bundle") pod "c33e8915-70e7-4c0b-9f67-ebf562338de0" (UID: "c33e8915-70e7-4c0b-9f67-ebf562338de0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:17.055433 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.055400    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33e8915-70e7-4c0b-9f67-ebf562338de0-kube-api-access-dkgw9" (OuterVolumeSpecName: "kube-api-access-dkgw9") pod "c33e8915-70e7-4c0b-9f67-ebf562338de0" (UID: "c33e8915-70e7-4c0b-9f67-ebf562338de0"). InnerVolumeSpecName "kube-api-access-dkgw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:37:17.062153 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.062124    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-util" (OuterVolumeSpecName: "util") pod "c33e8915-70e7-4c0b-9f67-ebf562338de0" (UID: "c33e8915-70e7-4c0b-9f67-ebf562338de0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:17.153816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.153743    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkgw9\" (UniqueName: \"kubernetes.io/projected/c33e8915-70e7-4c0b-9f67-ebf562338de0-kube-api-access-dkgw9\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:37:17.153816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.153779    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:37:17.153816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.153795    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c33e8915-70e7-4c0b-9f67-ebf562338de0-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:37:17.836410 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.836377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd" event={"ID":"c33e8915-70e7-4c0b-9f67-ebf562338de0","Type":"ContainerDied","Data":"228ca493e76593809bd37613a833f5306abf35ff00731506b16b06632b9e5b88"}
Sep 17 17:37:17.836603 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.836426    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="228ca493e76593809bd37613a833f5306abf35ff00731506b16b06632b9e5b88"
Sep 17 17:37:17.836603 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:17.836435    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0z45zd"
Sep 17 17:37:18.842330 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:18.842293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z" event={"ID":"681e544b-4503-4fae-9f41-1678769fcfe7","Type":"ContainerStarted","Data":"c3002e4caff12818d72b1292633dd63a3e1234adfe6019ceb07a6839bdd0b6ce"}
Sep 17 17:37:19.849142 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:19.849107    2559 generic.go:356] "Generic (PLEG): container finished" podID="681e544b-4503-4fae-9f41-1678769fcfe7" containerID="c3002e4caff12818d72b1292633dd63a3e1234adfe6019ceb07a6839bdd0b6ce" exitCode=0
Sep 17 17:37:19.849602 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:19.849187    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z" event={"ID":"681e544b-4503-4fae-9f41-1678769fcfe7","Type":"ContainerDied","Data":"c3002e4caff12818d72b1292633dd63a3e1234adfe6019ceb07a6839bdd0b6ce"}
Sep 17 17:37:20.856366 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:20.856328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z" event={"ID":"681e544b-4503-4fae-9f41-1678769fcfe7","Type":"ContainerStarted","Data":"f16727e95a4947ea759b761a228f8e5cf3a68157d810b77546c1902dfc4fe067"}
Sep 17 17:37:20.856869 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:20.856453    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:20.893734 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:20.893672    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z" podStartSLOduration=1.420539931 podStartE2EDuration="5.893655398s" totalImagesPullingTime="3.430188758s" totalInitContainerRuntime="1.042926709s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:20.892149589 +0000 UTC m=+348.669987225" watchObservedRunningTime="2026-09-17 17:37:20.893655398 +0000 UTC m=+348.671493034"
Sep 17 17:37:25.139271 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:25.139245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:25.264878 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:25.264835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:27.665198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:27.665167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:31.863309 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:31.863277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-584f5b8894-ppd9z"
Sep 17 17:37:34.267976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.267826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:34.388867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.388827    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:34.747363 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.747329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:34.774010 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.773975    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"]
Sep 17 17:37:34.774295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.774284    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerName="extract"
Sep 17 17:37:34.774338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.774297    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerName="extract"
Sep 17 17:37:34.774338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.774312    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerName="pull"
Sep 17 17:37:34.774338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.774318    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerName="pull"
Sep 17 17:37:34.774338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.774332    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerName="util"
Sep 17 17:37:34.774338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.774338    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerName="util"
Sep 17 17:37:34.774479 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.774385    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33e8915-70e7-4c0b-9f67-ebf562338de0" containerName="extract"
Sep 17 17:37:34.783677 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.783647    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:34.787167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.787144    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 17:37:34.787783 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.787755    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 17:37:34.796070 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.796048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"]
Sep 17 17:37:34.912282 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.912242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g87mb\" (UniqueName: \"kubernetes.io/projected/707cae63-4158-4dc8-91b8-e1c71d6891e3-kube-api-access-g87mb\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:34.912421 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.912323    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/707cae63-4158-4dc8-91b8-e1c71d6891e3-tls-certs\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:34.912421 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:34.912350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707cae63-4158-4dc8-91b8-e1c71d6891e3-tmp\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.001180 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.001099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:35.013287 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.013256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707cae63-4158-4dc8-91b8-e1c71d6891e3-tmp\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.013464 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.013344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g87mb\" (UniqueName: \"kubernetes.io/projected/707cae63-4158-4dc8-91b8-e1c71d6891e3-kube-api-access-g87mb\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.013464 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.013433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/707cae63-4158-4dc8-91b8-e1c71d6891e3-tls-certs\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.015986 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.015959    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707cae63-4158-4dc8-91b8-e1c71d6891e3-tmp\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.016116 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.016095    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/707cae63-4158-4dc8-91b8-e1c71d6891e3-tls-certs\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.036241 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.036211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g87mb\" (UniqueName: \"kubernetes.io/projected/707cae63-4158-4dc8-91b8-e1c71d6891e3-kube-api-access-g87mb\") pod \"kube-auth-proxy-5499794fdf-gnghq\" (UID: \"707cae63-4158-4dc8-91b8-e1c71d6891e3\") " pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.094264 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.094227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"
Sep 17 17:37:35.374236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.374148    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5499794fdf-gnghq"]
Sep 17 17:37:35.377285 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:37:35.377252    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707cae63_4158_4dc8_91b8_e1c71d6891e3.slice/crio-243e90dc6f7200a455562e3c4fc31f45132ec4fc693c3bdc182cea922ec783a7 WatchSource:0}: Error finding container 243e90dc6f7200a455562e3c4fc31f45132ec4fc693c3bdc182cea922ec783a7: Status 404 returned error can't find the container with id 243e90dc6f7200a455562e3c4fc31f45132ec4fc693c3bdc182cea922ec783a7
Sep 17 17:37:35.930647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:35.930613    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq" event={"ID":"707cae63-4158-4dc8-91b8-e1c71d6891e3","Type":"ContainerStarted","Data":"243e90dc6f7200a455562e3c4fc31f45132ec4fc693c3bdc182cea922ec783a7"}
Sep 17 17:37:36.514644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:36.514614    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:36.589932 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:36.589898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:37.519901 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.519859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:37.620991 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.620702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:37.622225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.622200    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"]
Sep 17 17:37:37.626017 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.625997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.630411 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.630371    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 17:37:37.630850 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.630781    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:37:37.631042 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.631024    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 17:37:37.631315 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.631285    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 17:37:37.631644 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.631625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 17:37:37.631879 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.631862    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xd4hn\""
Sep 17 17:37:37.638201 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.638174    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"]
Sep 17 17:37:37.737598 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.737558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abbab84e-e928-4c95-8de2-32fc2193a148-cert\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.737785 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.737626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8fz5\" (UniqueName: \"kubernetes.io/projected/abbab84e-e928-4c95-8de2-32fc2193a148-kube-api-access-m8fz5\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.737785 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.737669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abbab84e-e928-4c95-8de2-32fc2193a148-metrics-cert\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.737785 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.737696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abbab84e-e928-4c95-8de2-32fc2193a148-manager-config\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.838813 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.838726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8fz5\" (UniqueName: \"kubernetes.io/projected/abbab84e-e928-4c95-8de2-32fc2193a148-kube-api-access-m8fz5\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.838813 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.838792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abbab84e-e928-4c95-8de2-32fc2193a148-metrics-cert\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.838813 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.838815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abbab84e-e928-4c95-8de2-32fc2193a148-manager-config\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.839057 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.838854    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abbab84e-e928-4c95-8de2-32fc2193a148-cert\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.839649 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.839620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abbab84e-e928-4c95-8de2-32fc2193a148-manager-config\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.841985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.841963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abbab84e-e928-4c95-8de2-32fc2193a148-cert\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.842090 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.841961    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abbab84e-e928-4c95-8de2-32fc2193a148-metrics-cert\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.858604 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.858572    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8fz5\" (UniqueName: \"kubernetes.io/projected/abbab84e-e928-4c95-8de2-32fc2193a148-kube-api-access-m8fz5\") pod \"lws-controller-manager-79bc5f98c4-kkcpl\" (UID: \"abbab84e-e928-4c95-8de2-32fc2193a148\") " pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:37.941672 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:37.941353    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:38.116469 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:38.116368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:38.572385 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:38.572356    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"]
Sep 17 17:37:38.573590 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:37:38.573557    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabbab84e_e928_4c95_8de2_32fc2193a148.slice/crio-c1ceedc05d0a177eee8090d731d81944f51cd0dc5cbd1f1e0371a07551eab296 WatchSource:0}: Error finding container c1ceedc05d0a177eee8090d731d81944f51cd0dc5cbd1f1e0371a07551eab296: Status 404 returned error can't find the container with id c1ceedc05d0a177eee8090d731d81944f51cd0dc5cbd1f1e0371a07551eab296
Sep 17 17:37:38.951759 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:38.951722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq" event={"ID":"707cae63-4158-4dc8-91b8-e1c71d6891e3","Type":"ContainerStarted","Data":"87f92a47c9d20a012df7bfdaf241e98abccd883f39e8428a43acc756e833ac6f"}
Sep 17 17:37:38.952969 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:38.952943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl" event={"ID":"abbab84e-e928-4c95-8de2-32fc2193a148","Type":"ContainerStarted","Data":"c1ceedc05d0a177eee8090d731d81944f51cd0dc5cbd1f1e0371a07551eab296"}
Sep 17 17:37:38.982713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:38.982665    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5499794fdf-gnghq" podStartSLOduration=1.997030249 podStartE2EDuration="4.982650535s" totalImagesPullingTime="2.985620286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:38.980778997 +0000 UTC m=+366.758616667" watchObservedRunningTime="2026-09-17 17:37:38.982650535 +0000 UTC m=+366.760488170"
Sep 17 17:37:40.963321 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:40.963288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl" event={"ID":"abbab84e-e928-4c95-8de2-32fc2193a148","Type":"ContainerStarted","Data":"e1a86615a3f391c1c4764bd155c6d7168db09fa8b8b04dea96319d09d7f95960"}
Sep 17 17:37:40.963715 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:40.963346    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:40.986133 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:40.986086    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl" podStartSLOduration=2.592532288 podStartE2EDuration="3.986069551s" totalImagesPullingTime="1.393537263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:40.985664258 +0000 UTC m=+368.763501906" watchObservedRunningTime="2026-09-17 17:37:40.986069551 +0000 UTC m=+368.763907186"
Sep 17 17:37:41.123840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:41.123810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:41.226438 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:41.226354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:41.446101 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:41.446044    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:41.661756 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:41.661725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:41.867060 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:41.867031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:45.446197 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:45.446168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:45.553308 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:45.553277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:45.712791 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:45.712700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:46.029016 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:46.028983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:46.240602 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:46.240570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:51.970502 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:51.970470    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79bc5f98c4-kkcpl"
Sep 17 17:37:55.602146 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:55.602111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:55.718031 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:55.717997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:55.892662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:55.892573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:56.126053 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:56.126022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:56.965231 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:56.965201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:57.046401 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:57.046358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:57.147767 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:37:57.147729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:46.400911 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:46.400800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:46.496139 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:46.496104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:51.240967 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.240927    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"]
Sep 17 17:38:51.244457 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.244436    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.247061 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.247042    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 17:38:51.247166 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.247107    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 17:38:51.248191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.248173    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nmslq\""
Sep 17 17:38:51.254381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.254361    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"]
Sep 17 17:38:51.279062 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.279031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xnb2\" (UniqueName: \"kubernetes.io/projected/96eef03f-efbe-4077-911a-6dbf16aaf432-kube-api-access-9xnb2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.279244 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.279095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.279244 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.279201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.325267 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.325228    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"]
Sep 17 17:38:51.328803 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.328779    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.338995 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.338969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"]
Sep 17 17:38:51.379969 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.379931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.380143 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.379985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xnb2\" (UniqueName: \"kubernetes.io/projected/96eef03f-efbe-4077-911a-6dbf16aaf432-kube-api-access-9xnb2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.380143 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.380005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.380215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.380158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfcd\" (UniqueName: \"kubernetes.io/projected/ac2b0488-e87f-4330-8677-087bcdd53d22-kube-api-access-vcfcd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.380251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.380221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.380304 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.380287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.380378 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.380363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.380558 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.380538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.388397 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.388366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xnb2\" (UniqueName: \"kubernetes.io/projected/96eef03f-efbe-4077-911a-6dbf16aaf432-kube-api-access-9xnb2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.427672 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.427640    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"]
Sep 17 17:38:51.431237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.431220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.440833 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.440809    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"]
Sep 17 17:38:51.481411 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.481590 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.481590 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fnt\" (UniqueName: \"kubernetes.io/projected/15b955c9-7f2f-4d31-b88a-d6192062678c-kube-api-access-v9fnt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.481590 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.481590 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfcd\" (UniqueName: \"kubernetes.io/projected/ac2b0488-e87f-4330-8677-087bcdd53d22-kube-api-access-vcfcd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.481784 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.481863 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481845    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.481914 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.481854    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.498235 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.498208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfcd\" (UniqueName: \"kubernetes.io/projected/ac2b0488-e87f-4330-8677-087bcdd53d22-kube-api-access-vcfcd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.538539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.538495    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"]
Sep 17 17:38:51.542062 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.542039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.554218 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.554179    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"]
Sep 17 17:38:51.554338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.554258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:51.582458 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtv2g\" (UniqueName: \"kubernetes.io/projected/07086892-d93c-49f0-bea6-d8523ddbdb35-kube-api-access-mtv2g\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.582637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.582637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.582723 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.582723 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.582795 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582716    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fnt\" (UniqueName: \"kubernetes.io/projected/15b955c9-7f2f-4d31-b88a-d6192062678c-kube-api-access-v9fnt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.582837 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.582934 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.582919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.593272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.593208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fnt\" (UniqueName: \"kubernetes.io/projected/15b955c9-7f2f-4d31-b88a-d6192062678c-kube-api-access-v9fnt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.638853 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.638824    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:51.684869 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.684462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtv2g\" (UniqueName: \"kubernetes.io/projected/07086892-d93c-49f0-bea6-d8523ddbdb35-kube-api-access-mtv2g\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.684869 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.684529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.684869 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.684594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.685181 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.685020    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.685181 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.685036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.694253 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.694180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtv2g\" (UniqueName: \"kubernetes.io/projected/07086892-d93c-49f0-bea6-d8523ddbdb35-kube-api-access-mtv2g\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.741109 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.741077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:51.831824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.831789    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"]
Sep 17 17:38:51.832657 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:38:51.832632    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96eef03f_efbe_4077_911a_6dbf16aaf432.slice/crio-537d37cb8ec8d26633994bdd89dc5986a1564a9eb91f4bf19df28819dcbc90fb WatchSource:0}: Error finding container 537d37cb8ec8d26633994bdd89dc5986a1564a9eb91f4bf19df28819dcbc90fb: Status 404 returned error can't find the container with id 537d37cb8ec8d26633994bdd89dc5986a1564a9eb91f4bf19df28819dcbc90fb
Sep 17 17:38:51.852873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.852844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:51.924239 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:51.923934    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"]
Sep 17 17:38:51.927348 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:38:51.927315    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2b0488_e87f_4330_8677_087bcdd53d22.slice/crio-0f01bd06d9fe5a78b11405c9e9719fbc868bad9e7561c3e3d6472f0c3e229993 WatchSource:0}: Error finding container 0f01bd06d9fe5a78b11405c9e9719fbc868bad9e7561c3e3d6472f0c3e229993: Status 404 returned error can't find the container with id 0f01bd06d9fe5a78b11405c9e9719fbc868bad9e7561c3e3d6472f0c3e229993
Sep 17 17:38:52.022115 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.022090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"]
Sep 17 17:38:52.032119 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:38:52.032090    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b955c9_7f2f_4d31_b88a_d6192062678c.slice/crio-c35f29540c7c9310f8e3209ca15352405a9e19b64dfe6c78e017ee2f76d6fba6 WatchSource:0}: Error finding container c35f29540c7c9310f8e3209ca15352405a9e19b64dfe6c78e017ee2f76d6fba6: Status 404 returned error can't find the container with id c35f29540c7c9310f8e3209ca15352405a9e19b64dfe6c78e017ee2f76d6fba6
Sep 17 17:38:52.134485 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.134450    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"]
Sep 17 17:38:52.138386 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:38:52.138359    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07086892_d93c_49f0_bea6_d8523ddbdb35.slice/crio-3b8a5c4d33c8bd890d2d5cc6c3c932b6d433199a4a0cec8e0d34b2c420dec59b WatchSource:0}: Error finding container 3b8a5c4d33c8bd890d2d5cc6c3c932b6d433199a4a0cec8e0d34b2c420dec59b: Status 404 returned error can't find the container with id 3b8a5c4d33c8bd890d2d5cc6c3c932b6d433199a4a0cec8e0d34b2c420dec59b
Sep 17 17:38:52.315773 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.315738    2559 generic.go:356] "Generic (PLEG): container finished" podID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerID="46a3589696b25483e9d2ea9e4200dddc67ba1168f82f04e106cd0e2d69d26a8d" exitCode=0
Sep 17 17:38:52.316182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.315817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r" event={"ID":"96eef03f-efbe-4077-911a-6dbf16aaf432","Type":"ContainerDied","Data":"46a3589696b25483e9d2ea9e4200dddc67ba1168f82f04e106cd0e2d69d26a8d"}
Sep 17 17:38:52.316182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.315867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r" event={"ID":"96eef03f-efbe-4077-911a-6dbf16aaf432","Type":"ContainerStarted","Data":"537d37cb8ec8d26633994bdd89dc5986a1564a9eb91f4bf19df28819dcbc90fb"}
Sep 17 17:38:52.317484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.317425    2559 generic.go:356] "Generic (PLEG): container finished" podID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerID="db342744182369cc908d4ff6c6c29c51c01417af6f799bea7e9ac92a565f64f8" exitCode=0
Sep 17 17:38:52.317584 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.317505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm" event={"ID":"07086892-d93c-49f0-bea6-d8523ddbdb35","Type":"ContainerDied","Data":"db342744182369cc908d4ff6c6c29c51c01417af6f799bea7e9ac92a565f64f8"}
Sep 17 17:38:52.317584 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.317570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm" event={"ID":"07086892-d93c-49f0-bea6-d8523ddbdb35","Type":"ContainerStarted","Data":"3b8a5c4d33c8bd890d2d5cc6c3c932b6d433199a4a0cec8e0d34b2c420dec59b"}
Sep 17 17:38:52.319081 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.319051    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerID="f68eba28622cb4b5a4eadbbb3bda8a05c29f1186a0a3396011882a0b7e06956f" exitCode=0
Sep 17 17:38:52.319148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.319115    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl" event={"ID":"ac2b0488-e87f-4330-8677-087bcdd53d22","Type":"ContainerDied","Data":"f68eba28622cb4b5a4eadbbb3bda8a05c29f1186a0a3396011882a0b7e06956f"}
Sep 17 17:38:52.319209 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.319154    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl" event={"ID":"ac2b0488-e87f-4330-8677-087bcdd53d22","Type":"ContainerStarted","Data":"0f01bd06d9fe5a78b11405c9e9719fbc868bad9e7561c3e3d6472f0c3e229993"}
Sep 17 17:38:52.320969 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.320946    2559 generic.go:356] "Generic (PLEG): container finished" podID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerID="df6ef66a88125c08fb58faf641994375a783648ed05634ca8134ffab9b7eee5a" exitCode=0
Sep 17 17:38:52.321063 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.320978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l" event={"ID":"15b955c9-7f2f-4d31-b88a-d6192062678c","Type":"ContainerDied","Data":"df6ef66a88125c08fb58faf641994375a783648ed05634ca8134ffab9b7eee5a"}
Sep 17 17:38:52.321063 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:52.321009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l" event={"ID":"15b955c9-7f2f-4d31-b88a-d6192062678c","Type":"ContainerStarted","Data":"c35f29540c7c9310f8e3209ca15352405a9e19b64dfe6c78e017ee2f76d6fba6"}
Sep 17 17:38:53.329333 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:53.329301    2559 generic.go:356] "Generic (PLEG): container finished" podID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerID="9f67aea084c39207d5c5ddbef067d908ba909de5a3ac1717fa76ae248dd6a7a9" exitCode=0
Sep 17 17:38:53.329751 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:53.329385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm" event={"ID":"07086892-d93c-49f0-bea6-d8523ddbdb35","Type":"ContainerDied","Data":"9f67aea084c39207d5c5ddbef067d908ba909de5a3ac1717fa76ae248dd6a7a9"}
Sep 17 17:38:54.336791 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.336756    2559 generic.go:356] "Generic (PLEG): container finished" podID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerID="867866e22ce2c44886b955f2ea7a6c1bb6ecc7b920814505efc71779e821c657" exitCode=0
Sep 17 17:38:54.337300 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.336855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l" event={"ID":"15b955c9-7f2f-4d31-b88a-d6192062678c","Type":"ContainerDied","Data":"867866e22ce2c44886b955f2ea7a6c1bb6ecc7b920814505efc71779e821c657"}
Sep 17 17:38:54.338754 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.338730    2559 generic.go:356] "Generic (PLEG): container finished" podID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerID="8da6eaeb165c0660f1c698660ba2fdc89a30b97e116293646896dca63cd0d9f0" exitCode=0
Sep 17 17:38:54.338842 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.338817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r" event={"ID":"96eef03f-efbe-4077-911a-6dbf16aaf432","Type":"ContainerDied","Data":"8da6eaeb165c0660f1c698660ba2fdc89a30b97e116293646896dca63cd0d9f0"}
Sep 17 17:38:54.341063 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.341042    2559 generic.go:356] "Generic (PLEG): container finished" podID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerID="3c1c390e1666ebc637d73faee031df10c0a04f7b68ac92da2d862e31516549da" exitCode=0
Sep 17 17:38:54.341166 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.341150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm" event={"ID":"07086892-d93c-49f0-bea6-d8523ddbdb35","Type":"ContainerDied","Data":"3c1c390e1666ebc637d73faee031df10c0a04f7b68ac92da2d862e31516549da"}
Sep 17 17:38:54.343077 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.343054    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerID="0c790b310fbba6a130db3a70406d8d0d73824797833a8e1f64820065db5b4458" exitCode=0
Sep 17 17:38:54.343142 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:54.343089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl" event={"ID":"ac2b0488-e87f-4330-8677-087bcdd53d22","Type":"ContainerDied","Data":"0c790b310fbba6a130db3a70406d8d0d73824797833a8e1f64820065db5b4458"}
Sep 17 17:38:55.355801 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.355763    2559 generic.go:356] "Generic (PLEG): container finished" podID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerID="4a4643a65634ea40c663e1fcd2a5914d805f28bfc1e7247d0448ad76a3bf7d42" exitCode=0
Sep 17 17:38:55.356275 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.355885    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r" event={"ID":"96eef03f-efbe-4077-911a-6dbf16aaf432","Type":"ContainerDied","Data":"4a4643a65634ea40c663e1fcd2a5914d805f28bfc1e7247d0448ad76a3bf7d42"}
Sep 17 17:38:55.358209 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.358179    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerID="e2f444a88ab64eda5fcf83656d88a45c549fca39547882db8219f0b7558df262" exitCode=0
Sep 17 17:38:55.358324 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.358248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl" event={"ID":"ac2b0488-e87f-4330-8677-087bcdd53d22","Type":"ContainerDied","Data":"e2f444a88ab64eda5fcf83656d88a45c549fca39547882db8219f0b7558df262"}
Sep 17 17:38:55.360579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.360553    2559 generic.go:356] "Generic (PLEG): container finished" podID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerID="ccbcd37cfcd6b5b462463c59459319dea1f034004ef222b6d63f81ea382227b3" exitCode=0
Sep 17 17:38:55.360670 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.360616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l" event={"ID":"15b955c9-7f2f-4d31-b88a-d6192062678c","Type":"ContainerDied","Data":"ccbcd37cfcd6b5b462463c59459319dea1f034004ef222b6d63f81ea382227b3"}
Sep 17 17:38:55.499238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.499213    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:55.523984 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.523952    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-bundle\") pod \"07086892-d93c-49f0-bea6-d8523ddbdb35\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") "
Sep 17 17:38:55.524124 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.523998    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtv2g\" (UniqueName: \"kubernetes.io/projected/07086892-d93c-49f0-bea6-d8523ddbdb35-kube-api-access-mtv2g\") pod \"07086892-d93c-49f0-bea6-d8523ddbdb35\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") "
Sep 17 17:38:55.524124 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.524042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-util\") pod \"07086892-d93c-49f0-bea6-d8523ddbdb35\" (UID: \"07086892-d93c-49f0-bea6-d8523ddbdb35\") "
Sep 17 17:38:55.524507 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.524464    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-bundle" (OuterVolumeSpecName: "bundle") pod "07086892-d93c-49f0-bea6-d8523ddbdb35" (UID: "07086892-d93c-49f0-bea6-d8523ddbdb35"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:55.526259 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.526230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07086892-d93c-49f0-bea6-d8523ddbdb35-kube-api-access-mtv2g" (OuterVolumeSpecName: "kube-api-access-mtv2g") pod "07086892-d93c-49f0-bea6-d8523ddbdb35" (UID: "07086892-d93c-49f0-bea6-d8523ddbdb35"). InnerVolumeSpecName "kube-api-access-mtv2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:38:55.529404 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.529369    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-util" (OuterVolumeSpecName: "util") pod "07086892-d93c-49f0-bea6-d8523ddbdb35" (UID: "07086892-d93c-49f0-bea6-d8523ddbdb35"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:55.625187 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.625109    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:55.625187 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.625134    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07086892-d93c-49f0-bea6-d8523ddbdb35-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:55.625187 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.625145    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtv2g\" (UniqueName: \"kubernetes.io/projected/07086892-d93c-49f0-bea6-d8523ddbdb35-kube-api-access-mtv2g\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:55.966095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:55.966019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:56.367716 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.367687    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm"
Sep 17 17:38:56.368158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.367722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fmqmm" event={"ID":"07086892-d93c-49f0-bea6-d8523ddbdb35","Type":"ContainerDied","Data":"3b8a5c4d33c8bd890d2d5cc6c3c932b6d433199a4a0cec8e0d34b2c420dec59b"}
Sep 17 17:38:56.368158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.367769    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b8a5c4d33c8bd890d2d5cc6c3c932b6d433199a4a0cec8e0d34b2c420dec59b"
Sep 17 17:38:56.550493 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.550341    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:56.552658 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.552628    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:56.556406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.556384    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:56.633489 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633414    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xnb2\" (UniqueName: \"kubernetes.io/projected/96eef03f-efbe-4077-911a-6dbf16aaf432-kube-api-access-9xnb2\") pod \"96eef03f-efbe-4077-911a-6dbf16aaf432\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") "
Sep 17 17:38:56.633657 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633545    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcfcd\" (UniqueName: \"kubernetes.io/projected/ac2b0488-e87f-4330-8677-087bcdd53d22-kube-api-access-vcfcd\") pod \"ac2b0488-e87f-4330-8677-087bcdd53d22\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") "
Sep 17 17:38:56.633657 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633580    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-bundle\") pod \"96eef03f-efbe-4077-911a-6dbf16aaf432\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") "
Sep 17 17:38:56.633657 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-util\") pod \"96eef03f-efbe-4077-911a-6dbf16aaf432\" (UID: \"96eef03f-efbe-4077-911a-6dbf16aaf432\") "
Sep 17 17:38:56.633657 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633644    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-util\") pod \"ac2b0488-e87f-4330-8677-087bcdd53d22\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") "
Sep 17 17:38:56.633868 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9fnt\" (UniqueName: \"kubernetes.io/projected/15b955c9-7f2f-4d31-b88a-d6192062678c-kube-api-access-v9fnt\") pod \"15b955c9-7f2f-4d31-b88a-d6192062678c\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") "
Sep 17 17:38:56.633868 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633695    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-util\") pod \"15b955c9-7f2f-4d31-b88a-d6192062678c\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") "
Sep 17 17:38:56.633868 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633721    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-bundle\") pod \"ac2b0488-e87f-4330-8677-087bcdd53d22\" (UID: \"ac2b0488-e87f-4330-8677-087bcdd53d22\") "
Sep 17 17:38:56.633868 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.633798    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-bundle\") pod \"15b955c9-7f2f-4d31-b88a-d6192062678c\" (UID: \"15b955c9-7f2f-4d31-b88a-d6192062678c\") "
Sep 17 17:38:56.634172 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.634128    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-bundle" (OuterVolumeSpecName: "bundle") pod "96eef03f-efbe-4077-911a-6dbf16aaf432" (UID: "96eef03f-efbe-4077-911a-6dbf16aaf432"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:56.635565 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.634677    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-bundle" (OuterVolumeSpecName: "bundle") pod "ac2b0488-e87f-4330-8677-087bcdd53d22" (UID: "ac2b0488-e87f-4330-8677-087bcdd53d22"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:56.635565 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.634838    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-bundle" (OuterVolumeSpecName: "bundle") pod "15b955c9-7f2f-4d31-b88a-d6192062678c" (UID: "15b955c9-7f2f-4d31-b88a-d6192062678c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:56.636306 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.636245    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96eef03f-efbe-4077-911a-6dbf16aaf432-kube-api-access-9xnb2" (OuterVolumeSpecName: "kube-api-access-9xnb2") pod "96eef03f-efbe-4077-911a-6dbf16aaf432" (UID: "96eef03f-efbe-4077-911a-6dbf16aaf432"). InnerVolumeSpecName "kube-api-access-9xnb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:38:56.636306 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.636251    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2b0488-e87f-4330-8677-087bcdd53d22-kube-api-access-vcfcd" (OuterVolumeSpecName: "kube-api-access-vcfcd") pod "ac2b0488-e87f-4330-8677-087bcdd53d22" (UID: "ac2b0488-e87f-4330-8677-087bcdd53d22"). InnerVolumeSpecName "kube-api-access-vcfcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:38:56.636763 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.636735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b955c9-7f2f-4d31-b88a-d6192062678c-kube-api-access-v9fnt" (OuterVolumeSpecName: "kube-api-access-v9fnt") pod "15b955c9-7f2f-4d31-b88a-d6192062678c" (UID: "15b955c9-7f2f-4d31-b88a-d6192062678c"). InnerVolumeSpecName "kube-api-access-v9fnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:38:56.643208 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.643178    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-util" (OuterVolumeSpecName: "util") pod "15b955c9-7f2f-4d31-b88a-d6192062678c" (UID: "15b955c9-7f2f-4d31-b88a-d6192062678c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:56.643642 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.643604    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-util" (OuterVolumeSpecName: "util") pod "ac2b0488-e87f-4330-8677-087bcdd53d22" (UID: "ac2b0488-e87f-4330-8677-087bcdd53d22"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:56.643957 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.643937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-util" (OuterVolumeSpecName: "util") pod "96eef03f-efbe-4077-911a-6dbf16aaf432" (UID: "96eef03f-efbe-4077-911a-6dbf16aaf432"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:38:56.734542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734475    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcfcd\" (UniqueName: \"kubernetes.io/projected/ac2b0488-e87f-4330-8677-087bcdd53d22-kube-api-access-vcfcd\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734507    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734553    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eef03f-efbe-4077-911a-6dbf16aaf432-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734561    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734570    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9fnt\" (UniqueName: \"kubernetes.io/projected/15b955c9-7f2f-4d31-b88a-d6192062678c-kube-api-access-v9fnt\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734578    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734588    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b0488-e87f-4330-8677-087bcdd53d22-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734595    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15b955c9-7f2f-4d31-b88a-d6192062678c-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:56.734775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:56.734602    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xnb2\" (UniqueName: \"kubernetes.io/projected/96eef03f-efbe-4077-911a-6dbf16aaf432-kube-api-access-9xnb2\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:38:57.374419 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.374388    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l"
Sep 17 17:38:57.374419 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.374406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anwm4l" event={"ID":"15b955c9-7f2f-4d31-b88a-d6192062678c","Type":"ContainerDied","Data":"c35f29540c7c9310f8e3209ca15352405a9e19b64dfe6c78e017ee2f76d6fba6"}
Sep 17 17:38:57.374962 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.374459    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c35f29540c7c9310f8e3209ca15352405a9e19b64dfe6c78e017ee2f76d6fba6"
Sep 17 17:38:57.376415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.376393    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r"
Sep 17 17:38:57.376593 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.376437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tpt8r" event={"ID":"96eef03f-efbe-4077-911a-6dbf16aaf432","Type":"ContainerDied","Data":"537d37cb8ec8d26633994bdd89dc5986a1564a9eb91f4bf19df28819dcbc90fb"}
Sep 17 17:38:57.376593 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.376477    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="537d37cb8ec8d26633994bdd89dc5986a1564a9eb91f4bf19df28819dcbc90fb"
Sep 17 17:38:57.378390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.378362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl" event={"ID":"ac2b0488-e87f-4330-8677-087bcdd53d22","Type":"ContainerDied","Data":"0f01bd06d9fe5a78b11405c9e9719fbc868bad9e7561c3e3d6472f0c3e229993"}
Sep 17 17:38:57.378390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.378379    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck8qxl"
Sep 17 17:38:57.378552 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:38:57.378404    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f01bd06d9fe5a78b11405c9e9719fbc868bad9e7561c3e3d6472f0c3e229993"
Sep 17 17:39:00.205284 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:00.205244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:00.312363 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:00.312315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:00.496993 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:00.496967    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:03.091319 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:03.091287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:03.478817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:03.478734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:03.891663 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:03.891630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:04.761221 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:04.761184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:06.565937 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:06.565901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:06.665810 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:06.665779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:07.119884 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:07.119855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:07.504029 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:07.504000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:08.195341 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:08.195316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:08.302617 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:08.302581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:10.117626 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:10.117595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:10.251533 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:10.251496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:11.110727 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:11.110692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:11.210327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:11.210294    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:11.310731 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:11.310697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:13.100054 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:13.100024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:13.215828 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:13.215795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:14.956823 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.956786    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"]
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957107    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerName="extract"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957142    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerName="extract"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957155    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerName="extract"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957161    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerName="extract"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957171    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerName="pull"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957176    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerName="pull"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957182    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerName="extract"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957186    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerName="extract"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957193    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerName="pull"
Sep 17 17:39:14.957195 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957199    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerName="pull"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957211    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957216    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957221    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957227    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957232    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerName="pull"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957237    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerName="pull"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957242    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerName="extract"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957247    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerName="extract"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957260    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957265    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957274    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957279    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerName="util"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957287    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerName="pull"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957292    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerName="pull"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957346    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="96eef03f-efbe-4077-911a-6dbf16aaf432" containerName="extract"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957363    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="07086892-d93c-49f0-bea6-d8523ddbdb35" containerName="extract"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957370    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b955c9-7f2f-4d31-b88a-d6192062678c" containerName="extract"
Sep 17 17:39:14.957655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.957386    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2b0488-e87f-4330-8677-087bcdd53d22" containerName="extract"
Sep 17 17:39:14.962117 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.962098    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:14.964168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.964147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:14.964622 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.964603    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 17:39:14.964709 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.964635    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 17:39:14.964709 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.964689    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 17 17:39:14.964709 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.964704    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 17 17:39:14.965646 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.965632    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gqjh7\""
Sep 17 17:39:14.969084 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:14.969062    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"]
Sep 17 17:39:15.107127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.107091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e2fac8f-c9d0-4d02-9b82-597707682941-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.107127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.107128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e2fac8f-c9d0-4d02-9b82-597707682941-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.107335 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.107153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrtj\" (UniqueName: \"kubernetes.io/projected/2e2fac8f-c9d0-4d02-9b82-597707682941-kube-api-access-tdrtj\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.171647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.171616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:15.207777 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.207684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e2fac8f-c9d0-4d02-9b82-597707682941-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.207777 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.207725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e2fac8f-c9d0-4d02-9b82-597707682941-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.207969 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.207778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrtj\" (UniqueName: \"kubernetes.io/projected/2e2fac8f-c9d0-4d02-9b82-597707682941-kube-api-access-tdrtj\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.208426 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.208406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e2fac8f-c9d0-4d02-9b82-597707682941-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.210162 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.210145    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e2fac8f-c9d0-4d02-9b82-597707682941-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.220362 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.220339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrtj\" (UniqueName: \"kubernetes.io/projected/2e2fac8f-c9d0-4d02-9b82-597707682941-kube-api-access-tdrtj\") pod \"kuadrant-console-plugin-fbdd4f445-5nt9j\" (UID: \"2e2fac8f-c9d0-4d02-9b82-597707682941\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.272496 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.272454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"
Sep 17 17:39:15.545276 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:15.545252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j"]
Sep 17 17:39:15.547549 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:39:15.547496    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e2fac8f_c9d0_4d02_9b82_597707682941.slice/crio-852df8f8624b6c3e3b94b2c1311d46f74852c5b79f68d2d14726b52b914ee025 WatchSource:0}: Error finding container 852df8f8624b6c3e3b94b2c1311d46f74852c5b79f68d2d14726b52b914ee025: Status 404 returned error can't find the container with id 852df8f8624b6c3e3b94b2c1311d46f74852c5b79f68d2d14726b52b914ee025
Sep 17 17:39:16.482306 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:16.482225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j" event={"ID":"2e2fac8f-c9d0-4d02-9b82-597707682941","Type":"ContainerStarted","Data":"852df8f8624b6c3e3b94b2c1311d46f74852c5b79f68d2d14726b52b914ee025"}
Sep 17 17:39:18.298709 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:18.298657    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:18.391861 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:18.391824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:18.509214 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:18.509176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:18.607935 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:18.607853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:18.710191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:18.710151    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:18.808092 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:18.808059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:20.506261 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:20.506222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j" event={"ID":"2e2fac8f-c9d0-4d02-9b82-597707682941","Type":"ContainerStarted","Data":"994bc92a7127ecaefa53d2ac9890d51cc5b69260d32c12b41e49fad0bef09dcc"}
Sep 17 17:39:20.529197 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:20.529142    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nt9j" podStartSLOduration=1.915664936 podStartE2EDuration="6.529126259s" totalImagesPullingTime="4.613461323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:39:20.527278176 +0000 UTC m=+468.305115812" watchObservedRunningTime="2026-09-17 17:39:20.529126259 +0000 UTC m=+468.306963895"
Sep 17 17:39:26.832663 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:26.832629    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:26.941384 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:26.941346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:27.030717 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:27.030673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:29.801573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:29.801500    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:29.890787 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:29.890757    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:30.720231 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:30.720197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:30.824618 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:30.824586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:31.321417 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:31.321376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:32.448642 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:32.448610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:32.550549 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:32.550503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:37.767680 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:37.767644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:37.835280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:37.835221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:38.183374 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:38.183293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:38.284351 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:38.284317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:38.592663 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:38.592628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:38.659743 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:38.659711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:49.053214 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:49.053182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:49.197027 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:49.196984    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:49.375423 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:49.375342    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:50.778758 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:50.778725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:52.396017 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:52.395991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:52.540586 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:52.540556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:56.780490 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:56.780460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:56.883705 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:39:56.883672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:08.225322 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:08.225290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:08.327501 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:08.327472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:08.428669 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:08.428637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:09.049883 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.049848    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-mtb7x"]
Sep 17 17:40:09.070148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.070119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-mtb7x"]
Sep 17 17:40:09.070295 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.070208    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x"
Sep 17 17:40:09.072998 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.072974    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zb79d\""
Sep 17 17:40:09.107398 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.107374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:09.167752 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.167727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwln7\" (UniqueName: \"kubernetes.io/projected/00af8975-d345-42ab-9ce1-9a5473691eb8-kube-api-access-kwln7\") pod \"authorino-7bcfd8f9cd-mtb7x\" (UID: \"00af8975-d345-42ab-9ce1-9a5473691eb8\") " pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x"
Sep 17 17:40:09.207367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.207344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:09.269034 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.268998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwln7\" (UniqueName: \"kubernetes.io/projected/00af8975-d345-42ab-9ce1-9a5473691eb8-kube-api-access-kwln7\") pod \"authorino-7bcfd8f9cd-mtb7x\" (UID: \"00af8975-d345-42ab-9ce1-9a5473691eb8\") " pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x"
Sep 17 17:40:09.277662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.277637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwln7\" (UniqueName: \"kubernetes.io/projected/00af8975-d345-42ab-9ce1-9a5473691eb8-kube-api-access-kwln7\") pod \"authorino-7bcfd8f9cd-mtb7x\" (UID: \"00af8975-d345-42ab-9ce1-9a5473691eb8\") " pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x"
Sep 17 17:40:09.378802 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.378738    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x"
Sep 17 17:40:09.652777 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.652755    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-mtb7x"]
Sep 17 17:40:09.654885 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:40:09.654860    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00af8975_d345_42ab_9ce1_9a5473691eb8.slice/crio-a21dde15bb7ee70c80ba7b4e422a17e87652df368b5e834f298ed514b708a068 WatchSource:0}: Error finding container a21dde15bb7ee70c80ba7b4e422a17e87652df368b5e834f298ed514b708a068: Status 404 returned error can't find the container with id a21dde15bb7ee70c80ba7b4e422a17e87652df368b5e834f298ed514b708a068
Sep 17 17:40:09.752755 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:09.752725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x" event={"ID":"00af8975-d345-42ab-9ce1-9a5473691eb8","Type":"ContainerStarted","Data":"a21dde15bb7ee70c80ba7b4e422a17e87652df368b5e834f298ed514b708a068"}
Sep 17 17:40:12.230129 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:12.230094    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-mtb7x"]
Sep 17 17:40:15.098732 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:15.098700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:15.198175 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:15.198144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:25.801334 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:25.801297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:25.837095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:25.837064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x" event={"ID":"00af8975-d345-42ab-9ce1-9a5473691eb8","Type":"ContainerStarted","Data":"48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43"}
Sep 17 17:40:25.837249 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:25.837108    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x" podUID="00af8975-d345-42ab-9ce1-9a5473691eb8" containerName="authorino" containerID="cri-o://48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43" gracePeriod=30
Sep 17 17:40:25.867953 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:25.867908    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x" podStartSLOduration=1.313255798 podStartE2EDuration="16.867893721s" totalImagesPullingTime="15.554637923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:40:25.86510138 +0000 UTC m=+533.642939015" watchObservedRunningTime="2026-09-17 17:40:25.867893721 +0000 UTC m=+533.645731390"
Sep 17 17:40:25.890197 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:25.890158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:26.079788 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.079763    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x"
Sep 17 17:40:26.214814 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.214774    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwln7\" (UniqueName: \"kubernetes.io/projected/00af8975-d345-42ab-9ce1-9a5473691eb8-kube-api-access-kwln7\") pod \"00af8975-d345-42ab-9ce1-9a5473691eb8\" (UID: \"00af8975-d345-42ab-9ce1-9a5473691eb8\") "
Sep 17 17:40:26.217058 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.217027    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00af8975-d345-42ab-9ce1-9a5473691eb8-kube-api-access-kwln7" (OuterVolumeSpecName: "kube-api-access-kwln7") pod "00af8975-d345-42ab-9ce1-9a5473691eb8" (UID: "00af8975-d345-42ab-9ce1-9a5473691eb8"). InnerVolumeSpecName "kube-api-access-kwln7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:40:26.315502 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.315431    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwln7\" (UniqueName: \"kubernetes.io/projected/00af8975-d345-42ab-9ce1-9a5473691eb8-kube-api-access-kwln7\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:40:26.348993 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.348959    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:26.842693 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.842658    2559 generic.go:356] "Generic (PLEG): container finished" podID="00af8975-d345-42ab-9ce1-9a5473691eb8" containerID="48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43" exitCode=0
Sep 17 17:40:26.842693 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.842698    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x"
Sep 17 17:40:26.843148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.842747    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x" event={"ID":"00af8975-d345-42ab-9ce1-9a5473691eb8","Type":"ContainerDied","Data":"48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43"}
Sep 17 17:40:26.843148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.842773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-mtb7x" event={"ID":"00af8975-d345-42ab-9ce1-9a5473691eb8","Type":"ContainerDied","Data":"a21dde15bb7ee70c80ba7b4e422a17e87652df368b5e834f298ed514b708a068"}
Sep 17 17:40:26.843148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.842801    2559 scope.go:117] "RemoveContainer" containerID="48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43"
Sep 17 17:40:26.854312 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.854292    2559 scope.go:117] "RemoveContainer" containerID="48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43"
Sep 17 17:40:26.854641 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:40:26.854620    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43\": container with ID starting with 48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43 not found: ID does not exist" containerID="48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43"
Sep 17 17:40:26.854723 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.854650    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43"} err="failed to get container status \"48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43\": rpc error: code = NotFound desc = could not find container \"48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43\": container with ID starting with 48e28152b75d7f774da14dbcaeab8a3d2b4d4025c2b55d3cdf3552fd61d7be43 not found: ID does not exist"
Sep 17 17:40:26.862348 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.862321    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-mtb7x"]
Sep 17 17:40:26.869713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:26.869691    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-mtb7x"]
Sep 17 17:40:28.398823 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:28.398792    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00af8975-d345-42ab-9ce1-9a5473691eb8" path="/var/lib/kubelet/pods/00af8975-d345-42ab-9ce1-9a5473691eb8/volumes"
Sep 17 17:40:38.669221 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.669190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:38.781443 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.781414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:38.934972 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.934893    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-ch7vl"]
Sep 17 17:40:38.935216 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.935204    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00af8975-d345-42ab-9ce1-9a5473691eb8" containerName="authorino"
Sep 17 17:40:38.935265 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.935217    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="00af8975-d345-42ab-9ce1-9a5473691eb8" containerName="authorino"
Sep 17 17:40:38.935305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.935300    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="00af8975-d345-42ab-9ce1-9a5473691eb8" containerName="authorino"
Sep 17 17:40:38.939606 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.939587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-ch7vl"
Sep 17 17:40:38.942333 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.942312    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zb79d\""
Sep 17 17:40:38.949064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:38.949044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-ch7vl"]
Sep 17 17:40:39.009431 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.009406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzb2\" (UniqueName: \"kubernetes.io/projected/8e82d083-e990-4d51-8e21-c5f289b12422-kube-api-access-nxzb2\") pod \"authorino-557f876f69-ch7vl\" (UID: \"8e82d083-e990-4d51-8e21-c5f289b12422\") " pod="kuadrant-system/authorino-557f876f69-ch7vl"
Sep 17 17:40:39.048952 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.048921    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-ch7vl"]
Sep 17 17:40:39.049198 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:40:39.049180    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nxzb2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-ch7vl" podUID="8e82d083-e990-4d51-8e21-c5f289b12422"
Sep 17 17:40:39.110490 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.110455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzb2\" (UniqueName: \"kubernetes.io/projected/8e82d083-e990-4d51-8e21-c5f289b12422-kube-api-access-nxzb2\") pod \"authorino-557f876f69-ch7vl\" (UID: \"8e82d083-e990-4d51-8e21-c5f289b12422\") " pod="kuadrant-system/authorino-557f876f69-ch7vl"
Sep 17 17:40:39.118700 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.118670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzb2\" (UniqueName: \"kubernetes.io/projected/8e82d083-e990-4d51-8e21-c5f289b12422-kube-api-access-nxzb2\") pod \"authorino-557f876f69-ch7vl\" (UID: \"8e82d083-e990-4d51-8e21-c5f289b12422\") " pod="kuadrant-system/authorino-557f876f69-ch7vl"
Sep 17 17:40:39.907799 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.907768    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-ch7vl"
Sep 17 17:40:39.914811 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.914789    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-ch7vl"
Sep 17 17:40:39.916123 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.916106    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxzb2\" (UniqueName: \"kubernetes.io/projected/8e82d083-e990-4d51-8e21-c5f289b12422-kube-api-access-nxzb2\") pod \"8e82d083-e990-4d51-8e21-c5f289b12422\" (UID: \"8e82d083-e990-4d51-8e21-c5f289b12422\") "
Sep 17 17:40:39.918301 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:39.918274    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e82d083-e990-4d51-8e21-c5f289b12422-kube-api-access-nxzb2" (OuterVolumeSpecName: "kube-api-access-nxzb2") pod "8e82d083-e990-4d51-8e21-c5f289b12422" (UID: "8e82d083-e990-4d51-8e21-c5f289b12422"). InnerVolumeSpecName "kube-api-access-nxzb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:40:40.016746 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:40.016716    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxzb2\" (UniqueName: \"kubernetes.io/projected/8e82d083-e990-4d51-8e21-c5f289b12422-kube-api-access-nxzb2\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:40:40.912553 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:40.912507    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-ch7vl"
Sep 17 17:40:40.943893 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:40.943853    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-ch7vl"]
Sep 17 17:40:40.946049 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:40.946023    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-ch7vl"]
Sep 17 17:40:42.399874 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:42.399843    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e82d083-e990-4d51-8e21-c5f289b12422" path="/var/lib/kubelet/pods/8e82d083-e990-4d51-8e21-c5f289b12422/volumes"
Sep 17 17:40:46.790384 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:46.790354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:46.867953 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:46.867919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:46.936390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:46.936358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:47.744202 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:47.744166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:50.977643 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:50.977609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:40:51.118507 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:40:51.118461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:12.664480 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:12.664447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:23.614024 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:23.613995    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:23.711834 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:23.711808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:25.040324 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.040271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:25.135424 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.135399    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:25.455823 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.455745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:25.603398 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.603366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:25.704650 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.704616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:25.803211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.803182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:25.821567 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.821539    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"]
Sep 17 17:41:25.824699 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.824678    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:25.827783 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.827765    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xq52t\""
Sep 17 17:41:25.828267 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.828251    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 17 17:41:25.838627 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:25.838607    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"]
Sep 17 17:41:26.009311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.009267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cbcb970-eed0-4ee7-9c15-9f0329ca2946-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-v2ghz\" (UID: \"5cbcb970-eed0-4ee7-9c15-9f0329ca2946\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:26.009491 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.009368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5spm\" (UniqueName: \"kubernetes.io/projected/5cbcb970-eed0-4ee7-9c15-9f0329ca2946-kube-api-access-m5spm\") pod \"payload-processing-5b54b7fbb7-v2ghz\" (UID: \"5cbcb970-eed0-4ee7-9c15-9f0329ca2946\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:26.109966 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.109891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5spm\" (UniqueName: \"kubernetes.io/projected/5cbcb970-eed0-4ee7-9c15-9f0329ca2946-kube-api-access-m5spm\") pod \"payload-processing-5b54b7fbb7-v2ghz\" (UID: \"5cbcb970-eed0-4ee7-9c15-9f0329ca2946\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:26.110304 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.109968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cbcb970-eed0-4ee7-9c15-9f0329ca2946-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-v2ghz\" (UID: \"5cbcb970-eed0-4ee7-9c15-9f0329ca2946\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:26.110618 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.110599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cbcb970-eed0-4ee7-9c15-9f0329ca2946-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-v2ghz\" (UID: \"5cbcb970-eed0-4ee7-9c15-9f0329ca2946\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:26.120637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.120615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5spm\" (UniqueName: \"kubernetes.io/projected/5cbcb970-eed0-4ee7-9c15-9f0329ca2946-kube-api-access-m5spm\") pod \"payload-processing-5b54b7fbb7-v2ghz\" (UID: \"5cbcb970-eed0-4ee7-9c15-9f0329ca2946\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:26.134706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.134685    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:26.409491 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:26.409465    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"]
Sep 17 17:41:26.411363 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:41:26.411336    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbcb970_eed0_4ee7_9c15_9f0329ca2946.slice/crio-6a9b2ef36d2399d0fe513d53664e74c88cd03265feb454334c83b4af4386a795 WatchSource:0}: Error finding container 6a9b2ef36d2399d0fe513d53664e74c88cd03265feb454334c83b4af4386a795: Status 404 returned error can't find the container with id 6a9b2ef36d2399d0fe513d53664e74c88cd03265feb454334c83b4af4386a795
Sep 17 17:41:27.142343 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:27.142307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz" event={"ID":"5cbcb970-eed0-4ee7-9c15-9f0329ca2946","Type":"ContainerStarted","Data":"6a9b2ef36d2399d0fe513d53664e74c88cd03265feb454334c83b4af4386a795"}
Sep 17 17:41:28.148769 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:28.148732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz" event={"ID":"5cbcb970-eed0-4ee7-9c15-9f0329ca2946","Type":"ContainerStarted","Data":"5dd7ec9fe9b1a9190b5ecd418ffc198a81a128550b509b3dfcee014ec088f5cf"}
Sep 17 17:41:28.149213 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:28.148791    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:28.182683 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:28.182627    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz" podStartSLOduration=1.898515133 podStartE2EDuration="3.182608647s" totalImagesPullingTime="1.284093514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:28.178652916 +0000 UTC m=+595.956490550" watchObservedRunningTime="2026-09-17 17:41:28.182608647 +0000 UTC m=+595.960446286"
Sep 17 17:41:34.326341 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:34.326310    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:41:34.328950 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:34.328929    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:41:37.669889 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:37.669848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:37.778279 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:37.778246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:39.156536 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:39.156496    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-v2ghz"
Sep 17 17:41:41.292453 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:41.292419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:48.359764 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:41:48.359679    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:08.133019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.132989    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"]
Sep 17 17:42:08.137632 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.137616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.140327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.140306    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 17:42:08.141350 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.141326    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hxzsq\""
Sep 17 17:42:08.141450 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.141388    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 17:42:08.141450 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.141423    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 17 17:42:08.151505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.151486    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"]
Sep 17 17:42:08.173925 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.173879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:08.281625 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.281597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.281782 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.281633    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.281782 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.281649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.281782 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.281662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.281782 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.281747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.281951 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.281806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncj5z\" (UniqueName: \"kubernetes.io/projected/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-kube-api-access-ncj5z\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383284 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncj5z\" (UniqueName: \"kubernetes.io/projected/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-kube-api-access-ncj5z\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383284 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383476 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383476 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383476 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383476 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383767 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383811 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.383852 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.383816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.385620 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.385600    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.385898 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.385881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.400142 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.394475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncj5z\" (UniqueName: \"kubernetes.io/projected/8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b-kube-api-access-ncj5z\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m\" (UID: \"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.447491 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.447459    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:08.728208 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.728176    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"]
Sep 17 17:42:08.729864 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:42:08.729837    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d899a7f_ba45_4aff_8641_3e8a9b7f2f2b.slice/crio-8c25258b07d45eeea4dc872518834ff70a1d03c9a0e2455846fea70e3b6f751d WatchSource:0}: Error finding container 8c25258b07d45eeea4dc872518834ff70a1d03c9a0e2455846fea70e3b6f751d: Status 404 returned error can't find the container with id 8c25258b07d45eeea4dc872518834ff70a1d03c9a0e2455846fea70e3b6f751d
Sep 17 17:42:08.731532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:08.731496    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:42:09.367606 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:09.367558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m" event={"ID":"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b","Type":"ContainerStarted","Data":"8c25258b07d45eeea4dc872518834ff70a1d03c9a0e2455846fea70e3b6f751d"}
Sep 17 17:42:10.374112 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:10.374077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m" event={"ID":"8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b","Type":"ContainerStarted","Data":"f5d6abea7439fa93a6057c36de03e5fb92c1ef7d8ea979633859b3f9c430dc5c"}
Sep 17 17:42:10.402122 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:10.402065    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m" podStartSLOduration=1.355980234 podStartE2EDuration="2.402050008s" totalImagesPullingTime="1.046069774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:10.398847515 +0000 UTC m=+638.176685149" watchObservedRunningTime="2026-09-17 17:42:10.402050008 +0000 UTC m=+638.179887645"
Sep 17 17:42:18.035449 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.035417    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"]
Sep 17 17:42:18.039236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.039215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.042032 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.042008    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 17 17:42:18.050867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.050842    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"]
Sep 17 17:42:18.066476 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.066447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7ld\" (UniqueName: \"kubernetes.io/projected/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-kube-api-access-wp7ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.066595 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.066493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.066595 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.066570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.066707 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.066620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.066762 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.066712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.066762 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.066755    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.068347 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.068330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:18.167132 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167100    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167132 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167138    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7ld\" (UniqueName: \"kubernetes.io/projected/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-kube-api-access-wp7ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167757 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167757 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167642    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.167757 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.167666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.169459 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.169435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.169757 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.169740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.178898 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.178878    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7ld\" (UniqueName: \"kubernetes.io/projected/1f076717-e5a4-4ccf-bfb9-fa0f6773d5de-kube-api-access-wp7ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rjmrv\" (UID: \"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.349571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.349500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:18.448224 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.448196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:18.448355 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.448254    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:18.460397 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.460379    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:18.623113 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:18.623086    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"]
Sep 17 17:42:18.624201 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:42:18.624174    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f076717_e5a4_4ccf_bfb9_fa0f6773d5de.slice/crio-94ea1b947ddd56583285293c3213cb03ff696373e491fe83d5e6d463618de451 WatchSource:0}: Error finding container 94ea1b947ddd56583285293c3213cb03ff696373e491fe83d5e6d463618de451: Status 404 returned error can't find the container with id 94ea1b947ddd56583285293c3213cb03ff696373e491fe83d5e6d463618de451
Sep 17 17:42:19.422973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:19.422929    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv" event={"ID":"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de","Type":"ContainerStarted","Data":"b187f370dc916870cdc82ed80de4d13f65b8b871e1e8df253a0debf5bcec50f8"}
Sep 17 17:42:19.423541 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:19.423029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv" event={"ID":"1f076717-e5a4-4ccf-bfb9-fa0f6773d5de","Type":"ContainerStarted","Data":"94ea1b947ddd56583285293c3213cb03ff696373e491fe83d5e6d463618de451"}
Sep 17 17:42:19.434491 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:19.434469    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m"
Sep 17 17:42:19.449327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:19.449285    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv" podStartSLOduration=1.25056529 podStartE2EDuration="1.449272475s" totalImagesPullingTime="198.707185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:19.447451365 +0000 UTC m=+647.225288999" watchObservedRunningTime="2026-09-17 17:42:19.449272475 +0000 UTC m=+647.227110110"
Sep 17 17:42:28.350040 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:28.350004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:28.350480 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:28.350068    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:28.362671 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:28.362650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:28.479073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:28.479050    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rjmrv"
Sep 17 17:42:38.832353 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.832317    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"]
Sep 17 17:42:38.836593 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.836571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:38.843322 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.843291    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 17 17:42:38.856714 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.856690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"]
Sep 17 17:42:38.887273 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.887251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:38.946434 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.946411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:38.946555 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.946437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:38.946555 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.946486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:38.946637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.946566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:38.946637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.946589    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445rb\" (UniqueName: \"kubernetes.io/projected/37736117-001c-41a4-b905-015a24dc8a6d-kube-api-access-445rb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:38.946637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:38.946629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37736117-001c-41a4-b905-015a24dc8a6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.047813 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.047786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445rb\" (UniqueName: \"kubernetes.io/projected/37736117-001c-41a4-b905-015a24dc8a6d-kube-api-access-445rb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.047938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.047833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37736117-001c-41a4-b905-015a24dc8a6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.047938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.047850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.047938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.047870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.048167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.047944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.048167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.047997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.048419 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.048381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.048542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.048423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.048601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.048546    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.050077 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.050057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37736117-001c-41a4-b905-015a24dc8a6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.050475 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.050459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37736117-001c-41a4-b905-015a24dc8a6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.057348 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.057324    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-445rb\" (UniqueName: \"kubernetes.io/projected/37736117-001c-41a4-b905-015a24dc8a6d-kube-api-access-445rb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr\" (UID: \"37736117-001c-41a4-b905-015a24dc8a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.148995 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.148931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:39.424176 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.424095    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"]
Sep 17 17:42:39.431398 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:42:39.431369    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37736117_001c_41a4_b905_015a24dc8a6d.slice/crio-408aa22b60518660fd41fb617369fe2b106331abe8237c9d626b05a3aa69640b WatchSource:0}: Error finding container 408aa22b60518660fd41fb617369fe2b106331abe8237c9d626b05a3aa69640b: Status 404 returned error can't find the container with id 408aa22b60518660fd41fb617369fe2b106331abe8237c9d626b05a3aa69640b
Sep 17 17:42:39.521600 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:39.521573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr" event={"ID":"37736117-001c-41a4-b905-015a24dc8a6d","Type":"ContainerStarted","Data":"408aa22b60518660fd41fb617369fe2b106331abe8237c9d626b05a3aa69640b"}
Sep 17 17:42:40.008465 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:40.008442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:40.527947 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:40.527916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr" event={"ID":"37736117-001c-41a4-b905-015a24dc8a6d","Type":"ContainerStarted","Data":"e7a22d50f498d860a36d843aee4f44b170f0f14f8b9646f13420980c1ced3835"}
Sep 17 17:42:40.558938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:40.558891    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr" podStartSLOduration=2.362901966 podStartE2EDuration="2.558859574s" totalImagesPullingTime="195.957608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:40.557464729 +0000 UTC m=+668.335302361" watchObservedRunningTime="2026-09-17 17:42:40.558859574 +0000 UTC m=+668.336697208"
Sep 17 17:42:49.149829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:49.149796    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:49.150258 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:49.149885    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:49.162011 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:49.161985    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:49.585759 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:49.585729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr"
Sep 17 17:42:51.680467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:42:51.680434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:01.039605 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:43:01.039577    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:04.501364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:43:04.501337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:04.920743 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:43:04.920662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:04.980130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:43:04.980075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:05.154865 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:43:05.154839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:17.035737 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:43:17.035660    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:42.200204 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:43:42.200172    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:38.660829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.660796    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b4d9867c8-5jxgs"]
Sep 17 17:44:38.663077 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.663060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:38.666676 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.666648    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zb79d\""
Sep 17 17:44:38.666831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.666771    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 17 17:44:38.686213 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.686186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0929c827-2138-45e1-b125-620ac016dda0-tls-cert\") pod \"authorino-6b4d9867c8-5jxgs\" (UID: \"0929c827-2138-45e1-b125-620ac016dda0\") " pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:38.686359 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.686221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w7zn\" (UniqueName: \"kubernetes.io/projected/0929c827-2138-45e1-b125-620ac016dda0-kube-api-access-9w7zn\") pod \"authorino-6b4d9867c8-5jxgs\" (UID: \"0929c827-2138-45e1-b125-620ac016dda0\") " pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:38.688474 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.688453    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b4d9867c8-5jxgs"]
Sep 17 17:44:38.786819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.786778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0929c827-2138-45e1-b125-620ac016dda0-tls-cert\") pod \"authorino-6b4d9867c8-5jxgs\" (UID: \"0929c827-2138-45e1-b125-620ac016dda0\") " pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:38.786819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.786822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w7zn\" (UniqueName: \"kubernetes.io/projected/0929c827-2138-45e1-b125-620ac016dda0-kube-api-access-9w7zn\") pod \"authorino-6b4d9867c8-5jxgs\" (UID: \"0929c827-2138-45e1-b125-620ac016dda0\") " pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:38.789291 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.789261    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0929c827-2138-45e1-b125-620ac016dda0-tls-cert\") pod \"authorino-6b4d9867c8-5jxgs\" (UID: \"0929c827-2138-45e1-b125-620ac016dda0\") " pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:38.797064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.797041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w7zn\" (UniqueName: \"kubernetes.io/projected/0929c827-2138-45e1-b125-620ac016dda0-kube-api-access-9w7zn\") pod \"authorino-6b4d9867c8-5jxgs\" (UID: \"0929c827-2138-45e1-b125-620ac016dda0\") " pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:38.971552 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:38.971460    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4d9867c8-5jxgs"
Sep 17 17:44:39.251275 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:39.251251    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b4d9867c8-5jxgs"]
Sep 17 17:44:39.253872 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:44:39.253845    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0929c827_2138_45e1_b125_620ac016dda0.slice/crio-5e28a96d52b11a9cb41b3606bde5a0ba066b829952ba4236f248f3bc80bbcc05 WatchSource:0}: Error finding container 5e28a96d52b11a9cb41b3606bde5a0ba066b829952ba4236f248f3bc80bbcc05: Status 404 returned error can't find the container with id 5e28a96d52b11a9cb41b3606bde5a0ba066b829952ba4236f248f3bc80bbcc05
Sep 17 17:44:40.166113 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:40.166080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b4d9867c8-5jxgs" event={"ID":"0929c827-2138-45e1-b125-620ac016dda0","Type":"ContainerStarted","Data":"5e28a96d52b11a9cb41b3606bde5a0ba066b829952ba4236f248f3bc80bbcc05"}
Sep 17 17:44:41.173940 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:41.173907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b4d9867c8-5jxgs" event={"ID":"0929c827-2138-45e1-b125-620ac016dda0","Type":"ContainerStarted","Data":"d778a132d52bd1a1574336ad93debe82f2916e72ae6635428fd7f488a2a8f5ca"}
Sep 17 17:44:41.194250 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:41.194204    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b4d9867c8-5jxgs" podStartSLOduration=2.260929295 podStartE2EDuration="3.194188929s" totalImagesPullingTime="933.259634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:44:41.191560616 +0000 UTC m=+788.969398251" watchObservedRunningTime="2026-09-17 17:44:41.194188929 +0000 UTC m=+788.972026563"
Sep 17 17:44:41.815300 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:41.815261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:41.912957 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:41.912916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:42.958243 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:42.958193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:43.053832 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:43.053777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:59.555182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:59.555075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:59.671387 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:59.671350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:59.830300 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:44:59.830216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:00.176397 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:00.176310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:00.399900 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:00.399859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:00.547386 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:00.547357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:00.697310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:00.697280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:00.790269 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:00.790223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:01.220914 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:01.220873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:01.409551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:01.409501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:01.540608 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:01.540567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:01.784818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:01.784789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:03.978792 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:03.978759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:04.082363 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:04.082312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:04.253276 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:04.253249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:04.475363 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:04.475326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:04.655381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:04.655298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:05.521573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:05.521538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:05.638438 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:05.638404    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:06.504469 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.504416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:06.614803 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.614772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:06.799201 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.799121    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"]
Sep 17 17:45:06.801557 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.801540    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:06.804340 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.804318    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-54966d\""
Sep 17 17:45:06.804467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.804318    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-54966d-dockercfg-f5ctb\""
Sep 17 17:45:06.824865 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.824844    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"]
Sep 17 17:45:06.942030 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.941995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b59381d-9b99-4562-95fd-2090052ba152-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:06.942207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:06.942050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/2b59381d-9b99-4562-95fd-2090052ba152-kube-api-access-zqk4f\") pod \"payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:07.042722 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.042685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b59381d-9b99-4562-95fd-2090052ba152-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:07.042900 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.042763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/2b59381d-9b99-4562-95fd-2090052ba152-kube-api-access-zqk4f\") pod \"payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:07.043378 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.043358    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b59381d-9b99-4562-95fd-2090052ba152-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:07.057473 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.057408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/2b59381d-9b99-4562-95fd-2090052ba152-kube-api-access-zqk4f\") pod \"payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:07.111286 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.111254    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:07.409451 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.409428    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"]
Sep 17 17:45:07.410176 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:07.410150    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b59381d_9b99_4562_95fd_2090052ba152.slice/crio-06105d3832dbe860e41086d58d4ad88e0fbb6ea38d9006718660b0a3a921e37e WatchSource:0}: Error finding container 06105d3832dbe860e41086d58d4ad88e0fbb6ea38d9006718660b0a3a921e37e: Status 404 returned error can't find the container with id 06105d3832dbe860e41086d58d4ad88e0fbb6ea38d9006718660b0a3a921e37e
Sep 17 17:45:07.429466 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.429441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:07.518260 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:07.518231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:08.249415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.249385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:08.325511 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.325476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9" event={"ID":"2b59381d-9b99-4562-95fd-2090052ba152","Type":"ContainerStarted","Data":"c54dfd6b2bb44314372aceb0fe56df7f83a0ffae1354f7bfb0116af09a924cff"}
Sep 17 17:45:08.325712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.325564    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9" event={"ID":"2b59381d-9b99-4562-95fd-2090052ba152","Type":"ContainerStarted","Data":"06105d3832dbe860e41086d58d4ad88e0fbb6ea38d9006718660b0a3a921e37e"}
Sep 17 17:45:08.325712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.325636    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:08.347188 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.347162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:08.351861 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.351820    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9" podStartSLOduration=2.351806437 podStartE2EDuration="2.351806437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:08.350584649 +0000 UTC m=+816.128422286" watchObservedRunningTime="2026-09-17 17:45:08.351806437 +0000 UTC m=+816.129644072"
Sep 17 17:45:08.492966 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.492934    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"]
Sep 17 17:45:08.495707 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.495688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.500412 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.500334    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-db7813-dockercfg-v4pq8\""
Sep 17 17:45:08.500577 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.500539    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-db7813\""
Sep 17 17:45:08.558051 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.558023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2455d2f-a04b-4af9-b028-f4c9cf56a372-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.558051 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.558059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lbk\" (UniqueName: \"kubernetes.io/projected/e2455d2f-a04b-4af9-b028-f4c9cf56a372-kube-api-access-k2lbk\") pod \"payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.565105 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.565079    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"]
Sep 17 17:45:08.574544 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.574507    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"]
Sep 17 17:45:08.577141 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.577126    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:08.599095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.599069    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"]
Sep 17 17:45:08.658818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.658789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2455d2f-a04b-4af9-b028-f4c9cf56a372-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.658818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.658823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46lhv\" (UniqueName: \"kubernetes.io/projected/d3fee711-5b5d-4be6-8059-046bd7c93f19-kube-api-access-46lhv\") pod \"payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:08.659014 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.658843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lbk\" (UniqueName: \"kubernetes.io/projected/e2455d2f-a04b-4af9-b028-f4c9cf56a372-kube-api-access-k2lbk\") pod \"payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.659014 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.658906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3fee711-5b5d-4be6-8059-046bd7c93f19-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:08.659504 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.659486    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2455d2f-a04b-4af9-b028-f4c9cf56a372-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.671240 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.671214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lbk\" (UniqueName: \"kubernetes.io/projected/e2455d2f-a04b-4af9-b028-f4c9cf56a372-kube-api-access-k2lbk\") pod \"payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.760271 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.760181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3fee711-5b5d-4be6-8059-046bd7c93f19-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:08.760271 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.760256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46lhv\" (UniqueName: \"kubernetes.io/projected/d3fee711-5b5d-4be6-8059-046bd7c93f19-kube-api-access-46lhv\") pod \"payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:08.761135 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.761111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3fee711-5b5d-4be6-8059-046bd7c93f19-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:08.768492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.768466    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46lhv\" (UniqueName: \"kubernetes.io/projected/d3fee711-5b5d-4be6-8059-046bd7c93f19-kube-api-access-46lhv\") pod \"payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:08.806602 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.806570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:08.887951 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:08.887916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:09.007439 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.007414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:09.080243 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.080215    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"]
Sep 17 17:45:09.081574 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.081551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:09.081873 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:09.081840    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2455d2f_a04b_4af9_b028_f4c9cf56a372.slice/crio-b37f0a35f51ea115e53c9a6eb1cd4183b4633ddf186d89178c6c4e2dea0a5bf9 WatchSource:0}: Error finding container b37f0a35f51ea115e53c9a6eb1cd4183b4633ddf186d89178c6c4e2dea0a5bf9: Status 404 returned error can't find the container with id b37f0a35f51ea115e53c9a6eb1cd4183b4633ddf186d89178c6c4e2dea0a5bf9
Sep 17 17:45:09.175081 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.175059    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"]
Sep 17 17:45:09.176248 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:09.176224    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fee711_5b5d_4be6_8059_046bd7c93f19.slice/crio-1013f3deae5e62078885fbbbca1203caebd1e27cd96d6683dc1937669530eaf0 WatchSource:0}: Error finding container 1013f3deae5e62078885fbbbca1203caebd1e27cd96d6683dc1937669530eaf0: Status 404 returned error can't find the container with id 1013f3deae5e62078885fbbbca1203caebd1e27cd96d6683dc1937669530eaf0
Sep 17 17:45:09.333225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.333123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f" event={"ID":"d3fee711-5b5d-4be6-8059-046bd7c93f19","Type":"ContainerStarted","Data":"88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b"}
Sep 17 17:45:09.333225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.333203    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:09.333225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.333226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f" event={"ID":"d3fee711-5b5d-4be6-8059-046bd7c93f19","Type":"ContainerStarted","Data":"1013f3deae5e62078885fbbbca1203caebd1e27cd96d6683dc1937669530eaf0"}
Sep 17 17:45:09.341585 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.341555    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv" event={"ID":"e2455d2f-a04b-4af9-b028-f4c9cf56a372","Type":"ContainerStarted","Data":"ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843"}
Sep 17 17:45:09.341710 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.341626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:09.341710 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.341643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv" event={"ID":"e2455d2f-a04b-4af9-b028-f4c9cf56a372","Type":"ContainerStarted","Data":"b37f0a35f51ea115e53c9a6eb1cd4183b4633ddf186d89178c6c4e2dea0a5bf9"}
Sep 17 17:45:09.358531 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.358471    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f" podStartSLOduration=1.358456598 podStartE2EDuration="1.358456598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:09.354246734 +0000 UTC m=+817.132084370" watchObservedRunningTime="2026-09-17 17:45:09.358456598 +0000 UTC m=+817.136294233"
Sep 17 17:45:09.364445 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.364418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:09.382667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.382623    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv" podStartSLOduration=1.382606002 podStartE2EDuration="1.382606002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:09.381137926 +0000 UTC m=+817.158975562" watchObservedRunningTime="2026-09-17 17:45:09.382606002 +0000 UTC m=+817.160443641"
Sep 17 17:45:09.614448 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.614364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:09.714615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.714584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:09.787899 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.787865    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"]
Sep 17 17:45:09.790858 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.790841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:09.794114 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.794091    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-8aeea1-dockercfg-mmqsj\""
Sep 17 17:45:09.794724 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.794698    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-8aeea1\""
Sep 17 17:45:09.804056 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.804033    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"]
Sep 17 17:45:09.872313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.872216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03fa496f-e4f2-455a-87a1-961f945d7c65-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:09.872313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.872268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l5qq\" (UniqueName: \"kubernetes.io/projected/03fa496f-e4f2-455a-87a1-961f945d7c65-kube-api-access-5l5qq\") pod \"payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:09.912495 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.912462    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"]
Sep 17 17:45:09.914816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.914791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:09.937276 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.937248    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"]
Sep 17 17:45:09.973429 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.973396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03fa496f-e4f2-455a-87a1-961f945d7c65-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:09.973583 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.973450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l5qq\" (UniqueName: \"kubernetes.io/projected/03fa496f-e4f2-455a-87a1-961f945d7c65-kube-api-access-5l5qq\") pod \"payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:09.974286 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.974263    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03fa496f-e4f2-455a-87a1-961f945d7c65-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:09.988737 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:09.988706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l5qq\" (UniqueName: \"kubernetes.io/projected/03fa496f-e4f2-455a-87a1-961f945d7c65-kube-api-access-5l5qq\") pod \"payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:10.074186 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.074150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cl68\" (UniqueName: \"kubernetes.io/projected/0366360a-db43-48ea-b224-3e304857d29c-kube-api-access-6cl68\") pod \"payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:10.074373 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.074261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0366360a-db43-48ea-b224-3e304857d29c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:10.104006 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.103975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:10.175965 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.175930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl68\" (UniqueName: \"kubernetes.io/projected/0366360a-db43-48ea-b224-3e304857d29c-kube-api-access-6cl68\") pod \"payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:10.176226 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.176206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0366360a-db43-48ea-b224-3e304857d29c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:10.176974 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.176938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0366360a-db43-48ea-b224-3e304857d29c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:10.195062 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.195041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cl68\" (UniqueName: \"kubernetes.io/projected/0366360a-db43-48ea-b224-3e304857d29c-kube-api-access-6cl68\") pod \"payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:10.206649 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.206610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:10.227425 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.227402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:10.387346 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.387318    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"]
Sep 17 17:45:10.390001 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:10.389973    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fa496f_e4f2_455a_87a1_961f945d7c65.slice/crio-49af0e68933f8de23456d10eb87c74a35516ee871711a30175f005fd552bc0c1 WatchSource:0}: Error finding container 49af0e68933f8de23456d10eb87c74a35516ee871711a30175f005fd552bc0c1: Status 404 returned error can't find the container with id 49af0e68933f8de23456d10eb87c74a35516ee871711a30175f005fd552bc0c1
Sep 17 17:45:10.505685 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:10.505659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"]
Sep 17 17:45:10.506724 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:10.506698    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0366360a_db43_48ea_b224_3e304857d29c.slice/crio-b7192a6c30d0b4038c92e0c0aae663e9e5bb415c25040ba30e36282e9d9df828 WatchSource:0}: Error finding container b7192a6c30d0b4038c92e0c0aae663e9e5bb415c25040ba30e36282e9d9df828: Status 404 returned error can't find the container with id b7192a6c30d0b4038c92e0c0aae663e9e5bb415c25040ba30e36282e9d9df828
Sep 17 17:45:11.213426 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.213395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:11.315558 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.315505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:11.356595 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.356559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d" event={"ID":"0366360a-db43-48ea-b224-3e304857d29c","Type":"ContainerStarted","Data":"154c45d358cb6af3234ec14de130b8ea6307af075e1b7cfa3560cff9e856008c"}
Sep 17 17:45:11.356947 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.356926    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:11.357122 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.357103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d" event={"ID":"0366360a-db43-48ea-b224-3e304857d29c","Type":"ContainerStarted","Data":"b7192a6c30d0b4038c92e0c0aae663e9e5bb415c25040ba30e36282e9d9df828"}
Sep 17 17:45:11.358442 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.358419    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm" event={"ID":"03fa496f-e4f2-455a-87a1-961f945d7c65","Type":"ContainerStarted","Data":"6c4cb0725de9abd2d85cc4aa76a4419537a0ffb90db66a4baa8f86dea22a596b"}
Sep 17 17:45:11.358556 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.358467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm" event={"ID":"03fa496f-e4f2-455a-87a1-961f945d7c65","Type":"ContainerStarted","Data":"49af0e68933f8de23456d10eb87c74a35516ee871711a30175f005fd552bc0c1"}
Sep 17 17:45:11.358556 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.358505    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:11.381188 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.381143    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d" podStartSLOduration=2.381126036 podStartE2EDuration="2.381126036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:11.379764479 +0000 UTC m=+819.157602116" watchObservedRunningTime="2026-09-17 17:45:11.381126036 +0000 UTC m=+819.158963672"
Sep 17 17:45:11.417573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.417528    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm" podStartSLOduration=2.417503421 podStartE2EDuration="2.417503421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:11.415787728 +0000 UTC m=+819.193625362" watchObservedRunningTime="2026-09-17 17:45:11.417503421 +0000 UTC m=+819.195341057"
Sep 17 17:45:11.439087 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.439062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:11.847841 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:11.847806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:12.064449 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:12.064418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:12.635704 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:12.635663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:13.837595 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:13.837556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:14.209844 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:14.209764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:14.319800 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:14.319769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:15.504947 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:15.504920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:16.897686 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:16.897658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:18.056488 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:18.056458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:18.372847 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:18.372769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:18.495281 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:18.495249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:18.686502 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:18.686413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:19.003765 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:19.003741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:19.238492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:19.238457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:19.344287 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:19.344191    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:45:19.472399 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:19.472371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:19.618821 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:19.618721    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:19.722864 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:19.722828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:20.174120 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:20.174078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:20.342572 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:20.342499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:20.349056 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:20.349032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:45:20.349202 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:20.349099    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:45:20.447968 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:20.447883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:21.078782 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:21.078750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:21.218427 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:21.218395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:21.375069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:21.374989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:21.559573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:21.559543    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:21.933131 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:21.933085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:22.031954 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:22.031907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:22.366177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:22.366149    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:45:22.750355 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:22.750319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:23.372378 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:23.372347    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:45:23.490934 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:23.490892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:23.780020 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:23.779989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:23.872292 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:23.872262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:24.011045 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:24.011008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:24.119036 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:24.118955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:24.302456 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:24.302426    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:24.534749 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:24.534707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:24.668768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:24.668732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:24.808814 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:24.808730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:27.115160 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:27.115122    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:28.368632 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:28.368599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:28.469396 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:28.469361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:29.105274 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.105236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:29.199465 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.199435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:29.234656 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.234623    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"]
Sep 17 17:45:29.237255 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.237227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.240371 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.240353    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-af14f8\""
Sep 17 17:45:29.240614 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.240599    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-af14f8-dockercfg-6tb6q\""
Sep 17 17:45:29.252357 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.252338    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"]
Sep 17 17:45:29.366289 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.366211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tpbd\" (UniqueName: \"kubernetes.io/projected/ac8c97a9-ba87-4e0b-a254-26eabe766367-kube-api-access-9tpbd\") pod \"payload-processing-e2e-autores-af14f8-787575b4c7-njh49\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") " pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.366289 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.366268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c97a9-ba87-4e0b-a254-26eabe766367-plugins-config-volume\") pod \"payload-processing-e2e-autores-af14f8-787575b4c7-njh49\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") " pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.467722 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.467691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c97a9-ba87-4e0b-a254-26eabe766367-plugins-config-volume\") pod \"payload-processing-e2e-autores-af14f8-787575b4c7-njh49\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") " pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.468105 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.467940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tpbd\" (UniqueName: \"kubernetes.io/projected/ac8c97a9-ba87-4e0b-a254-26eabe766367-kube-api-access-9tpbd\") pod \"payload-processing-e2e-autores-af14f8-787575b4c7-njh49\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") " pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.468439 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.468421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c97a9-ba87-4e0b-a254-26eabe766367-plugins-config-volume\") pod \"payload-processing-e2e-autores-af14f8-787575b4c7-njh49\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") " pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.480103 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.480080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tpbd\" (UniqueName: \"kubernetes.io/projected/ac8c97a9-ba87-4e0b-a254-26eabe766367-kube-api-access-9tpbd\") pod \"payload-processing-e2e-autores-af14f8-787575b4c7-njh49\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") " pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.530917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.530892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:29.547923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.547894    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:29.630888 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.630803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:29.821537 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.821481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:29.841410 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.841388    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"]
Sep 17 17:45:29.843491 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:29.843461    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8c97a9_ba87_4e0b_a254_26eabe766367.slice/crio-f35fa5a9dfa4c231084811004320dee9219742017a6c8984fe0607d2d247d910 WatchSource:0}: Error finding container f35fa5a9dfa4c231084811004320dee9219742017a6c8984fe0607d2d247d910: Status 404 returned error can't find the container with id f35fa5a9dfa4c231084811004320dee9219742017a6c8984fe0607d2d247d910
Sep 17 17:45:29.933875 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:29.933848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:30.043064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:30.043035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:30.476532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:30.476486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49" event={"ID":"ac8c97a9-ba87-4e0b-a254-26eabe766367","Type":"ContainerStarted","Data":"11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c"}
Sep 17 17:45:30.476950 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:30.476567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49" event={"ID":"ac8c97a9-ba87-4e0b-a254-26eabe766367","Type":"ContainerStarted","Data":"f35fa5a9dfa4c231084811004320dee9219742017a6c8984fe0607d2d247d910"}
Sep 17 17:45:30.476950 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:30.476598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:30.496915 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:30.496871    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49" podStartSLOduration=1.496856466 podStartE2EDuration="1.496856466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:30.494681835 +0000 UTC m=+838.272519470" watchObservedRunningTime="2026-09-17 17:45:30.496856466 +0000 UTC m=+838.274694100"
Sep 17 17:45:30.665787 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:30.665759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:30.761467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:30.761435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:31.355148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.355115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:31.477761 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.477723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:31.587735 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.587708    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"]
Sep 17 17:45:31.590323 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.590305    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.590688 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.590645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:31.593184 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.593168    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-dfb277-dockercfg-hd4bw\""
Sep 17 17:45:31.593184 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.593180    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-dfb277\""
Sep 17 17:45:31.602933 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.602912    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"]
Sep 17 17:45:31.648699 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.648628    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"]
Sep 17 17:45:31.651060 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.651044    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:31.673631 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.673609    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"]
Sep 17 17:45:31.688182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.688153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmt2n\" (UniqueName: \"kubernetes.io/projected/51cd31dd-e03c-4451-ae39-e4101a9814b5-kube-api-access-qmt2n\") pod \"payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.688310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.688190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5r5\" (UniqueName: \"kubernetes.io/projected/1ba95f2e-7c90-4515-8dd4-c520a773a353-kube-api-access-6g5r5\") pod \"payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:31.688310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.688210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd31dd-e03c-4451-ae39-e4101a9814b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.688403 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.688355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba95f2e-7c90-4515-8dd4-c520a773a353-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:31.789575 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.789540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba95f2e-7c90-4515-8dd4-c520a773a353-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:31.789741 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.789587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmt2n\" (UniqueName: \"kubernetes.io/projected/51cd31dd-e03c-4451-ae39-e4101a9814b5-kube-api-access-qmt2n\") pod \"payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.789741 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.789623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5r5\" (UniqueName: \"kubernetes.io/projected/1ba95f2e-7c90-4515-8dd4-c520a773a353-kube-api-access-6g5r5\") pod \"payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:31.789741 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.789647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd31dd-e03c-4451-ae39-e4101a9814b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.790371 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.790351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba95f2e-7c90-4515-8dd4-c520a773a353-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:31.790371 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.790363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd31dd-e03c-4451-ae39-e4101a9814b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.811650 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.811626    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmt2n\" (UniqueName: \"kubernetes.io/projected/51cd31dd-e03c-4451-ae39-e4101a9814b5-kube-api-access-qmt2n\") pod \"payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.814430 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.814404    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5r5\" (UniqueName: \"kubernetes.io/projected/1ba95f2e-7c90-4515-8dd4-c520a773a353-kube-api-access-6g5r5\") pod \"payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") " pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:31.900839 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.900751    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:31.961776 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:31.961640    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:32.134654 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.134624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:32.185923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.185896    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"]
Sep 17 17:45:32.187474 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:32.187450    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cd31dd_e03c_4451_ae39_e4101a9814b5.slice/crio-bde18de2eb8342bd56e539a5276d14a02aa71b5a07380df715efaa2f6cc7ae4c WatchSource:0}: Error finding container bde18de2eb8342bd56e539a5276d14a02aa71b5a07380df715efaa2f6cc7ae4c: Status 404 returned error can't find the container with id bde18de2eb8342bd56e539a5276d14a02aa71b5a07380df715efaa2f6cc7ae4c
Sep 17 17:45:32.248708 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.248684    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"]
Sep 17 17:45:32.250305 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:32.250281    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba95f2e_7c90_4515_8dd4_c520a773a353.slice/crio-28a72a60c64e068b106061f953b02ec76e0481678025f0fbb82eb70c75bc63de WatchSource:0}: Error finding container 28a72a60c64e068b106061f953b02ec76e0481678025f0fbb82eb70c75bc63de: Status 404 returned error can't find the container with id 28a72a60c64e068b106061f953b02ec76e0481678025f0fbb82eb70c75bc63de
Sep 17 17:45:32.490566 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.490462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf" event={"ID":"1ba95f2e-7c90-4515-8dd4-c520a773a353","Type":"ContainerStarted","Data":"81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9"}
Sep 17 17:45:32.490566 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.490548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf" event={"ID":"1ba95f2e-7c90-4515-8dd4-c520a773a353","Type":"ContainerStarted","Data":"28a72a60c64e068b106061f953b02ec76e0481678025f0fbb82eb70c75bc63de"}
Sep 17 17:45:32.491043 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.490582    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:32.492139 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.492105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g" event={"ID":"51cd31dd-e03c-4451-ae39-e4101a9814b5","Type":"ContainerStarted","Data":"d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a"}
Sep 17 17:45:32.492257 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.492156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:32.492257 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.492173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g" event={"ID":"51cd31dd-e03c-4451-ae39-e4101a9814b5","Type":"ContainerStarted","Data":"bde18de2eb8342bd56e539a5276d14a02aa71b5a07380df715efaa2f6cc7ae4c"}
Sep 17 17:45:32.512992 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.512943    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf" podStartSLOduration=1.5129305990000002 podStartE2EDuration="1.512930599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:32.510411075 +0000 UTC m=+840.288248701" watchObservedRunningTime="2026-09-17 17:45:32.512930599 +0000 UTC m=+840.290768224"
Sep 17 17:45:32.527757 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:32.527712    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g" podStartSLOduration=1.527699203 podStartE2EDuration="1.527699203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:32.526577486 +0000 UTC m=+840.304415122" watchObservedRunningTime="2026-09-17 17:45:32.527699203 +0000 UTC m=+840.305536869"
Sep 17 17:45:33.117328 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:33.117286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:34.118381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.118346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:34.491617 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.491542    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"]
Sep 17 17:45:34.494742 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.494721    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"
Sep 17 17:45:34.497365 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.497337    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:45:34.497482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.497445    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:45:34.505260 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.505224    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"]
Sep 17 17:45:34.617744 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.617709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0a744e9-d29f-465f-ae0c-ebd1b34dc541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l\" (UID: \"d0a744e9-d29f-465f-ae0c-ebd1b34dc541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"
Sep 17 17:45:34.718988 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.718955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0a744e9-d29f-465f-ae0c-ebd1b34dc541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l\" (UID: \"d0a744e9-d29f-465f-ae0c-ebd1b34dc541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"
Sep 17 17:45:34.719608 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.719587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0a744e9-d29f-465f-ae0c-ebd1b34dc541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l\" (UID: \"d0a744e9-d29f-465f-ae0c-ebd1b34dc541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"
Sep 17 17:45:34.807223 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:34.807184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"
Sep 17 17:45:35.086980 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:35.086954    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"]
Sep 17 17:45:35.088267 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:35.088241    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a744e9_d29f_465f_ae0c_ebd1b34dc541.slice/crio-bbc416d8036627fdb065802864101db90d10208ac0e3c767b6364251f641f705 WatchSource:0}: Error finding container bbc416d8036627fdb065802864101db90d10208ac0e3c767b6364251f641f705: Status 404 returned error can't find the container with id bbc416d8036627fdb065802864101db90d10208ac0e3c767b6364251f641f705
Sep 17 17:45:35.188796 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:35.188773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:35.513617 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:35.513585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l" event={"ID":"d0a744e9-d29f-465f-ae0c-ebd1b34dc541","Type":"ContainerStarted","Data":"bbc416d8036627fdb065802864101db90d10208ac0e3c767b6364251f641f705"}
Sep 17 17:45:35.997426 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:35.997396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:36.792320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:36.792289    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:36.886408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:36.886373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:36.997494 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:36.997462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:37.123674 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:37.123578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:37.226811 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:37.226761    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:38.086868 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:38.086779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:38.534849 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:38.534813    2559 generic.go:356] "Generic (PLEG): container finished" podID="d0a744e9-d29f-465f-ae0c-ebd1b34dc541" containerID="3744bb2db3f02d98e9c941f5b81d453b0f8cacf406731b4318b1da307769c2cf" exitCode=0
Sep 17 17:45:38.535026 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:38.534859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l" event={"ID":"d0a744e9-d29f-465f-ae0c-ebd1b34dc541","Type":"ContainerDied","Data":"3744bb2db3f02d98e9c941f5b81d453b0f8cacf406731b4318b1da307769c2cf"}
Sep 17 17:45:39.013037 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:39.013007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:39.673023 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:39.673001    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"
Sep 17 17:45:39.770401 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:39.770366    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0a744e9-d29f-465f-ae0c-ebd1b34dc541-maas-api-service-ca\") pod \"d0a744e9-d29f-465f-ae0c-ebd1b34dc541\" (UID: \"d0a744e9-d29f-465f-ae0c-ebd1b34dc541\") "
Sep 17 17:45:39.770753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:39.770729    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a744e9-d29f-465f-ae0c-ebd1b34dc541-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d0a744e9-d29f-465f-ae0c-ebd1b34dc541" (UID: "d0a744e9-d29f-465f-ae0c-ebd1b34dc541"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:45:39.872222 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:39.872138    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0a744e9-d29f-465f-ae0c-ebd1b34dc541-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:45:40.005435 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:40.005399    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:40.547532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:40.547502    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"
Sep 17 17:45:40.547710 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:40.547558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l" event={"ID":"d0a744e9-d29f-465f-ae0c-ebd1b34dc541","Type":"ContainerDied","Data":"bbc416d8036627fdb065802864101db90d10208ac0e3c767b6364251f641f705"}
Sep 17 17:45:40.547710 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:40.547606    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbc416d8036627fdb065802864101db90d10208ac0e3c767b6364251f641f705"
Sep 17 17:45:40.769312 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:40.769282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:41.484650 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:41.484617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:45:41.598958 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:41.598930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:43.501224 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:43.501196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:45:43.501643 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:43.501274    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:45:43.545154 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:43.545121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:43.649156 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:43.649122    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:45.212467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:45.212437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:45.299150 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:45.299119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:45.407904 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:45.407873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:45.516292 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:45.516261    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"]
Sep 17 17:45:45.518631 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:45.518610    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f7d735f2-xl65l"]
Sep 17 17:45:45.548463 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:45.548436    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:45.676959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:45.676908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:46.027874 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:46.027845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:46.227976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:46.227930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:46.366176 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:46.366094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:46.399687 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:46.399652    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a744e9-d29f-465f-ae0c-ebd1b34dc541" path="/var/lib/kubelet/pods/d0a744e9-d29f-465f-ae0c-ebd1b34dc541/volumes"
Sep 17 17:45:46.457675 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:46.457648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:46.950226 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:46.950187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:47.436035 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:47.435997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:48.222410 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:48.222379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:48.584835 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:48.584793    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:49.276552 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:49.276506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:49.826728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:49.826703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:49.981029 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:49.981000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:50.769979 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:50.769950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:51.859536 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:51.859494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:51.988207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:51.988180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:52.790302 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:52.790268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:52.893166 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:52.893133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:53.022238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:53.022204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:53.362377 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:53.362344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:53.837205 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:53.837176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:54.027207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:54.027170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:54.600738 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:54.600708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:55.836390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:55.836359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:56.766445 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:56.766403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:57.920153 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:57.920100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:58.164117 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.164080    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"]
Sep 17 17:45:58.164629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.164609    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a744e9-d29f-465f-ae0c-ebd1b34dc541" containerName="revoke-keys"
Sep 17 17:45:58.164629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.164631    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a744e9-d29f-465f-ae0c-ebd1b34dc541" containerName="revoke-keys"
Sep 17 17:45:58.164787 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.164742    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a744e9-d29f-465f-ae0c-ebd1b34dc541" containerName="revoke-keys"
Sep 17 17:45:58.168042 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.168021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.171389 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.171334    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"default-dockercfg-rhrfd\""
Sep 17 17:45:58.171571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.171553    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"openshift-service-ca.crt\""
Sep 17 17:45:58.172558 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.172541    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"simulator-w0-db7813-kserve-self-signed-certs\""
Sep 17 17:45:58.172558 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.172549    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-db7813\"/\"kube-root-ca.crt\""
Sep 17 17:45:58.180484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.180463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"]
Sep 17 17:45:58.247134 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.247105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1003b54-0b60-4884-a142-e5ddb6e456ac-tls-certs\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.247313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.247144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvw8\" (UniqueName: \"kubernetes.io/projected/f1003b54-0b60-4884-a142-e5ddb6e456ac-kube-api-access-xzvw8\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.247313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.247183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-model-cache\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.247313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.247216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-home\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.247313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.247230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-dshm\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.247463 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.247350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-tmp-dir\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.267218 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.267188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:58.348594 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.348551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzvw8\" (UniqueName: \"kubernetes.io/projected/f1003b54-0b60-4884-a142-e5ddb6e456ac-kube-api-access-xzvw8\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.348812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.348611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-model-cache\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.348812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.348656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-home\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.348812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.348676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-dshm\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.348812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.348718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-tmp-dir\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.348989 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.348831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1003b54-0b60-4884-a142-e5ddb6e456ac-tls-certs\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.349149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.349112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-home\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.349225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.349121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-tmp-dir\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.349225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.349169    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-model-cache\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.350993 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.350974    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-dshm\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.351474 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.351451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1003b54-0b60-4884-a142-e5ddb6e456ac-tls-certs\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.360215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.360191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzvw8\" (UniqueName: \"kubernetes.io/projected/f1003b54-0b60-4884-a142-e5ddb6e456ac-kube-api-access-xzvw8\") pod \"simulator-w0-db7813-kserve-6d6576b854-dzqp2\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") " pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.478257 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.478164    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:45:58.768206 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.768176    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"]
Sep 17 17:45:58.770062 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:45:58.770027    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1003b54_0b60_4884_a142_e5ddb6e456ac.slice/crio-6fe42ce41443ca36ca4057be102197495247e62c56bb8a9203a3ade8cd85d407 WatchSource:0}: Error finding container 6fe42ce41443ca36ca4057be102197495247e62c56bb8a9203a3ade8cd85d407: Status 404 returned error can't find the container with id 6fe42ce41443ca36ca4057be102197495247e62c56bb8a9203a3ade8cd85d407
Sep 17 17:45:58.957863 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:58.957832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:45:59.663554 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:59.663505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2" event={"ID":"f1003b54-0b60-4884-a142-e5ddb6e456ac","Type":"ContainerStarted","Data":"bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2"}
Sep 17 17:45:59.663732 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:59.663566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2" event={"ID":"f1003b54-0b60-4884-a142-e5ddb6e456ac","Type":"ContainerStarted","Data":"6fe42ce41443ca36ca4057be102197495247e62c56bb8a9203a3ade8cd85d407"}
Sep 17 17:45:59.684682 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:59.684627    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2" podStartSLOduration=1.684609733 podStartE2EDuration="1.684609733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:59.684135715 +0000 UTC m=+867.461973351" watchObservedRunningTime="2026-09-17 17:45:59.684609733 +0000 UTC m=+867.462447370"
Sep 17 17:45:59.785105 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:45:59.785070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:00.934831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:00.934797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:01.410471 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:01.410441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:01.517149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:01.517121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:01.640167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:01.640133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:02.868850 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:02.868823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:04.266678 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.266644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:04.570950 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.570862    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"]
Sep 17 17:46:04.574806 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.574782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"
Sep 17 17:46:04.578809 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.578787    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:46:04.579069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.579042    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:46:04.590066 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.590031    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"]
Sep 17 17:46:04.606168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.606141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dabebf5-9ca8-453c-8f71-d6a781aa1327-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw\" (UID: \"0dabebf5-9ca8-453c-8f71-d6a781aa1327\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"
Sep 17 17:46:04.707506 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.707473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dabebf5-9ca8-453c-8f71-d6a781aa1327-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw\" (UID: \"0dabebf5-9ca8-453c-8f71-d6a781aa1327\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"
Sep 17 17:46:04.708100 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.708080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dabebf5-9ca8-453c-8f71-d6a781aa1327-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw\" (UID: \"0dabebf5-9ca8-453c-8f71-d6a781aa1327\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"
Sep 17 17:46:04.887845 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:04.887749    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"
Sep 17 17:46:05.163251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:05.163222    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"]
Sep 17 17:46:05.165202 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:46:05.165182    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dabebf5_9ca8_453c_8f71_d6a781aa1327.slice/crio-0426f45e94d454cbdcd853a87e62c74e35c09aae225a1c1ea89259fbd6f12ba4 WatchSource:0}: Error finding container 0426f45e94d454cbdcd853a87e62c74e35c09aae225a1c1ea89259fbd6f12ba4: Status 404 returned error can't find the container with id 0426f45e94d454cbdcd853a87e62c74e35c09aae225a1c1ea89259fbd6f12ba4
Sep 17 17:46:05.444908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:05.444822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:05.702187 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:05.702098    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw" event={"ID":"0dabebf5-9ca8-453c-8f71-d6a781aa1327","Type":"ContainerStarted","Data":"b6d90ab13e5ce79e657a5bcd2599c89b0e4e34c064a55fc83b5f0a360819a52c"}
Sep 17 17:46:05.702187 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:05.702156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw" event={"ID":"0dabebf5-9ca8-453c-8f71-d6a781aa1327","Type":"ContainerStarted","Data":"0426f45e94d454cbdcd853a87e62c74e35c09aae225a1c1ea89259fbd6f12ba4"}
Sep 17 17:46:05.740302 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:05.740253    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw" podStartSLOduration=1.740236593 podStartE2EDuration="1.740236593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:46:05.738784848 +0000 UTC m=+873.516622484" watchObservedRunningTime="2026-09-17 17:46:05.740236593 +0000 UTC m=+873.518074252"
Sep 17 17:46:06.347171 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:06.347118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:06.709184 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:06.709091    2559 generic.go:356] "Generic (PLEG): container finished" podID="0dabebf5-9ca8-453c-8f71-d6a781aa1327" containerID="b6d90ab13e5ce79e657a5bcd2599c89b0e4e34c064a55fc83b5f0a360819a52c" exitCode=0
Sep 17 17:46:06.709184 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:06.709142    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw" event={"ID":"0dabebf5-9ca8-453c-8f71-d6a781aa1327","Type":"ContainerDied","Data":"b6d90ab13e5ce79e657a5bcd2599c89b0e4e34c064a55fc83b5f0a360819a52c"}
Sep 17 17:46:07.292136 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:07.292104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:07.852168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:07.852141    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"
Sep 17 17:46:07.938557 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:07.938513    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dabebf5-9ca8-453c-8f71-d6a781aa1327-maas-api-service-ca\") pod \"0dabebf5-9ca8-453c-8f71-d6a781aa1327\" (UID: \"0dabebf5-9ca8-453c-8f71-d6a781aa1327\") "
Sep 17 17:46:07.938939 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:07.938913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dabebf5-9ca8-453c-8f71-d6a781aa1327-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0dabebf5-9ca8-453c-8f71-d6a781aa1327" (UID: "0dabebf5-9ca8-453c-8f71-d6a781aa1327"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:46:08.040149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.040119    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dabebf5-9ca8-453c-8f71-d6a781aa1327-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:46:08.180780 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.180726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:08.479932 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.479602    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:46:08.480651 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.480628    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:46:08.497322 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.497298    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:46:08.721733 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.721636    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"
Sep 17 17:46:08.721733 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.721674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw" event={"ID":"0dabebf5-9ca8-453c-8f71-d6a781aa1327","Type":"ContainerDied","Data":"0426f45e94d454cbdcd853a87e62c74e35c09aae225a1c1ea89259fbd6f12ba4"}
Sep 17 17:46:08.721733 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.721729    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0426f45e94d454cbdcd853a87e62c74e35c09aae225a1c1ea89259fbd6f12ba4"
Sep 17 17:46:08.733640 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:08.733615    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:46:09.304137 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:09.304099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:10.250277 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:10.250249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:11.175763 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:11.175730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:14.526533 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:14.526486    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:15.316740 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:15.316708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:15.412315 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:15.412288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:15.512818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:15.512792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:15.552468 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:15.552437    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"]
Sep 17 17:46:15.555245 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:15.555223    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-49bc2f4e-t6bpw"]
Sep 17 17:46:15.594366 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:15.594307    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:15.718060 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:15.718028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:16.143810 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:16.143734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:16.243639 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:16.243605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:16.400389 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:16.400298    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dabebf5-9ca8-453c-8f71-d6a781aa1327" path="/var/lib/kubelet/pods/0dabebf5-9ca8-453c-8f71-d6a781aa1327/volumes"
Sep 17 17:46:16.555119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:16.555084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:16.643981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:16.643949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:16.967678 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:16.967613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:18.111221 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:18.111190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:19.201818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:19.201786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:19.781830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:19.781796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:19.873122 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:19.873090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:20.100360 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:20.100263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:21.184288 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:21.184257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:22.351214 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:22.351185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:22.450501 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:22.450464    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:22.773152 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:22.773116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:22.958887 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:22.958855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:23.059255 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:23.059164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:23.691287 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:23.691257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:24.685734 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:24.685703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:25.777259 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:25.777221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:26.640851 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:26.640819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:34.366821 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:34.366790    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:46:34.371495 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:34.371472    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:46:44.750424 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:44.750390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.495808 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.495777    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"]
Sep 17 17:46:45.496201 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.496189    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dabebf5-9ca8-453c-8f71-d6a781aa1327" containerName="revoke-keys"
Sep 17 17:46:45.496244 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.496203    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dabebf5-9ca8-453c-8f71-d6a781aa1327" containerName="revoke-keys"
Sep 17 17:46:45.496278 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.496266    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dabebf5-9ca8-453c-8f71-d6a781aa1327" containerName="revoke-keys"
Sep 17 17:46:45.499215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.499199    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"
Sep 17 17:46:45.502639 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.502618    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:46:45.504127 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.504111    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:46:45.511240 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.511217    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"]
Sep 17 17:46:45.593766 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.593734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4967ba4-9a07-49e9-a363-60bce8b34ebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4\" (UID: \"e4967ba4-9a07-49e9-a363-60bce8b34ebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"
Sep 17 17:46:45.694727 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.694698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4967ba4-9a07-49e9-a363-60bce8b34ebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4\" (UID: \"e4967ba4-9a07-49e9-a363-60bce8b34ebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"
Sep 17 17:46:45.695291 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.695273    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4967ba4-9a07-49e9-a363-60bce8b34ebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4\" (UID: \"e4967ba4-9a07-49e9-a363-60bce8b34ebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"
Sep 17 17:46:45.782945 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.782912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.811798 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:45.811761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"
Sep 17 17:46:46.086489 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:46.086463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"]
Sep 17 17:46:46.088661 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:46:46.088627    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4967ba4_9a07_49e9_a363_60bce8b34ebb.slice/crio-d1c064535120ba9b4e857b1dbf16a0b155c6f6d3dd22940f23418a23da6ee8d1 WatchSource:0}: Error finding container d1c064535120ba9b4e857b1dbf16a0b155c6f6d3dd22940f23418a23da6ee8d1: Status 404 returned error can't find the container with id d1c064535120ba9b4e857b1dbf16a0b155c6f6d3dd22940f23418a23da6ee8d1
Sep 17 17:46:46.671619 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:46.671590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:46.948039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:46.947961    2559 generic.go:356] "Generic (PLEG): container finished" podID="e4967ba4-9a07-49e9-a363-60bce8b34ebb" containerID="b87b245100fd7ceaa9c48d219ecb5b16c29d3cbeb27f809f669130e0565df9ee" exitCode=0
Sep 17 17:46:46.948380 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:46.948080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4" event={"ID":"e4967ba4-9a07-49e9-a363-60bce8b34ebb","Type":"ContainerDied","Data":"b87b245100fd7ceaa9c48d219ecb5b16c29d3cbeb27f809f669130e0565df9ee"}
Sep 17 17:46:46.948380 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:46.948131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4" event={"ID":"e4967ba4-9a07-49e9-a363-60bce8b34ebb","Type":"ContainerStarted","Data":"d1c064535120ba9b4e857b1dbf16a0b155c6f6d3dd22940f23418a23da6ee8d1"}
Sep 17 17:46:47.724152 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:47.724121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:48.095579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.095554    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"
Sep 17 17:46:48.118743 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.118699    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4967ba4-9a07-49e9-a363-60bce8b34ebb-maas-api-service-ca\") pod \"e4967ba4-9a07-49e9-a363-60bce8b34ebb\" (UID: \"e4967ba4-9a07-49e9-a363-60bce8b34ebb\") "
Sep 17 17:46:48.119041 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.119018    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4967ba4-9a07-49e9-a363-60bce8b34ebb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4967ba4-9a07-49e9-a363-60bce8b34ebb" (UID: "e4967ba4-9a07-49e9-a363-60bce8b34ebb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:46:48.220319 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.220294    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4967ba4-9a07-49e9-a363-60bce8b34ebb-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:46:48.633848 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.633818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:48.961532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.961505    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"
Sep 17 17:46:48.961702 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.961500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4" event={"ID":"e4967ba4-9a07-49e9-a363-60bce8b34ebb","Type":"ContainerDied","Data":"d1c064535120ba9b4e857b1dbf16a0b155c6f6d3dd22940f23418a23da6ee8d1"}
Sep 17 17:46:48.961702 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:48.961659    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1c064535120ba9b4e857b1dbf16a0b155c6f6d3dd22940f23418a23da6ee8d1"
Sep 17 17:46:49.402977 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:49.402945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:49.674846 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:49.674771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:50.430572 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:50.430539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:51.267878 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:51.267847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:52.244151 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:52.244115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:53.266503 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:53.266467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:54.049293 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.049256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:54.144254 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.144219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:54.209759 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.209727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:54.315692 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.315602    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"]
Sep 17 17:46:54.315692 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.315650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:54.318690 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.318671    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2b0967aa-skmp4"]
Sep 17 17:46:54.401245 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.401211    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4967ba4-9a07-49e9-a363-60bce8b34ebb" path="/var/lib/kubelet/pods/e4967ba4-9a07-49e9-a363-60bce8b34ebb/volumes"
Sep 17 17:46:54.421419 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:54.421391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:55.368228 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:55.368197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:55.516757 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:55.516725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:56.112562 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:56.112530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:56.454090 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:56.454003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:56.594394 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:56.594363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:56.721098 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:56.721016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:57.956459 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:57.956427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:58.977637 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:58.977607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:59.081679 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:59.081644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:59.198084 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:46:59.198051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:00.550645 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:00.550614    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:01.792156 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:01.792129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:01.889401 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:01.889376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:02.084602 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:02.084499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:02.499801 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:02.499770    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:02.601168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:02.601135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:03.283669 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:03.283637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:04.109094 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:04.109052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:05.194532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:05.194488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:06.077216 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:06.077185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:07.001432 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:07.001400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:15.227100 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:15.227072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:19.900636 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:19.900594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:21.752532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.752478    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"]
Sep 17 17:47:21.753120 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.753101    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4967ba4-9a07-49e9-a363-60bce8b34ebb" containerName="revoke-keys"
Sep 17 17:47:21.753120 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.753122    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4967ba4-9a07-49e9-a363-60bce8b34ebb" containerName="revoke-keys"
Sep 17 17:47:21.753304 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.753241    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4967ba4-9a07-49e9-a363-60bce8b34ebb" containerName="revoke-keys"
Sep 17 17:47:21.756297 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.756275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.759964 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.759944    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54966d\"/\"openshift-service-ca.crt\""
Sep 17 17:47:21.761157 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.761132    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54966d\"/\"kube-root-ca.crt\""
Sep 17 17:47:21.761238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.761183    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54966d\"/\"default-dockercfg-c9v5h\""
Sep 17 17:47:21.761238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.761221    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54966d\"/\"test-model-54966d-kserve-self-signed-certs\""
Sep 17 17:47:21.784237 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.784209    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"]
Sep 17 17:47:21.811345 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.811325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:21.840231 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.840206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e704f773-57ed-4453-9f15-1f7e3de08521-tls-certs\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.840336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.840239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-home\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.840336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.840260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvdk4\" (UniqueName: \"kubernetes.io/projected/e704f773-57ed-4453-9f15-1f7e3de08521-kube-api-access-mvdk4\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.840336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.840315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-model-cache\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.840336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.840337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-dshm\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.840582 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.840424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-tmp-dir\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.940994 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.940964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-dshm\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941121 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-tmp-dir\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941121 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e704f773-57ed-4453-9f15-1f7e3de08521-tls-certs\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941121 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-home\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941121 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvdk4\" (UniqueName: \"kubernetes.io/projected/e704f773-57ed-4453-9f15-1f7e3de08521-kube-api-access-mvdk4\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941121 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-model-cache\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941497 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-home\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941477    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-tmp-dir\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.941601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.941548    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-model-cache\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.943280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.943259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-dshm\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.943549 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.943534    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e704f773-57ed-4453-9f15-1f7e3de08521-tls-certs\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:21.952223 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:21.952199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvdk4\" (UniqueName: \"kubernetes.io/projected/e704f773-57ed-4453-9f15-1f7e3de08521-kube-api-access-mvdk4\") pod \"test-model-54966d-kserve-d86576f45-gggbx\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") " pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:22.066559 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:22.066465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:22.347847 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:22.347820    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"]
Sep 17 17:47:22.348850 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:47:22.348815    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode704f773_57ed_4453_9f15_1f7e3de08521.slice/crio-13f9cc254a530b94fc7f4484418129f4028b5e971e4d9e98626b4ea57fa02559 WatchSource:0}: Error finding container 13f9cc254a530b94fc7f4484418129f4028b5e971e4d9e98626b4ea57fa02559: Status 404 returned error can't find the container with id 13f9cc254a530b94fc7f4484418129f4028b5e971e4d9e98626b4ea57fa02559
Sep 17 17:47:23.179707 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:23.179672    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx" event={"ID":"e704f773-57ed-4453-9f15-1f7e3de08521","Type":"ContainerStarted","Data":"b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b"}
Sep 17 17:47:23.180066 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:23.179718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx" event={"ID":"e704f773-57ed-4453-9f15-1f7e3de08521","Type":"ContainerStarted","Data":"13f9cc254a530b94fc7f4484418129f4028b5e971e4d9e98626b4ea57fa02559"}
Sep 17 17:47:23.204654 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:23.204602    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx" podStartSLOduration=2.20458353 podStartE2EDuration="2.20458353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:23.202601424 +0000 UTC m=+950.980439059" watchObservedRunningTime="2026-09-17 17:47:23.20458353 +0000 UTC m=+950.982421167"
Sep 17 17:47:24.639441 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:24.639403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:25.620626 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:25.620580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:26.401648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:26.401614    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:27.287864 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:27.287831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:28.292129 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:28.292095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:28.954545 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:28.954500    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"]
Sep 17 17:47:28.958007 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:28.957987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"
Sep 17 17:47:28.962019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:28.961999    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:47:28.962361 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:28.962341    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:47:28.970139 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:28.970114    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"]
Sep 17 17:47:28.994739 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:28.994693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5\" (UID: \"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"
Sep 17 17:47:29.095693 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:29.095649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5\" (UID: \"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"
Sep 17 17:47:29.096257 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:29.096239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5\" (UID: \"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"
Sep 17 17:47:29.269809 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:29.269781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"
Sep 17 17:47:29.594277 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:47:29.594252    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db13e21_5ce8_44aa_96ef_9e5bc3c59e6f.slice/crio-7ddeff1461d6c28cd9b284021cb73fb059cfa03877e2490f2a7a1ad9422b9bcd WatchSource:0}: Error finding container 7ddeff1461d6c28cd9b284021cb73fb059cfa03877e2490f2a7a1ad9422b9bcd: Status 404 returned error can't find the container with id 7ddeff1461d6c28cd9b284021cb73fb059cfa03877e2490f2a7a1ad9422b9bcd
Sep 17 17:47:29.609700 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:29.609676    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"]
Sep 17 17:47:29.801310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:29.801273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:30.230792 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:30.230760    2559 generic.go:356] "Generic (PLEG): container finished" podID="2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f" containerID="a7bad071fb43aaf98a7a47887d05e4e82796c04f4b36c635b49ea65e4800f9f6" exitCode=0
Sep 17 17:47:30.230951 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:30.230838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5" event={"ID":"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f","Type":"ContainerDied","Data":"a7bad071fb43aaf98a7a47887d05e4e82796c04f4b36c635b49ea65e4800f9f6"}
Sep 17 17:47:30.230951 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:30.230899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5" event={"ID":"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f","Type":"ContainerStarted","Data":"7ddeff1461d6c28cd9b284021cb73fb059cfa03877e2490f2a7a1ad9422b9bcd"}
Sep 17 17:47:30.710904 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:30.710875    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:31.393167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:31.393139    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"
Sep 17 17:47:31.418317 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:31.418291    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f-maas-api-service-ca\") pod \"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f\" (UID: \"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f\") "
Sep 17 17:47:31.418716 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:31.418688    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f" (UID: "2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:47:31.519770 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:31.519734    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:47:31.547864 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:31.547826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:32.066614 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.066577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:32.067002 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.066654    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:32.079281 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.079257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:32.243468 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.243437    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"
Sep 17 17:47:32.243662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.243482    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5" event={"ID":"2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f","Type":"ContainerDied","Data":"7ddeff1461d6c28cd9b284021cb73fb059cfa03877e2490f2a7a1ad9422b9bcd"}
Sep 17 17:47:32.243662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.243550    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ddeff1461d6c28cd9b284021cb73fb059cfa03877e2490f2a7a1ad9422b9bcd"
Sep 17 17:47:32.255751 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.255723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:47:32.497161 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:32.497123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:33.401768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:33.401735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:34.476287 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:34.476244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:35.735236 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:35.735204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:40.685401 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:40.685367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:41.731185 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:41.731149    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"]
Sep 17 17:47:41.733615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:41.733590    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e4e10ed-bhmb5"]
Sep 17 17:47:41.991794 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:41.991710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:42.234938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:42.234907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:42.400381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:42.400348    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f" path="/var/lib/kubelet/pods/2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f/volumes"
Sep 17 17:47:42.564069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:42.564031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:42.666249 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:42.666168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:42.755823 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:42.755795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:43.370438 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:43.370409    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:44.141339 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:44.141301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:44.240805 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:44.240766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:45.285647 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:45.285614    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:46.170590 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:46.170506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:47.037505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:47.037475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:51.054612 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.054573    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"]
Sep 17 17:47:51.055073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.055063    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f" containerName="revoke-keys"
Sep 17 17:47:51.055114 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.055075    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f" containerName="revoke-keys"
Sep 17 17:47:51.055168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.055157    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db13e21-5ce8-44aa-96ef-9e5bc3c59e6f" containerName="revoke-keys"
Sep 17 17:47:51.057950 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.057931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"
Sep 17 17:47:51.064725 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.064644    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:47:51.064725 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.064648    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:47:51.072066 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.072043    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"]
Sep 17 17:47:51.216599 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.216560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa2c05a-6637-4a1c-a193-d8bfce251d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-af14f8-nqnxp\" (UID: \"1aa2c05a-6637-4a1c-a193-d8bfce251d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"
Sep 17 17:47:51.317509 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.317424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa2c05a-6637-4a1c-a193-d8bfce251d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-af14f8-nqnxp\" (UID: \"1aa2c05a-6637-4a1c-a193-d8bfce251d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"
Sep 17 17:47:51.318155 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.318132    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa2c05a-6637-4a1c-a193-d8bfce251d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-af14f8-nqnxp\" (UID: \"1aa2c05a-6637-4a1c-a193-d8bfce251d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"
Sep 17 17:47:51.368044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.368007    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"
Sep 17 17:47:51.437093 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.437066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:51.659727 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:51.659702    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"]
Sep 17 17:47:51.660717 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:47:51.660693    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa2c05a_6637_4a1c_a193_d8bfce251d38.slice/crio-38db6013bfbea045bf796f3c9f4bdb30f4eebf5ce4be1550c4d1cd89136b516f WatchSource:0}: Error finding container 38db6013bfbea045bf796f3c9f4bdb30f4eebf5ce4be1550c4d1cd89136b516f: Status 404 returned error can't find the container with id 38db6013bfbea045bf796f3c9f4bdb30f4eebf5ce4be1550c4d1cd89136b516f
Sep 17 17:47:52.362326 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:52.362288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp" event={"ID":"1aa2c05a-6637-4a1c-a193-d8bfce251d38","Type":"ContainerStarted","Data":"dfab61949229d23a31c085a7d64ec4951c63d144e492f1e27673a733fad62c56"}
Sep 17 17:47:52.362727 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:52.362359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp" event={"ID":"1aa2c05a-6637-4a1c-a193-d8bfce251d38","Type":"ContainerStarted","Data":"38db6013bfbea045bf796f3c9f4bdb30f4eebf5ce4be1550c4d1cd89136b516f"}
Sep 17 17:47:52.400135 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:52.400085    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp" podStartSLOduration=1.400068973 podStartE2EDuration="1.400068973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:52.399027869 +0000 UTC m=+980.176865504" watchObservedRunningTime="2026-09-17 17:47:52.400068973 +0000 UTC m=+980.177906608"
Sep 17 17:47:52.835077 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:52.835020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:53.030249 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:53.030199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:53.129350 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:53.129268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:53.218179 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:53.218147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:53.318776 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:53.318748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:53.369768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:53.369726    2559 generic.go:356] "Generic (PLEG): container finished" podID="1aa2c05a-6637-4a1c-a193-d8bfce251d38" containerID="dfab61949229d23a31c085a7d64ec4951c63d144e492f1e27673a733fad62c56" exitCode=0
Sep 17 17:47:53.370194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:53.369811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp" event={"ID":"1aa2c05a-6637-4a1c-a193-d8bfce251d38","Type":"ContainerDied","Data":"dfab61949229d23a31c085a7d64ec4951c63d144e492f1e27673a733fad62c56"}
Sep 17 17:47:53.732011 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:53.731980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:54.032742 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:54.032712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:54.520856 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:54.520826    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"
Sep 17 17:47:54.649976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:54.649887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa2c05a-6637-4a1c-a193-d8bfce251d38-maas-api-service-ca\") pod \"1aa2c05a-6637-4a1c-a193-d8bfce251d38\" (UID: \"1aa2c05a-6637-4a1c-a193-d8bfce251d38\") "
Sep 17 17:47:54.650313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:54.650290    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa2c05a-6637-4a1c-a193-d8bfce251d38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1aa2c05a-6637-4a1c-a193-d8bfce251d38" (UID: "1aa2c05a-6637-4a1c-a193-d8bfce251d38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:47:54.751039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:54.751002    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa2c05a-6637-4a1c-a193-d8bfce251d38-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:47:55.288279 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:55.288232    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:55.383216 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:55.383191    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"
Sep 17 17:47:55.383391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:55.383211    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp" event={"ID":"1aa2c05a-6637-4a1c-a193-d8bfce251d38","Type":"ContainerDied","Data":"38db6013bfbea045bf796f3c9f4bdb30f4eebf5ce4be1550c4d1cd89136b516f"}
Sep 17 17:47:55.383391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:55.383258    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38db6013bfbea045bf796f3c9f4bdb30f4eebf5ce4be1550c4d1cd89136b516f"
Sep 17 17:47:56.531745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:56.531708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:57.636106 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:57.636071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:47:58.761811 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:47:58.761781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:00.204130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:00.204101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:01.877547 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:01.877482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:01.923039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:01.923006    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"]
Sep 17 17:48:01.923255 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:01.923233    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49" podUID="ac8c97a9-ba87-4e0b-a254-26eabe766367" containerName="payload-processing" containerID="cri-o://11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c" gracePeriod=30
Sep 17 17:48:01.967418 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:01.967388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:02.037253 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.037231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:02.176409 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.176382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:02.185960 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.185940    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:48:02.254080 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.254043    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"]
Sep 17 17:48:02.258389 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.258363    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-af14f8-nqnxp"]
Sep 17 17:48:02.268504 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.268467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:02.326314 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.326277    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c97a9-ba87-4e0b-a254-26eabe766367-plugins-config-volume\") pod \"ac8c97a9-ba87-4e0b-a254-26eabe766367\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") "
Sep 17 17:48:02.326481 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.326394    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tpbd\" (UniqueName: \"kubernetes.io/projected/ac8c97a9-ba87-4e0b-a254-26eabe766367-kube-api-access-9tpbd\") pod \"ac8c97a9-ba87-4e0b-a254-26eabe766367\" (UID: \"ac8c97a9-ba87-4e0b-a254-26eabe766367\") "
Sep 17 17:48:02.326687 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.326662    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac8c97a9-ba87-4e0b-a254-26eabe766367-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac8c97a9-ba87-4e0b-a254-26eabe766367" (UID: "ac8c97a9-ba87-4e0b-a254-26eabe766367"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:48:02.328622 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.328593    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8c97a9-ba87-4e0b-a254-26eabe766367-kube-api-access-9tpbd" (OuterVolumeSpecName: "kube-api-access-9tpbd") pod "ac8c97a9-ba87-4e0b-a254-26eabe766367" (UID: "ac8c97a9-ba87-4e0b-a254-26eabe766367"). InnerVolumeSpecName "kube-api-access-9tpbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:48:02.399929 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.399897    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa2c05a-6637-4a1c-a193-d8bfce251d38" path="/var/lib/kubelet/pods/1aa2c05a-6637-4a1c-a193-d8bfce251d38/volumes"
Sep 17 17:48:02.424633 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.424568    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8c97a9-ba87-4e0b-a254-26eabe766367" containerID="11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c" exitCode=0
Sep 17 17:48:02.424633 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.424615    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"
Sep 17 17:48:02.424633 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.424624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49" event={"ID":"ac8c97a9-ba87-4e0b-a254-26eabe766367","Type":"ContainerDied","Data":"11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c"}
Sep 17 17:48:02.424812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.424674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49" event={"ID":"ac8c97a9-ba87-4e0b-a254-26eabe766367","Type":"ContainerDied","Data":"f35fa5a9dfa4c231084811004320dee9219742017a6c8984fe0607d2d247d910"}
Sep 17 17:48:02.424812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.424703    2559 scope.go:117] "RemoveContainer" containerID="11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c"
Sep 17 17:48:02.427308 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.427284    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tpbd\" (UniqueName: \"kubernetes.io/projected/ac8c97a9-ba87-4e0b-a254-26eabe766367-kube-api-access-9tpbd\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:48:02.427410 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.427314    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c97a9-ba87-4e0b-a254-26eabe766367-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:48:02.434053 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.434027    2559 scope.go:117] "RemoveContainer" containerID="11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c"
Sep 17 17:48:02.434310 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:48:02.434292    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c\": container with ID starting with 11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c not found: ID does not exist" containerID="11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c"
Sep 17 17:48:02.434360 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.434319    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c"} err="failed to get container status \"11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c\": rpc error: code = NotFound desc = could not find container \"11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c\": container with ID starting with 11ed36310155256dd5e1c2a7774916a99eda31b5165bd9a8261b550348088b4c not found: ID does not exist"
Sep 17 17:48:02.453932 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.453903    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"]
Sep 17 17:48:02.462666 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.462642    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-af14f8-787575b4c7-njh49"]
Sep 17 17:48:02.635092 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.635059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:02.769148 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:02.769118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:03.676728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:03.676698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:04.400596 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:04.400558    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac8c97a9-ba87-4e0b-a254-26eabe766367" path="/var/lib/kubelet/pods/ac8c97a9-ba87-4e0b-a254-26eabe766367/volumes"
Sep 17 17:48:04.508887 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:04.508854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:05.532969 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:05.532927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:06.431505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:06.431471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:07.668227 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:07.668190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:14.578462 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:14.578431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:19.643833 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:19.643798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:21.058532 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:21.058493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:21.159621 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:21.159594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:26.128579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:26.128493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:26.196512 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:26.196478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:26.292047 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:26.292020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:26.385167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:26.385087    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:42.259661 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:42.259631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:42.971071 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:42.971036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:43.268245 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:43.268215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:43.837123 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:43.837065    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:44.455214 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:44.455170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:44.555404 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:44.555367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:46.496579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:46.496543    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:47.302568 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:47.302538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:47.473313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:47.473275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:48.121413 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:48.121381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:48.469707 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:48.469630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:48.536280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:48.536253    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:48.962716 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:48.962685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:49.969200 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:49.969173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:50.093077 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:50.093047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:50.342779 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:50.342742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:50.439766 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:50.439739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:51.483477 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:51.483437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:52.757966 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:52.757935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:52.850817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:52.850787    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:53.022038 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:53.021954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:53.452793 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:53.452713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:53.549141 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:53.549113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:59.996619 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:48:59.996575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:00.096747 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:00.096716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:00.821018 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:00.820987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:01.602152 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:01.602116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:06.228651 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:06.228612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:07.802533 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:07.802490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:07.906445 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:07.906413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:08.004020 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:08.003990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:08.103748 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:08.103643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:08.774768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:08.774735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:08.875712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:08.875682    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:08.974037 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:08.974007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:10.488669 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:10.488639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:11.640573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.640542    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"]
Sep 17 17:49:11.640980 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.640967    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8c97a9-ba87-4e0b-a254-26eabe766367" containerName="payload-processing"
Sep 17 17:49:11.640980 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.640982    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8c97a9-ba87-4e0b-a254-26eabe766367" containerName="payload-processing"
Sep 17 17:49:11.641056 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.640997    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa2c05a-6637-4a1c-a193-d8bfce251d38" containerName="revoke-keys"
Sep 17 17:49:11.641056 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.641003    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa2c05a-6637-4a1c-a193-d8bfce251d38" containerName="revoke-keys"
Sep 17 17:49:11.641124 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.641064    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa2c05a-6637-4a1c-a193-d8bfce251d38" containerName="revoke-keys"
Sep 17 17:49:11.641124 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.641073    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8c97a9-ba87-4e0b-a254-26eabe766367" containerName="payload-processing"
Sep 17 17:49:11.643883 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.643868    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.648747 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.648726    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dfb277\"/\"openshift-service-ca.crt\""
Sep 17 17:49:11.648873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.648752    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dfb277\"/\"test-model-dfb277-kserve-self-signed-certs\""
Sep 17 17:49:11.648873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.648781    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dfb277\"/\"kube-root-ca.crt\""
Sep 17 17:49:11.648873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.648734    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dfb277\"/\"default-dockercfg-xgnvr\""
Sep 17 17:49:11.657393 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.657371    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"]
Sep 17 17:49:11.747133 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.747107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:11.776086 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.776062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tls-certs\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.776215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.776094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-model-cache\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.776215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.776113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-home\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.776215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.776128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljxtq\" (UniqueName: \"kubernetes.io/projected/4fa9c41d-6d73-45af-86ae-9f90014d5b35-kube-api-access-ljxtq\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.776320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.776217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-dshm\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.776354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.776317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tmp-dir\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-dshm\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tmp-dir\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tls-certs\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-model-cache\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877320    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-home\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljxtq\" (UniqueName: \"kubernetes.io/projected/4fa9c41d-6d73-45af-86ae-9f90014d5b35-kube-api-access-ljxtq\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877709 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877686    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-home\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877780 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-model-cache\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.877826 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.877788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tmp-dir\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.879397 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.879375    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-dshm\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.879734 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.879720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tls-certs\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.886642 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.886616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljxtq\" (UniqueName: \"kubernetes.io/projected/4fa9c41d-6d73-45af-86ae-9f90014d5b35-kube-api-access-ljxtq\") pod \"test-model-dfb277-kserve-8549cd8fc7-g28f2\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") " pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:11.953083 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:11.953026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:12.234180 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:12.234155    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"]
Sep 17 17:49:12.235540 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:49:12.235487    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fa9c41d_6d73_45af_86ae_9f90014d5b35.slice/crio-e9ec441a81940e8831b7794a8493e764130af3604a4f4cd574f7c868813d0e91 WatchSource:0}: Error finding container e9ec441a81940e8831b7794a8493e764130af3604a4f4cd574f7c868813d0e91: Status 404 returned error can't find the container with id e9ec441a81940e8831b7794a8493e764130af3604a4f4cd574f7c868813d0e91
Sep 17 17:49:12.844878 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:12.844840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2" event={"ID":"4fa9c41d-6d73-45af-86ae-9f90014d5b35","Type":"ContainerStarted","Data":"2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061"}
Sep 17 17:49:12.845257 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:12.844892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2" event={"ID":"4fa9c41d-6d73-45af-86ae-9f90014d5b35","Type":"ContainerStarted","Data":"e9ec441a81940e8831b7794a8493e764130af3604a4f4cd574f7c868813d0e91"}
Sep 17 17:49:12.863668 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:12.863605    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2" podStartSLOduration=1.863587829 podStartE2EDuration="1.863587829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:49:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:49:12.862683867 +0000 UTC m=+1060.640521502" watchObservedRunningTime="2026-09-17 17:49:12.863587829 +0000 UTC m=+1060.641425464"
Sep 17 17:49:15.337473 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:15.337419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:16.311485 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:16.311415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:17.210837 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:17.210800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:17.313388 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:17.313360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:17.418222 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:17.418195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:17.547244 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:17.547219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:18.129512 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:18.129481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:18.386573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:18.386470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:19.366662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:19.366624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:20.148995 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:20.148965    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:21.953669 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:21.953639    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:21.954080 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:21.953682    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:21.965916 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:21.965891    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:22.914006 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:22.913975    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:49:24.627350 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:24.627315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:24.754038 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:24.754008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:24.853064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:24.853034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:25.225604 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:25.225573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:25.399083 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:25.399049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:31.640382 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:31.640344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:32.314852 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:32.314818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:32.414063 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:32.414035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:32.815512 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:32.815477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:33.970308 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:33.970275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:35.170267 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:35.170238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:36.235533 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:36.235499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:37.098504 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:37.098473    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:38.127936 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.127910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:38.227905 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.227871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:38.439085 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.438998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:38.669215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.669180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:38.775994 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.775945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:38.854542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.854498    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"]
Sep 17 17:49:38.858324 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.858308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:38.861753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.861735    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8f6c1ea9-dockercfg-jbfpp\""
Sep 17 17:49:38.861842 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.861785    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8f6c1ea9\""
Sep 17 17:49:38.871075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.871052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"]
Sep 17 17:49:38.944935 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.944897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc4nf\" (UniqueName: \"kubernetes.io/projected/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-kube-api-access-rc4nf\") pod \"payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:38.945107 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:38.944945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:39.046666 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:39.046549    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc4nf\" (UniqueName: \"kubernetes.io/projected/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-kube-api-access-rc4nf\") pod \"payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:39.046666 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:39.046616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:39.047325 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:39.047304    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:39.056703 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:39.056682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc4nf\" (UniqueName: \"kubernetes.io/projected/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-kube-api-access-rc4nf\") pod \"payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:39.169439 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:39.169402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:39.447250 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:39.447219    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"]
Sep 17 17:49:39.448618 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:49:39.448592    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5d6539_3130_4c97_8aa9_af6e253ce1d0.slice/crio-6c464e0d4bad35259cfdb90530991f46a22fdb95ae9a0e7278bc373116cd73cf WatchSource:0}: Error finding container 6c464e0d4bad35259cfdb90530991f46a22fdb95ae9a0e7278bc373116cd73cf: Status 404 returned error can't find the container with id 6c464e0d4bad35259cfdb90530991f46a22fdb95ae9a0e7278bc373116cd73cf
Sep 17 17:49:40.012269 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:40.012238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl" event={"ID":"5f5d6539-3130-4c97-8aa9-af6e253ce1d0","Type":"ContainerStarted","Data":"3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f"}
Sep 17 17:49:40.012462 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:40.012289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl" event={"ID":"5f5d6539-3130-4c97-8aa9-af6e253ce1d0","Type":"ContainerStarted","Data":"6c464e0d4bad35259cfdb90530991f46a22fdb95ae9a0e7278bc373116cd73cf"}
Sep 17 17:49:40.012462 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:40.012351    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:49:40.041058 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:40.041000    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl" podStartSLOduration=2.040980172 podStartE2EDuration="2.040980172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:49:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:49:40.039341967 +0000 UTC m=+1087.817179602" watchObservedRunningTime="2026-09-17 17:49:40.040980172 +0000 UTC m=+1087.818817807"
Sep 17 17:49:51.021968 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:49:51.021937    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:50:00.388889 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:00.388839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:01.163104 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:01.163044    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:02.140317 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:02.140283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:02.423545 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:02.423438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:02.851772 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:02.851740    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:03.186460 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.186375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:03.355332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.355304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:03.554116 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.554088    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"]
Sep 17 17:50:03.557820 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.557801    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.562780 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.562755    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-6239ea\"/\"openshift-service-ca.crt\""
Sep 17 17:50:03.563910 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.563892    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-6239ea\"/\"kube-root-ca.crt\""
Sep 17 17:50:03.563981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.563962    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-6239ea\"/\"explicit-model-6239ea-kserve-self-signed-certs\""
Sep 17 17:50:03.564168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.564155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-6239ea\"/\"default-dockercfg-49tw6\""
Sep 17 17:50:03.596099 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.596063    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"]
Sep 17 17:50:03.609164 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.609084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:03.682453 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.682416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-home\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.682453 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.682450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tmp-dir\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.682719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.682491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-model-cache\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.682719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.682513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tls-certs\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.682719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.682591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-dshm\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.682719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.682621    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvgn\" (UniqueName: \"kubernetes.io/projected/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-kube-api-access-ngvgn\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.783470 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.783435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-home\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.783470 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.783472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tmp-dir\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.783745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.783538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-model-cache\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.783745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.783576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tls-certs\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.783745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.783637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-dshm\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.783745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.783687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvgn\" (UniqueName: \"kubernetes.io/projected/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-kube-api-access-ngvgn\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.784041 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.784010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-home\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.784137 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.784035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-model-cache\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.784222 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.784199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tmp-dir\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.785176 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.785153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:03.786210 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.786183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-dshm\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.786358 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.786344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tls-certs\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.806544 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.806459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvgn\" (UniqueName: \"kubernetes.io/projected/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-kube-api-access-ngvgn\") pod \"explicit-model-6239ea-kserve-76fcd65c9c-xfpks\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") " pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:03.868531 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:03.868490    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:04.206908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:04.206882    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"]
Sep 17 17:50:04.207836 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:50:04.207811    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2b4f9ea_44d5_4dde_877a_933e8c85a4c8.slice/crio-78502d0c8579b4aef4f4e5f48370487fc8fffb0ff8482ddcf10df2159ff5eb4e WatchSource:0}: Error finding container 78502d0c8579b4aef4f4e5f48370487fc8fffb0ff8482ddcf10df2159ff5eb4e: Status 404 returned error can't find the container with id 78502d0c8579b4aef4f4e5f48370487fc8fffb0ff8482ddcf10df2159ff5eb4e
Sep 17 17:50:05.169830 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:05.169795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks" event={"ID":"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8","Type":"ContainerStarted","Data":"eb339e774bf5b86aae43f53563c109f8dbd0fc0975c79d1b75273f1021a15a61"}
Sep 17 17:50:05.170017 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:05.169839    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks" event={"ID":"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8","Type":"ContainerStarted","Data":"78502d0c8579b4aef4f4e5f48370487fc8fffb0ff8482ddcf10df2159ff5eb4e"}
Sep 17 17:50:05.214338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:05.214288    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks" podStartSLOduration=2.214272649 podStartE2EDuration="2.214272649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:50:05.211561174 +0000 UTC m=+1112.989398809" watchObservedRunningTime="2026-09-17 17:50:05.214272649 +0000 UTC m=+1112.992110283"
Sep 17 17:50:05.319235 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:05.319207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:06.437819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:06.437789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:07.767916 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:07.767888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:09.160825 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.160788    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"]
Sep 17 17:50:09.189596 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.189571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:09.299569 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.299536    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"]
Sep 17 17:50:09.303272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.303257    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"
Sep 17 17:50:09.307820 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.307797    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:50:09.308161 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.308145    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:50:09.319209 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.319186    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"]
Sep 17 17:50:09.437373 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.437280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd36a90-e503-4090-bbd3-ca235864cfe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm\" (UID: \"3dd36a90-e503-4090-bbd3-ca235864cfe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"
Sep 17 17:50:09.468662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.468632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:09.538881 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.538851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd36a90-e503-4090-bbd3-ca235864cfe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm\" (UID: \"3dd36a90-e503-4090-bbd3-ca235864cfe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"
Sep 17 17:50:09.539485 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.539462    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd36a90-e503-4090-bbd3-ca235864cfe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm\" (UID: \"3dd36a90-e503-4090-bbd3-ca235864cfe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"
Sep 17 17:50:09.614226 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.614200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"
Sep 17 17:50:09.899309 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:09.899238    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"]
Sep 17 17:50:10.200339 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:10.200308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm" event={"ID":"3dd36a90-e503-4090-bbd3-ca235864cfe9","Type":"ContainerStarted","Data":"1ffd6350fd338043d53ea260eb710817b4ad9f4b5361c64ad15b823fa85eafe5"}
Sep 17 17:50:10.200701 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:10.200363    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm" event={"ID":"3dd36a90-e503-4090-bbd3-ca235864cfe9","Type":"ContainerStarted","Data":"6cd00487b06fb1fcc0b7d1306eb92606376270fb9f5703972a9dd7e3ae2a7647"}
Sep 17 17:50:10.657500 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:10.657472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:11.208378 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:11.208344    2559 generic.go:356] "Generic (PLEG): container finished" podID="3dd36a90-e503-4090-bbd3-ca235864cfe9" containerID="1ffd6350fd338043d53ea260eb710817b4ad9f4b5361c64ad15b823fa85eafe5" exitCode=0
Sep 17 17:50:11.208757 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:11.208410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm" event={"ID":"3dd36a90-e503-4090-bbd3-ca235864cfe9","Type":"ContainerDied","Data":"1ffd6350fd338043d53ea260eb710817b4ad9f4b5361c64ad15b823fa85eafe5"}
Sep 17 17:50:11.930625 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:11.930579    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:12.050884 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.050854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:12.155369 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.155340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:12.356897 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.356865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"
Sep 17 17:50:12.415348 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.415316    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"]
Sep 17 17:50:12.415783 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.415769    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd36a90-e503-4090-bbd3-ca235864cfe9" containerName="revoke-keys"
Sep 17 17:50:12.415783 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.415784    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd36a90-e503-4090-bbd3-ca235864cfe9" containerName="revoke-keys"
Sep 17 17:50:12.415885 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.415855    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd36a90-e503-4090-bbd3-ca235864cfe9" containerName="revoke-keys"
Sep 17 17:50:12.418960 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.418943    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"
Sep 17 17:50:12.431792 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.431769    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"]
Sep 17 17:50:12.469453 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.469392    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd36a90-e503-4090-bbd3-ca235864cfe9-maas-api-service-ca\") pod \"3dd36a90-e503-4090-bbd3-ca235864cfe9\" (UID: \"3dd36a90-e503-4090-bbd3-ca235864cfe9\") "
Sep 17 17:50:12.469848 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.469823    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dd36a90-e503-4090-bbd3-ca235864cfe9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3dd36a90-e503-4090-bbd3-ca235864cfe9" (UID: "3dd36a90-e503-4090-bbd3-ca235864cfe9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:50:12.570864 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.570837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a78331-82d5-4bf9-9db8-d7bb2bf233ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq\" (UID: \"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"
Sep 17 17:50:12.570983 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.570947    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd36a90-e503-4090-bbd3-ca235864cfe9-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:12.671608 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.671579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a78331-82d5-4bf9-9db8-d7bb2bf233ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq\" (UID: \"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"
Sep 17 17:50:12.672149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.672132    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a78331-82d5-4bf9-9db8-d7bb2bf233ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq\" (UID: \"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"
Sep 17 17:50:12.730753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:12.730698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"
Sep 17 17:50:13.015667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:13.015642    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"]
Sep 17 17:50:13.017407 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:50:13.017382    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a78331_82d5_4bf9_9db8_d7bb2bf233ed.slice/crio-4a62cbfc76717e70f898791ec988c1e27b0145a64ffc14026b721622aef4f3f5 WatchSource:0}: Error finding container 4a62cbfc76717e70f898791ec988c1e27b0145a64ffc14026b721622aef4f3f5: Status 404 returned error can't find the container with id 4a62cbfc76717e70f898791ec988c1e27b0145a64ffc14026b721622aef4f3f5
Sep 17 17:50:13.221498 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:13.221473    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"
Sep 17 17:50:13.221676 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:13.221529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm" event={"ID":"3dd36a90-e503-4090-bbd3-ca235864cfe9","Type":"ContainerDied","Data":"6cd00487b06fb1fcc0b7d1306eb92606376270fb9f5703972a9dd7e3ae2a7647"}
Sep 17 17:50:13.221676 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:13.221578    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cd00487b06fb1fcc0b7d1306eb92606376270fb9f5703972a9dd7e3ae2a7647"
Sep 17 17:50:13.222876 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:13.222849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq" event={"ID":"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed","Type":"ContainerStarted","Data":"4a62cbfc76717e70f898791ec988c1e27b0145a64ffc14026b721622aef4f3f5"}
Sep 17 17:50:13.240803 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:13.240784    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:13.868699 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:13.868663    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:14.187686 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:14.187636    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:14.230842 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:14.230813    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2a78331-82d5-4bf9-9db8-d7bb2bf233ed" containerID="be2e4bfd8ff5be187b61d59a17122828e409ba21427e0ee5f52630477e276ed0" exitCode=0
Sep 17 17:50:14.231016 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:14.230896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq" event={"ID":"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed","Type":"ContainerDied","Data":"be2e4bfd8ff5be187b61d59a17122828e409ba21427e0ee5f52630477e276ed0"}
Sep 17 17:50:15.124420 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:15.124392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:15.377463 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:15.377403    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"
Sep 17 17:50:15.396998 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:15.396972    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a78331-82d5-4bf9-9db8-d7bb2bf233ed-maas-api-service-ca\") pod \"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed\" (UID: \"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed\") "
Sep 17 17:50:15.397311 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:15.397282    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a78331-82d5-4bf9-9db8-d7bb2bf233ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a2a78331-82d5-4bf9-9db8-d7bb2bf233ed" (UID: "a2a78331-82d5-4bf9-9db8-d7bb2bf233ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:50:15.498080 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:15.498047    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a78331-82d5-4bf9-9db8-d7bb2bf233ed-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:16.043760 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:16.043732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:16.244293 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:16.244266    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"
Sep 17 17:50:16.244682 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:16.244311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq" event={"ID":"a2a78331-82d5-4bf9-9db8-d7bb2bf233ed","Type":"ContainerDied","Data":"4a62cbfc76717e70f898791ec988c1e27b0145a64ffc14026b721622aef4f3f5"}
Sep 17 17:50:16.244682 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:16.244360    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a62cbfc76717e70f898791ec988c1e27b0145a64ffc14026b721622aef4f3f5"
Sep 17 17:50:16.996966 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:16.996927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:18.591824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:18.591786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:19.639012 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:19.638980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:20.556111 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:20.556075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:21.370808 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:21.370777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:21.527571 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:21.527537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:21.628989 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:21.628906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:21.811380 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:21.811340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:21.895835 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:21.895767    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"]
Sep 17 17:50:21.898354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:21.898332    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6239ea-l2wbm"]
Sep 17 17:50:21.906696 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:21.906675    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:22.248872 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:22.248840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:22.353394 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:22.353364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:22.400015 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:22.399974    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd36a90-e503-4090-bbd3-ca235864cfe9" path="/var/lib/kubelet/pods/3dd36a90-e503-4090-bbd3-ca235864cfe9/volumes"
Sep 17 17:50:23.335650 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:23.335610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:24.180207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.180148    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks" podUID="e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" containerName="main" containerID="cri-o://eb339e774bf5b86aae43f53563c109f8dbd0fc0975c79d1b75273f1021a15a61" gracePeriod=45
Sep 17 17:50:24.299303 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.299279    2559 generic.go:356] "Generic (PLEG): container finished" podID="e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" containerID="eb339e774bf5b86aae43f53563c109f8dbd0fc0975c79d1b75273f1021a15a61" exitCode=0
Sep 17 17:50:24.299402 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.299367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks" event={"ID":"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8","Type":"ContainerDied","Data":"eb339e774bf5b86aae43f53563c109f8dbd0fc0975c79d1b75273f1021a15a61"}
Sep 17 17:50:24.439067 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.439011    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:24.479165 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479133    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-home\") pod \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") "
Sep 17 17:50:24.479305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479199    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-model-cache\") pod \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") "
Sep 17 17:50:24.479305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479253    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-dshm\") pod \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") "
Sep 17 17:50:24.479408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479325    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngvgn\" (UniqueName: \"kubernetes.io/projected/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-kube-api-access-ngvgn\") pod \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") "
Sep 17 17:50:24.479408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479381    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tls-certs\") pod \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") "
Sep 17 17:50:24.479513 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479408    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-home" (OuterVolumeSpecName: "home") pod "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" (UID: "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:24.479513 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479434    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tmp-dir\") pod \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\" (UID: \"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8\") "
Sep 17 17:50:24.479513 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479498    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-model-cache" (OuterVolumeSpecName: "model-cache") pod "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" (UID: "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:24.479713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.479668    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" (UID: "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:24.480141 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.480118    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:24.480285 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.480272    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:24.480382 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.480372    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:24.481900 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.481869    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" (UID: "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:50:24.482012 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.481983    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-dshm" (OuterVolumeSpecName: "dshm") pod "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" (UID: "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:50:24.482081 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.482025    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-kube-api-access-ngvgn" (OuterVolumeSpecName: "kube-api-access-ngvgn") pod "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" (UID: "e2b4f9ea-44d5-4dde-877a-933e8c85a4c8"). InnerVolumeSpecName "kube-api-access-ngvgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:24.581326 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.581287    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:24.581326 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.581321    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngvgn\" (UniqueName: \"kubernetes.io/projected/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-kube-api-access-ngvgn\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:24.581553 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.581335    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:24.798471 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:24.798443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:25.306867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:25.306835    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"
Sep 17 17:50:25.306867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:25.306850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks" event={"ID":"e2b4f9ea-44d5-4dde-877a-933e8c85a4c8","Type":"ContainerDied","Data":"78502d0c8579b4aef4f4e5f48370487fc8fffb0ff8482ddcf10df2159ff5eb4e"}
Sep 17 17:50:25.307415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:25.306900    2559 scope.go:117] "RemoveContainer" containerID="eb339e774bf5b86aae43f53563c109f8dbd0fc0975c79d1b75273f1021a15a61"
Sep 17 17:50:25.362367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:25.362334    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"]
Sep 17 17:50:25.381570 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:25.381509    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-6239ea/explicit-model-6239ea-kserve-76fcd65c9c-xfpks"]
Sep 17 17:50:26.379509 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:26.379474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:26.400232 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:26.400196    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" path="/var/lib/kubelet/pods/e2b4f9ea-44d5-4dde-877a-933e8c85a4c8/volumes"
Sep 17 17:50:27.390070 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:27.390042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:28.318643 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.318600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:28.386052 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.386018    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"]
Sep 17 17:50:28.386299 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.386266    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl" podUID="5f5d6539-3130-4c97-8aa9-af6e253ce1d0" containerName="payload-pre-processing" containerID="cri-o://3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f" gracePeriod=30
Sep 17 17:50:28.421640 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.421594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:28.517634 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.517605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:28.617664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.617591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:28.654746 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.654720    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:50:28.691982 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.691952    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"]
Sep 17 17:50:28.704432 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.704403    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f6c1ea9-ggkwq"]
Sep 17 17:50:28.723272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.723239    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc4nf\" (UniqueName: \"kubernetes.io/projected/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-kube-api-access-rc4nf\") pod \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") "
Sep 17 17:50:28.723447 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.723350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-plugins-config-volume\") pod \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\" (UID: \"5f5d6539-3130-4c97-8aa9-af6e253ce1d0\") "
Sep 17 17:50:28.723790 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.723762    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f5d6539-3130-4c97-8aa9-af6e253ce1d0" (UID: "5f5d6539-3130-4c97-8aa9-af6e253ce1d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:50:28.725444 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.725418    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-kube-api-access-rc4nf" (OuterVolumeSpecName: "kube-api-access-rc4nf") pod "5f5d6539-3130-4c97-8aa9-af6e253ce1d0" (UID: "5f5d6539-3130-4c97-8aa9-af6e253ce1d0"). InnerVolumeSpecName "kube-api-access-rc4nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:50:28.730351 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.730331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:28.825013 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.824981    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc4nf\" (UniqueName: \"kubernetes.io/projected/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-kube-api-access-rc4nf\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:28.825013 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:28.825012    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f5d6539-3130-4c97-8aa9-af6e253ce1d0-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:50:29.045232 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.045201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:29.200564 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.200512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:29.334010 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.333921    2559 generic.go:356] "Generic (PLEG): container finished" podID="5f5d6539-3130-4c97-8aa9-af6e253ce1d0" containerID="3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f" exitCode=0
Sep 17 17:50:29.334010 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.333983    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"
Sep 17 17:50:29.334200 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.334006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl" event={"ID":"5f5d6539-3130-4c97-8aa9-af6e253ce1d0","Type":"ContainerDied","Data":"3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f"}
Sep 17 17:50:29.334200 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.334079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl" event={"ID":"5f5d6539-3130-4c97-8aa9-af6e253ce1d0","Type":"ContainerDied","Data":"6c464e0d4bad35259cfdb90530991f46a22fdb95ae9a0e7278bc373116cd73cf"}
Sep 17 17:50:29.334200 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.334103    2559 scope.go:117] "RemoveContainer" containerID="3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f"
Sep 17 17:50:29.344286 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.344265    2559 scope.go:117] "RemoveContainer" containerID="3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f"
Sep 17 17:50:29.344571 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:50:29.344552    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f\": container with ID starting with 3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f not found: ID does not exist" containerID="3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f"
Sep 17 17:50:29.344617 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.344580    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f"} err="failed to get container status \"3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f\": rpc error: code = NotFound desc = could not find container \"3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f\": container with ID starting with 3fb53fcd42e95a46d3dfd20fc930af313b37a4405f04a62862c1d12ca68e9d4f not found: ID does not exist"
Sep 17 17:50:29.363385 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.363354    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"]
Sep 17 17:50:29.369354 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:29.369329    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f6c1ea9-8c94bc67d-mb4tl"]
Sep 17 17:50:30.400585 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:30.400552    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f5d6539-3130-4c97-8aa9-af6e253ce1d0" path="/var/lib/kubelet/pods/5f5d6539-3130-4c97-8aa9-af6e253ce1d0/volumes"
Sep 17 17:50:30.400956 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:30.400911    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a78331-82d5-4bf9-9db8-d7bb2bf233ed" path="/var/lib/kubelet/pods/a2a78331-82d5-4bf9-9db8-d7bb2bf233ed/volumes"
Sep 17 17:50:30.476779 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:30.476748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:31.466822 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:31.466794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:31.567658 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:31.567629    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:31.894044 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:31.894016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:32.027434 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:32.027407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:32.295648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:32.295620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:32.753971 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:32.753941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:32.956161 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:32.956129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:33.326712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:33.326667    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:34.215620 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:34.215587    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:34.345674 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:34.345640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:34.522572 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:34.522509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:35.812777 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:35.812743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:36.962193 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:36.962160    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:38.035816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:38.035786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:38.867711 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:38.867682    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:38.953753 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:38.953718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:39.156110 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:39.156027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:39.520661 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:39.520630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:39.613715 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:39.613685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:39.748839 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:39.748810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:45.669312 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:45.669272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:45.868796 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:45.868765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:45.965777 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:45.965695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:46.065285 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:46.065217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:51.371557 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:51.371506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:52.453039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:52.453000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:52.520771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:52.520736    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:52.771816 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:52.771786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:53.361452 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:53.361412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:53.679081 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:53.678981    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:53.852977 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:53.852945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:56.176908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:56.176863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:57.044930 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:57.044896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:57.141055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:57.141022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:57.238640 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:57.238612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:58.224167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:58.224137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:59.097582 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:50:59.097550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:00.066282 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:00.066227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:00.833928 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:00.833898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:00.933589 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:00.933559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:01.032425 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:01.032370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:01.327296 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:01.327262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:01.416860 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:01.416830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:22.260209 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:22.260176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:23.662660 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:23.662629    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:24.504701 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:24.504669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:25.671217 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:25.671188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:26.994538 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:26.994479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:27.373107 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:27.373076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:27.470714 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:27.470678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:27.652454 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:27.652375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:28.151587 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:28.151535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:28.227728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:28.227692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:28.994596 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:28.994564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:30.528490 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:30.528457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:31.244114 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:31.244075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:31.388400 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:31.388364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:32.111605 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:32.111574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:34.224139 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:34.224081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:34.412022 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:34.411996    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:51:34.417704 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:34.417684    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:51:35.389592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:35.389543    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:36.317679 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:36.317645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:37.303543 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:37.303502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:38.179982 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:38.179947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:38.279332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:38.279301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:38.525675 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:38.525648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:38.742731 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:38.742700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:38.843951 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:38.843838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.067338    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"]
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068015    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f5d6539-3130-4c97-8aa9-af6e253ce1d0" containerName="payload-pre-processing"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068035    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f5d6539-3130-4c97-8aa9-af6e253ce1d0" containerName="payload-pre-processing"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068049    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a78331-82d5-4bf9-9db8-d7bb2bf233ed" containerName="revoke-keys"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068058    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a78331-82d5-4bf9-9db8-d7bb2bf233ed" containerName="revoke-keys"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068094    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" containerName="main"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068104    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" containerName="main"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068248    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f5d6539-3130-4c97-8aa9-af6e253ce1d0" containerName="payload-pre-processing"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068266    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a78331-82d5-4bf9-9db8-d7bb2bf233ed" containerName="revoke-keys"
Sep 17 17:51:39.069539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.068279    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b4f9ea-44d5-4dde-877a-933e8c85a4c8" containerName="main"
Sep 17 17:51:39.078542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.074385    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.081653 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.081249    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-ef41f8\""
Sep 17 17:51:39.081653 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.081259    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-ef41f8-dockercfg-64xmk\""
Sep 17 17:51:39.088291 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.088264    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"]
Sep 17 17:51:39.139601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.136179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78np\" (UniqueName: \"kubernetes.io/projected/5a589aaa-e31f-41ea-9bec-489c6bd9156f-kube-api-access-t78np\") pod \"payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.139601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.136264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a589aaa-e31f-41ea-9bec-489c6bd9156f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.237818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.237784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78np\" (UniqueName: \"kubernetes.io/projected/5a589aaa-e31f-41ea-9bec-489c6bd9156f-kube-api-access-t78np\") pod \"payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.238008 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.237837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a589aaa-e31f-41ea-9bec-489c6bd9156f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.238738 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.238707    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a589aaa-e31f-41ea-9bec-489c6bd9156f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.259690 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.259659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78np\" (UniqueName: \"kubernetes.io/projected/5a589aaa-e31f-41ea-9bec-489c6bd9156f-kube-api-access-t78np\") pod \"payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.396792 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.396694    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:39.704638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.704611    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"]
Sep 17 17:51:39.706113 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:51:39.706086    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a589aaa_e31f_41ea_9bec_489c6bd9156f.slice/crio-3f556588daf0901f9c7009be7b9df8d68cbdd493b68b5ae66b9e938c67c446fa WatchSource:0}: Error finding container 3f556588daf0901f9c7009be7b9df8d68cbdd493b68b5ae66b9e938c67c446fa: Status 404 returned error can't find the container with id 3f556588daf0901f9c7009be7b9df8d68cbdd493b68b5ae66b9e938c67c446fa
Sep 17 17:51:39.806573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:39.806492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j" event={"ID":"5a589aaa-e31f-41ea-9bec-489c6bd9156f","Type":"ContainerStarted","Data":"3f556588daf0901f9c7009be7b9df8d68cbdd493b68b5ae66b9e938c67c446fa"}
Sep 17 17:51:40.815162 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:40.815122    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j" event={"ID":"5a589aaa-e31f-41ea-9bec-489c6bd9156f","Type":"ContainerStarted","Data":"c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37"}
Sep 17 17:51:40.815625 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:40.815200    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:40.836415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:40.836350    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j" podStartSLOduration=1.836329673 podStartE2EDuration="1.836329673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:51:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:51:40.8350974 +0000 UTC m=+1208.612935060" watchObservedRunningTime="2026-09-17 17:51:40.836329673 +0000 UTC m=+1208.614167315"
Sep 17 17:51:48.418844 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.418809    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"]
Sep 17 17:51:48.422305 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.422288    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"
Sep 17 17:51:48.427234 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.427213    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:51:48.430605 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.430586    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:51:48.507368 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.507340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"]
Sep 17 17:51:48.540940 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.540916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63631558-1cd2-4f6d-9f97-db119218ec2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl\" (UID: \"63631558-1cd2-4f6d-9f97-db119218ec2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"
Sep 17 17:51:48.641695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.641665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63631558-1cd2-4f6d-9f97-db119218ec2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl\" (UID: \"63631558-1cd2-4f6d-9f97-db119218ec2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"
Sep 17 17:51:48.642269 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.642248    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63631558-1cd2-4f6d-9f97-db119218ec2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl\" (UID: \"63631558-1cd2-4f6d-9f97-db119218ec2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"
Sep 17 17:51:48.732303 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.732229    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"
Sep 17 17:51:48.747383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:48.747353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:49.022960 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:49.022930    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"]
Sep 17 17:51:49.024606 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:51:49.024577    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63631558_1cd2_4f6d_9f97_db119218ec2f.slice/crio-95e9168eb4bae011db3f3d784d89664f6e020e0e1d17b768923036deca8469a5 WatchSource:0}: Error finding container 95e9168eb4bae011db3f3d784d89664f6e020e0e1d17b768923036deca8469a5: Status 404 returned error can't find the container with id 95e9168eb4bae011db3f3d784d89664f6e020e0e1d17b768923036deca8469a5
Sep 17 17:51:49.875926 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:49.875893    2559 generic.go:356] "Generic (PLEG): container finished" podID="63631558-1cd2-4f6d-9f97-db119218ec2f" containerID="75bd4cc780132f0092bbe082889eb79eb777e908b2a911d73455abf56baa062f" exitCode=0
Sep 17 17:51:49.876288 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:49.875932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl" event={"ID":"63631558-1cd2-4f6d-9f97-db119218ec2f","Type":"ContainerDied","Data":"75bd4cc780132f0092bbe082889eb79eb777e908b2a911d73455abf56baa062f"}
Sep 17 17:51:49.876288 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:49.875966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl" event={"ID":"63631558-1cd2-4f6d-9f97-db119218ec2f","Type":"ContainerStarted","Data":"95e9168eb4bae011db3f3d784d89664f6e020e0e1d17b768923036deca8469a5"}
Sep 17 17:51:50.193754 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:50.193640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:50.710733 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:50.710699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:51.024022 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.023999    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"
Sep 17 17:51:51.167506 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.167471    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63631558-1cd2-4f6d-9f97-db119218ec2f-maas-api-service-ca\") pod \"63631558-1cd2-4f6d-9f97-db119218ec2f\" (UID: \"63631558-1cd2-4f6d-9f97-db119218ec2f\") "
Sep 17 17:51:51.167835 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.167813    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63631558-1cd2-4f6d-9f97-db119218ec2f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63631558-1cd2-4f6d-9f97-db119218ec2f" (UID: "63631558-1cd2-4f6d-9f97-db119218ec2f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:51:51.269235 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.269155    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63631558-1cd2-4f6d-9f97-db119218ec2f-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:51:51.314029 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.314003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:51.825669 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.825641    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:51:51.889917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.889880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl" event={"ID":"63631558-1cd2-4f6d-9f97-db119218ec2f","Type":"ContainerDied","Data":"95e9168eb4bae011db3f3d784d89664f6e020e0e1d17b768923036deca8469a5"}
Sep 17 17:51:51.889917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.889905    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"
Sep 17 17:51:51.890115 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:51.889929    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95e9168eb4bae011db3f3d784d89664f6e020e0e1d17b768923036deca8469a5"
Sep 17 17:51:52.481587 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:52.481552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:53.615892 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:53.615861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:53.887468 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:53.887391    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"]
Sep 17 17:51:53.912272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:53.912241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:54.485182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:54.485123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:55.498000 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:55.497967    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:56.472119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:56.472088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:57.425726 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:57.425690    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:58.331385 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:58.331357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:58.819615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:58.819579    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:58.891442 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:58.891402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:59.300969 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:51:59.300935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:00.289891 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:00.289849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:01.091569 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.091540    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:01.254479 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.254436    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:01.950199 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.950169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:01.989274 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.989231    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-a4fb04"]
Sep 17 17:52:01.989703 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.989689    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63631558-1cd2-4f6d-9f97-db119218ec2f" containerName="revoke-keys"
Sep 17 17:52:01.989758 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.989704    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63631558-1cd2-4f6d-9f97-db119218ec2f" containerName="revoke-keys"
Sep 17 17:52:01.989804 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.989789    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63631558-1cd2-4f6d-9f97-db119218ec2f" containerName="revoke-keys"
Sep 17 17:52:01.993103 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.993087    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:01.996389 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:01.996354    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z7xqm\""
Sep 17 17:52:02.000220 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.000199    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-a4fb04"]
Sep 17 17:52:02.070912 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.070883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxlmd\" (UniqueName: \"kubernetes.io/projected/b02088d8-2853-4b12-91ae-aa97ddbbeae2-kube-api-access-gxlmd\") pod \"test-curl-7600-a4fb04\" (UID: \"b02088d8-2853-4b12-91ae-aa97ddbbeae2\") " pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:02.171697 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.171665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxlmd\" (UniqueName: \"kubernetes.io/projected/b02088d8-2853-4b12-91ae-aa97ddbbeae2-kube-api-access-gxlmd\") pod \"test-curl-7600-a4fb04\" (UID: \"b02088d8-2853-4b12-91ae-aa97ddbbeae2\") " pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:02.182188 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.182169    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxlmd\" (UniqueName: \"kubernetes.io/projected/b02088d8-2853-4b12-91ae-aa97ddbbeae2-kube-api-access-gxlmd\") pod \"test-curl-7600-a4fb04\" (UID: \"b02088d8-2853-4b12-91ae-aa97ddbbeae2\") " pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:02.304128 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.304096    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:02.580890 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.580860    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-a4fb04"]
Sep 17 17:52:02.583437 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:52:02.583412    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb02088d8_2853_4b12_91ae_aa97ddbbeae2.slice/crio-90c59b82e2850164bb685e022fd13610e066911dba84406a844d6ee340a7b7bd WatchSource:0}: Error finding container 90c59b82e2850164bb685e022fd13610e066911dba84406a844d6ee340a7b7bd: Status 404 returned error can't find the container with id 90c59b82e2850164bb685e022fd13610e066911dba84406a844d6ee340a7b7bd
Sep 17 17:52:02.585143 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.585126    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:52:02.721724 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.721693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:02.771274 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.771237    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"]
Sep 17 17:52:02.771539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.771491    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9" podUID="2b59381d-9b99-4562-95fd-2090052ba152" containerName="payload-pre-processing" containerID="cri-o://c54dfd6b2bb44314372aceb0fe56df7f83a0ffae1354f7bfb0116af09a924cff" gracePeriod=30
Sep 17 17:52:02.841729 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.841663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:02.957853 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.957810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:02.963626 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.963584    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b59381d-9b99-4562-95fd-2090052ba152" containerID="c54dfd6b2bb44314372aceb0fe56df7f83a0ffae1354f7bfb0116af09a924cff" exitCode=0
Sep 17 17:52:02.963889 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.963649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9" event={"ID":"2b59381d-9b99-4562-95fd-2090052ba152","Type":"ContainerDied","Data":"c54dfd6b2bb44314372aceb0fe56df7f83a0ffae1354f7bfb0116af09a924cff"}
Sep 17 17:52:02.965403 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:02.965378    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-a4fb04" event={"ID":"b02088d8-2853-4b12-91ae-aa97ddbbeae2","Type":"ContainerStarted","Data":"90c59b82e2850164bb685e022fd13610e066911dba84406a844d6ee340a7b7bd"}
Sep 17 17:52:03.015165 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.015141    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:52:03.050632 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.050605    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"]
Sep 17 17:52:03.053155 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.053136    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54966d-t4bgl"]
Sep 17 17:52:03.072564 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.072509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:03.081799 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.081777    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b59381d-9b99-4562-95fd-2090052ba152-plugins-config-volume\") pod \"2b59381d-9b99-4562-95fd-2090052ba152\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") "
Sep 17 17:52:03.081923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.081898    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/2b59381d-9b99-4562-95fd-2090052ba152-kube-api-access-zqk4f\") pod \"2b59381d-9b99-4562-95fd-2090052ba152\" (UID: \"2b59381d-9b99-4562-95fd-2090052ba152\") "
Sep 17 17:52:03.082175 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.082149    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b59381d-9b99-4562-95fd-2090052ba152-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b59381d-9b99-4562-95fd-2090052ba152" (UID: "2b59381d-9b99-4562-95fd-2090052ba152"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:03.083918 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.083897    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b59381d-9b99-4562-95fd-2090052ba152-kube-api-access-zqk4f" (OuterVolumeSpecName: "kube-api-access-zqk4f") pod "2b59381d-9b99-4562-95fd-2090052ba152" (UID: "2b59381d-9b99-4562-95fd-2090052ba152"). InnerVolumeSpecName "kube-api-access-zqk4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:03.174497 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.174404    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:03.182815 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.182792    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/2b59381d-9b99-4562-95fd-2090052ba152-kube-api-access-zqk4f\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:03.182815 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.182816    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b59381d-9b99-4562-95fd-2090052ba152-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:03.397938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.397892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:03.973914 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.973881    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"
Sep 17 17:52:03.974374 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.974027    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9" event={"ID":"2b59381d-9b99-4562-95fd-2090052ba152","Type":"ContainerDied","Data":"06105d3832dbe860e41086d58d4ad88e0fbb6ea38d9006718660b0a3a921e37e"}
Sep 17 17:52:03.974374 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:03.974142    2559 scope.go:117] "RemoveContainer" containerID="c54dfd6b2bb44314372aceb0fe56df7f83a0ffae1354f7bfb0116af09a924cff"
Sep 17 17:52:04.003556 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:04.003528    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"]
Sep 17 17:52:04.008011 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:04.007987    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-54966d-5ccc9649bb-sljh9"]
Sep 17 17:52:04.118906 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:04.118878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:04.402216 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:04.402186    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b59381d-9b99-4562-95fd-2090052ba152" path="/var/lib/kubelet/pods/2b59381d-9b99-4562-95fd-2090052ba152/volumes"
Sep 17 17:52:04.402510 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:04.402496    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63631558-1cd2-4f6d-9f97-db119218ec2f" path="/var/lib/kubelet/pods/63631558-1cd2-4f6d-9f97-db119218ec2f/volumes"
Sep 17 17:52:05.113167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:05.113134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:05.989436 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:05.989398    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-a4fb04" event={"ID":"b02088d8-2853-4b12-91ae-aa97ddbbeae2","Type":"ContainerStarted","Data":"3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc"}
Sep 17 17:52:06.022952 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:06.022905    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7600-a4fb04" podStartSLOduration=2.638379812 podStartE2EDuration="5.022891052s" totalImagesPullingTime="2.38451124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:06.020090417 +0000 UTC m=+1233.797928052" watchObservedRunningTime="2026-09-17 17:52:06.022891052 +0000 UTC m=+1233.800728729"
Sep 17 17:52:06.130477 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:06.130451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:06.733484 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:06.733402    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-a4fb04"]
Sep 17 17:52:06.741187 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:06.741158    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-a4fb04"]
Sep 17 17:52:06.995970 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:06.995880    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7600-a4fb04" container="test-curl-7600-a4fb04"
Sep 17 17:52:07.237981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:07.237949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:07.245853 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:07.245828    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"]
Sep 17 17:52:07.380645 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:07.380616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:08.002488 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:08.002452    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7600-a4fb04" podUID="b02088d8-2853-4b12-91ae-aa97ddbbeae2" containerName="test-curl-7600-a4fb04" containerID="cri-o://3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc" gracePeriod=2
Sep 17 17:52:08.006952 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:08.006915    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7600-a4fb04\" is forbidden: User \"system:node:ip-10-0-133-160.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-160.ec2.internal' and this object" podUID="b02088d8-2853-4b12-91ae-aa97ddbbeae2" pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:08.529551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:08.529471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:08.617030 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:08.617003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:08.908067 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:08.907960    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx" podUID="e704f773-57ed-4453-9f15-1f7e3de08521" containerName="main" containerID="cri-o://b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b" gracePeriod=45
Sep 17 17:52:09.163415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.163357    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:52:09.245759 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.245728    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-home\") pod \"e704f773-57ed-4453-9f15-1f7e3de08521\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") "
Sep 17 17:52:09.245936 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.245795    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-tmp-dir\") pod \"e704f773-57ed-4453-9f15-1f7e3de08521\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") "
Sep 17 17:52:09.245936 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.245827    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e704f773-57ed-4453-9f15-1f7e3de08521-tls-certs\") pod \"e704f773-57ed-4453-9f15-1f7e3de08521\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") "
Sep 17 17:52:09.245936 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.245850    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-model-cache\") pod \"e704f773-57ed-4453-9f15-1f7e3de08521\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") "
Sep 17 17:52:09.245936 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.245889    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-dshm\") pod \"e704f773-57ed-4453-9f15-1f7e3de08521\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") "
Sep 17 17:52:09.245936 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.245918    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvdk4\" (UniqueName: \"kubernetes.io/projected/e704f773-57ed-4453-9f15-1f7e3de08521-kube-api-access-mvdk4\") pod \"e704f773-57ed-4453-9f15-1f7e3de08521\" (UID: \"e704f773-57ed-4453-9f15-1f7e3de08521\") "
Sep 17 17:52:09.246177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.245984    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-home" (OuterVolumeSpecName: "home") pod "e704f773-57ed-4453-9f15-1f7e3de08521" (UID: "e704f773-57ed-4453-9f15-1f7e3de08521"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:09.246177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.246095    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e704f773-57ed-4453-9f15-1f7e3de08521" (UID: "e704f773-57ed-4453-9f15-1f7e3de08521"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:09.246177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.246137    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-model-cache" (OuterVolumeSpecName: "model-cache") pod "e704f773-57ed-4453-9f15-1f7e3de08521" (UID: "e704f773-57ed-4453-9f15-1f7e3de08521"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:09.246332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.246295    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:09.246332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.246313    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:09.246332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.246328    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:09.248084 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.248055    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-dshm" (OuterVolumeSpecName: "dshm") pod "e704f773-57ed-4453-9f15-1f7e3de08521" (UID: "e704f773-57ed-4453-9f15-1f7e3de08521"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:09.248184 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.248093    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e704f773-57ed-4453-9f15-1f7e3de08521-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e704f773-57ed-4453-9f15-1f7e3de08521" (UID: "e704f773-57ed-4453-9f15-1f7e3de08521"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:52:09.248232 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.248179    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e704f773-57ed-4453-9f15-1f7e3de08521-kube-api-access-mvdk4" (OuterVolumeSpecName: "kube-api-access-mvdk4") pod "e704f773-57ed-4453-9f15-1f7e3de08521" (UID: "e704f773-57ed-4453-9f15-1f7e3de08521"). InnerVolumeSpecName "kube-api-access-mvdk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:09.347734 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.347708    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e704f773-57ed-4453-9f15-1f7e3de08521-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:09.347862 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.347738    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvdk4\" (UniqueName: \"kubernetes.io/projected/e704f773-57ed-4453-9f15-1f7e3de08521-kube-api-access-mvdk4\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:09.347862 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.347755    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e704f773-57ed-4453-9f15-1f7e3de08521-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:09.742731 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:09.742698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:10.016240 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.016209    2559 generic.go:356] "Generic (PLEG): container finished" podID="e704f773-57ed-4453-9f15-1f7e3de08521" containerID="b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b" exitCode=0
Sep 17 17:52:10.016367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.016259    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"
Sep 17 17:52:10.016367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.016296    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx" event={"ID":"e704f773-57ed-4453-9f15-1f7e3de08521","Type":"ContainerDied","Data":"b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b"}
Sep 17 17:52:10.016367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.016337    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx" event={"ID":"e704f773-57ed-4453-9f15-1f7e3de08521","Type":"ContainerDied","Data":"13f9cc254a530b94fc7f4484418129f4028b5e971e4d9e98626b4ea57fa02559"}
Sep 17 17:52:10.016367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.016360    2559 scope.go:117] "RemoveContainer" containerID="b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b"
Sep 17 17:52:10.061579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.061550    2559 scope.go:117] "RemoveContainer" containerID="b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b"
Sep 17 17:52:10.061868 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:10.061848    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b\": container with ID starting with b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b not found: ID does not exist" containerID="b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b"
Sep 17 17:52:10.061965 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.061877    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b"} err="failed to get container status \"b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b\": rpc error: code = NotFound desc = could not find container \"b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b\": container with ID starting with b29db305196e1f5b6665ab46ce467285ca4a2192128d65cfb47c32234273a23b not found: ID does not exist"
Sep 17 17:52:10.092375 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.092346    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"]
Sep 17 17:52:10.117896 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.117870    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-54966d/test-model-54966d-kserve-d86576f45-gggbx"]
Sep 17 17:52:10.202667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.202639    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:10.256185 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.256115    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxlmd\" (UniqueName: \"kubernetes.io/projected/b02088d8-2853-4b12-91ae-aa97ddbbeae2-kube-api-access-gxlmd\") pod \"b02088d8-2853-4b12-91ae-aa97ddbbeae2\" (UID: \"b02088d8-2853-4b12-91ae-aa97ddbbeae2\") "
Sep 17 17:52:10.258315 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.258291    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02088d8-2853-4b12-91ae-aa97ddbbeae2-kube-api-access-gxlmd" (OuterVolumeSpecName: "kube-api-access-gxlmd") pod "b02088d8-2853-4b12-91ae-aa97ddbbeae2" (UID: "b02088d8-2853-4b12-91ae-aa97ddbbeae2"). InnerVolumeSpecName "kube-api-access-gxlmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:10.357031 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.357007    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxlmd\" (UniqueName: \"kubernetes.io/projected/b02088d8-2853-4b12-91ae-aa97ddbbeae2-kube-api-access-gxlmd\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:10.400635 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.400602    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02088d8-2853-4b12-91ae-aa97ddbbeae2" path="/var/lib/kubelet/pods/b02088d8-2853-4b12-91ae-aa97ddbbeae2/volumes"
Sep 17 17:52:10.401089 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.401070    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e704f773-57ed-4453-9f15-1f7e3de08521" path="/var/lib/kubelet/pods/e704f773-57ed-4453-9f15-1f7e3de08521/volumes"
Sep 17 17:52:10.846085 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846052    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-0336b8"]
Sep 17 17:52:10.846475 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846459    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02088d8-2853-4b12-91ae-aa97ddbbeae2" containerName="test-curl-7600-a4fb04"
Sep 17 17:52:10.846475 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846471    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02088d8-2853-4b12-91ae-aa97ddbbeae2" containerName="test-curl-7600-a4fb04"
Sep 17 17:52:10.846592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846484    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e704f773-57ed-4453-9f15-1f7e3de08521" containerName="main"
Sep 17 17:52:10.846592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846490    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e704f773-57ed-4453-9f15-1f7e3de08521" containerName="main"
Sep 17 17:52:10.846592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846509    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b59381d-9b99-4562-95fd-2090052ba152" containerName="payload-pre-processing"
Sep 17 17:52:10.846592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846528    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b59381d-9b99-4562-95fd-2090052ba152" containerName="payload-pre-processing"
Sep 17 17:52:10.846592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846592    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b59381d-9b99-4562-95fd-2090052ba152" containerName="payload-pre-processing"
Sep 17 17:52:10.846747 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846600    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02088d8-2853-4b12-91ae-aa97ddbbeae2" containerName="test-curl-7600-a4fb04"
Sep 17 17:52:10.846747 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.846607    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e704f773-57ed-4453-9f15-1f7e3de08521" containerName="main"
Sep 17 17:52:10.850041 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.850025    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:10.861723 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.861700    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-0336b8"]
Sep 17 17:52:10.963542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:10.963483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzmq4\" (UniqueName: \"kubernetes.io/projected/a323441d-6e7b-4042-9239-ed4e9915d727-kube-api-access-wzmq4\") pod \"test-curl-7600-0336b8\" (UID: \"a323441d-6e7b-4042-9239-ed4e9915d727\") " pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:11.030381 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.030343    2559 generic.go:356] "Generic (PLEG): container finished" podID="b02088d8-2853-4b12-91ae-aa97ddbbeae2" containerID="3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc" exitCode=137
Sep 17 17:52:11.030560 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.030399    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-a4fb04"
Sep 17 17:52:11.030560 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.030409    2559 scope.go:117] "RemoveContainer" containerID="3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc"
Sep 17 17:52:11.039681 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.039663    2559 scope.go:117] "RemoveContainer" containerID="3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc"
Sep 17 17:52:11.039954 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:11.039931    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc\": container with ID starting with 3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc not found: ID does not exist" containerID="3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc"
Sep 17 17:52:11.040005 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.039963    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc"} err="failed to get container status \"3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc\": rpc error: code = NotFound desc = could not find container \"3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc\": container with ID starting with 3de4c136ad8de8d2fabf1cd9a0b7afd85af9346204059a1cff5a0195dd2230dc not found: ID does not exist"
Sep 17 17:52:11.065017 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.064993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmq4\" (UniqueName: \"kubernetes.io/projected/a323441d-6e7b-4042-9239-ed4e9915d727-kube-api-access-wzmq4\") pod \"test-curl-7600-0336b8\" (UID: \"a323441d-6e7b-4042-9239-ed4e9915d727\") " pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:11.074931 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.074908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzmq4\" (UniqueName: \"kubernetes.io/projected/a323441d-6e7b-4042-9239-ed4e9915d727-kube-api-access-wzmq4\") pod \"test-curl-7600-0336b8\" (UID: \"a323441d-6e7b-4042-9239-ed4e9915d727\") " pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:11.158959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.158897    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:11.440337 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:11.440310    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-0336b8"]
Sep 17 17:52:11.442262 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:52:11.442233    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda323441d_6e7b_4042_9239_ed4e9915d727.slice/crio-b0311363584a7b3cee53967343bf14070c686e6009531683cbd028b0f8e51744 WatchSource:0}: Error finding container b0311363584a7b3cee53967343bf14070c686e6009531683cbd028b0f8e51744: Status 404 returned error can't find the container with id b0311363584a7b3cee53967343bf14070c686e6009531683cbd028b0f8e51744
Sep 17 17:52:12.043296 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:12.043259    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-0336b8" event={"ID":"a323441d-6e7b-4042-9239-ed4e9915d727","Type":"ContainerStarted","Data":"686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f"}
Sep 17 17:52:12.043795 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:12.043311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-0336b8" event={"ID":"a323441d-6e7b-4042-9239-ed4e9915d727","Type":"ContainerStarted","Data":"b0311363584a7b3cee53967343bf14070c686e6009531683cbd028b0f8e51744"}
Sep 17 17:52:12.062324 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:12.062273    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7600-0336b8" podStartSLOduration=2.062257962 podStartE2EDuration="2.062257962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:12.061695969 +0000 UTC m=+1239.839533606" watchObservedRunningTime="2026-09-17 17:52:12.062257962 +0000 UTC m=+1239.840095596"
Sep 17 17:52:12.689946 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:12.689908    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-0336b8"]
Sep 17 17:52:12.700299 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:12.700261    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-0336b8"]
Sep 17 17:52:13.050737 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:13.050708    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7600-0336b8" container="test-curl-7600-0336b8"
Sep 17 17:52:13.322363 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:13.322275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:13.667779 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:13.667699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:13.876718 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:13.876685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:13.991540 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:13.991437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:14.056251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:14.056218    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7600-0336b8" podUID="a323441d-6e7b-4042-9239-ed4e9915d727" containerName="test-curl-7600-0336b8" containerID="cri-o://686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f" gracePeriod=2
Sep 17 17:52:14.060266 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:14.060241    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7600-0336b8\" is forbidden: User \"system:node:ip-10-0-133-160.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-160.ec2.internal' and this object" podUID="a323441d-6e7b-4042-9239-ed4e9915d727" pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:14.400334 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:14.400297    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7600-0336b8\" is forbidden: User \"system:node:ip-10-0-133-160.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-160.ec2.internal' and this object" podUID="a323441d-6e7b-4042-9239-ed4e9915d727" pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:15.707136 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:15.707083    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:16.168163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.168117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:16.237599 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.237570    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:16.319095 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.319009    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzmq4\" (UniqueName: \"kubernetes.io/projected/a323441d-6e7b-4042-9239-ed4e9915d727-kube-api-access-wzmq4\") pod \"a323441d-6e7b-4042-9239-ed4e9915d727\" (UID: \"a323441d-6e7b-4042-9239-ed4e9915d727\") "
Sep 17 17:52:16.321055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.321035    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a323441d-6e7b-4042-9239-ed4e9915d727-kube-api-access-wzmq4" (OuterVolumeSpecName: "kube-api-access-wzmq4") pod "a323441d-6e7b-4042-9239-ed4e9915d727" (UID: "a323441d-6e7b-4042-9239-ed4e9915d727"). InnerVolumeSpecName "kube-api-access-wzmq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:16.400687 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.400652    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a323441d-6e7b-4042-9239-ed4e9915d727" path="/var/lib/kubelet/pods/a323441d-6e7b-4042-9239-ed4e9915d727/volumes"
Sep 17 17:52:16.420207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.420177    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzmq4\" (UniqueName: \"kubernetes.io/projected/a323441d-6e7b-4042-9239-ed4e9915d727-kube-api-access-wzmq4\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:16.422547 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.422507    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:16.573631 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.573545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:16.683287 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.683255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:16.746759 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.746726    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"]
Sep 17 17:52:16.747175 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.747163    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a323441d-6e7b-4042-9239-ed4e9915d727" containerName="test-curl-7600-0336b8"
Sep 17 17:52:16.747220 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.747177    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a323441d-6e7b-4042-9239-ed4e9915d727" containerName="test-curl-7600-0336b8"
Sep 17 17:52:16.747255 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.747250    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a323441d-6e7b-4042-9239-ed4e9915d727" containerName="test-curl-7600-0336b8"
Sep 17 17:52:16.750435 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.750416    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"
Sep 17 17:52:16.753630 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.753610    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:52:16.753768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.753693    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:52:16.762430 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.762404    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"]
Sep 17 17:52:16.824151 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.824053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6535bab8-80cb-4cb9-9584-50c719e9fb68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc\" (UID: \"6535bab8-80cb-4cb9-9584-50c719e9fb68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"
Sep 17 17:52:16.925341 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.925301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6535bab8-80cb-4cb9-9584-50c719e9fb68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc\" (UID: \"6535bab8-80cb-4cb9-9584-50c719e9fb68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"
Sep 17 17:52:16.925983 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:16.925960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6535bab8-80cb-4cb9-9584-50c719e9fb68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc\" (UID: \"6535bab8-80cb-4cb9-9584-50c719e9fb68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"
Sep 17 17:52:17.061713 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:17.061677    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"
Sep 17 17:52:17.076592 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:17.076564    2559 generic.go:356] "Generic (PLEG): container finished" podID="a323441d-6e7b-4042-9239-ed4e9915d727" containerID="686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f" exitCode=137
Sep 17 17:52:17.076719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:17.076609    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-0336b8"
Sep 17 17:52:17.076719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:17.076674    2559 scope.go:117] "RemoveContainer" containerID="686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f"
Sep 17 17:52:17.095743 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:17.095719    2559 scope.go:117] "RemoveContainer" containerID="686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f"
Sep 17 17:52:17.096115 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:17.096093    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f\": container with ID starting with 686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f not found: ID does not exist" containerID="686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f"
Sep 17 17:52:17.096196 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:17.096127    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f"} err="failed to get container status \"686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f\": rpc error: code = NotFound desc = could not find container \"686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f\": container with ID starting with 686cb052cc72067776f1a28481151838c56e0d2ce1607d4a1325f7c56a65598f not found: ID does not exist"
Sep 17 17:52:17.346005 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:17.345975    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"]
Sep 17 17:52:17.347252 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:52:17.347226    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6535bab8_80cb_4cb9_9584_50c719e9fb68.slice/crio-bf32b6ebeb1984837ac57e68968124e858428727ed8554a8758476f8c5741fe8 WatchSource:0}: Error finding container bf32b6ebeb1984837ac57e68968124e858428727ed8554a8758476f8c5741fe8: Status 404 returned error can't find the container with id bf32b6ebeb1984837ac57e68968124e858428727ed8554a8758476f8c5741fe8
Sep 17 17:52:18.085150 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:18.085120    2559 generic.go:356] "Generic (PLEG): container finished" podID="6535bab8-80cb-4cb9-9584-50c719e9fb68" containerID="e65181cb9afb2d2f3c81e12c0b609cf3a9a7b04b37285a237af49982f38de0b9" exitCode=0
Sep 17 17:52:18.085475 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:18.085199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc" event={"ID":"6535bab8-80cb-4cb9-9584-50c719e9fb68","Type":"ContainerDied","Data":"e65181cb9afb2d2f3c81e12c0b609cf3a9a7b04b37285a237af49982f38de0b9"}
Sep 17 17:52:18.085475 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:18.085246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc" event={"ID":"6535bab8-80cb-4cb9-9584-50c719e9fb68","Type":"ContainerStarted","Data":"bf32b6ebeb1984837ac57e68968124e858428727ed8554a8758476f8c5741fe8"}
Sep 17 17:52:18.353376 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:18.353291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:19.234215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:19.234186    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"
Sep 17 17:52:19.282299 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:19.282263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:19.350445 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:19.350366    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6535bab8-80cb-4cb9-9584-50c719e9fb68-maas-api-service-ca\") pod \"6535bab8-80cb-4cb9-9584-50c719e9fb68\" (UID: \"6535bab8-80cb-4cb9-9584-50c719e9fb68\") "
Sep 17 17:52:19.350727 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:19.350706    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6535bab8-80cb-4cb9-9584-50c719e9fb68-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6535bab8-80cb-4cb9-9584-50c719e9fb68" (UID: "6535bab8-80cb-4cb9-9584-50c719e9fb68"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:19.451596 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:19.451548    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6535bab8-80cb-4cb9-9584-50c719e9fb68-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:20.098405 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:20.098373    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"
Sep 17 17:52:20.098615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:20.098411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc" event={"ID":"6535bab8-80cb-4cb9-9584-50c719e9fb68","Type":"ContainerDied","Data":"bf32b6ebeb1984837ac57e68968124e858428727ed8554a8758476f8c5741fe8"}
Sep 17 17:52:20.098615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:20.098492    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf32b6ebeb1984837ac57e68968124e858428727ed8554a8758476f8c5741fe8"
Sep 17 17:52:20.454367 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:20.454278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:21.512738 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:21.512693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:22.264959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.264921    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2" podUID="4fa9c41d-6d73-45af-86ae-9f90014d5b35" containerName="main" containerID="cri-o://2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061" gracePeriod=45
Sep 17 17:52:22.518828 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.518764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:22.523595 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.523571    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:52:22.616386 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.616352    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:22.685448 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685412    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-model-cache\") pod \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") "
Sep 17 17:52:22.685448 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685452    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tls-certs\") pod \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") "
Sep 17 17:52:22.685730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685469    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-home\") pod \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") "
Sep 17 17:52:22.685730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685495    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tmp-dir\") pod \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") "
Sep 17 17:52:22.685730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685576    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-dshm\") pod \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") "
Sep 17 17:52:22.685730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685651    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljxtq\" (UniqueName: \"kubernetes.io/projected/4fa9c41d-6d73-45af-86ae-9f90014d5b35-kube-api-access-ljxtq\") pod \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\" (UID: \"4fa9c41d-6d73-45af-86ae-9f90014d5b35\") "
Sep 17 17:52:22.685922 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685791    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-model-cache" (OuterVolumeSpecName: "model-cache") pod "4fa9c41d-6d73-45af-86ae-9f90014d5b35" (UID: "4fa9c41d-6d73-45af-86ae-9f90014d5b35"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:22.685922 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685805    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-home" (OuterVolumeSpecName: "home") pod "4fa9c41d-6d73-45af-86ae-9f90014d5b35" (UID: "4fa9c41d-6d73-45af-86ae-9f90014d5b35"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:22.685922 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685819    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4fa9c41d-6d73-45af-86ae-9f90014d5b35" (UID: "4fa9c41d-6d73-45af-86ae-9f90014d5b35"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:22.686066 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685942    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:22.686066 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685954    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:22.686066 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.685963    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:22.687917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.687875    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa9c41d-6d73-45af-86ae-9f90014d5b35-kube-api-access-ljxtq" (OuterVolumeSpecName: "kube-api-access-ljxtq") pod "4fa9c41d-6d73-45af-86ae-9f90014d5b35" (UID: "4fa9c41d-6d73-45af-86ae-9f90014d5b35"). InnerVolumeSpecName "kube-api-access-ljxtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:22.688019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.687948    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4fa9c41d-6d73-45af-86ae-9f90014d5b35" (UID: "4fa9c41d-6d73-45af-86ae-9f90014d5b35"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:52:22.688019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.687953    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-dshm" (OuterVolumeSpecName: "dshm") pod "4fa9c41d-6d73-45af-86ae-9f90014d5b35" (UID: "4fa9c41d-6d73-45af-86ae-9f90014d5b35"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:22.775871 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.775767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:22.787074 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.787049    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljxtq\" (UniqueName: \"kubernetes.io/projected/4fa9c41d-6d73-45af-86ae-9f90014d5b35-kube-api-access-ljxtq\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:22.787074 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.787071    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa9c41d-6d73-45af-86ae-9f90014d5b35-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:22.787213 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.787080    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fa9c41d-6d73-45af-86ae-9f90014d5b35-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:22.881326 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:22.881293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:23.063234 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.063136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:23.118173 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.118138    2559 generic.go:356] "Generic (PLEG): container finished" podID="4fa9c41d-6d73-45af-86ae-9f90014d5b35" containerID="2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061" exitCode=0
Sep 17 17:52:23.118327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.118180    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"
Sep 17 17:52:23.118327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.118225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2" event={"ID":"4fa9c41d-6d73-45af-86ae-9f90014d5b35","Type":"ContainerDied","Data":"2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061"}
Sep 17 17:52:23.118327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.118262    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2" event={"ID":"4fa9c41d-6d73-45af-86ae-9f90014d5b35","Type":"ContainerDied","Data":"e9ec441a81940e8831b7794a8493e764130af3604a4f4cd574f7c868813d0e91"}
Sep 17 17:52:23.118327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.118281    2559 scope.go:117] "RemoveContainer" containerID="2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061"
Sep 17 17:52:23.128414 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.128398    2559 scope.go:117] "RemoveContainer" containerID="2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061"
Sep 17 17:52:23.128689 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:23.128671    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061\": container with ID starting with 2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061 not found: ID does not exist" containerID="2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061"
Sep 17 17:52:23.128771 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.128700    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061"} err="failed to get container status \"2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061\": rpc error: code = NotFound desc = could not find container \"2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061\": container with ID starting with 2fe010b86670ae1b369aec81a5d4d6180b2f83fc7a54c611bcac91729eacb061 not found: ID does not exist"
Sep 17 17:52:23.166798 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.166775    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"]
Sep 17 17:52:23.180131 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.180106    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-dfb277/test-model-dfb277-kserve-8549cd8fc7-g28f2"]
Sep 17 17:52:23.190211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.190186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:23.411609 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.411481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:23.524050 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.524024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:23.732499 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.732423    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"]
Sep 17 17:52:23.732873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.732860    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa9c41d-6d73-45af-86ae-9f90014d5b35" containerName="main"
Sep 17 17:52:23.732926 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.732878    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa9c41d-6d73-45af-86ae-9f90014d5b35" containerName="main"
Sep 17 17:52:23.732926 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.732890    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6535bab8-80cb-4cb9-9584-50c719e9fb68" containerName="revoke-keys"
Sep 17 17:52:23.732926 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.732897    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6535bab8-80cb-4cb9-9584-50c719e9fb68" containerName="revoke-keys"
Sep 17 17:52:23.733020 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.732982    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6535bab8-80cb-4cb9-9584-50c719e9fb68" containerName="revoke-keys"
Sep 17 17:52:23.733020 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.732993    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fa9c41d-6d73-45af-86ae-9f90014d5b35" containerName="main"
Sep 17 17:52:23.737320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.737302    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:23.742782 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.742731    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f9224635\""
Sep 17 17:52:23.742782 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.742731    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f9224635-dockercfg-47gbc\""
Sep 17 17:52:23.771038 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.771003    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"]
Sep 17 17:52:23.816300 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.816269    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"]
Sep 17 17:52:23.819743 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.819727    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:23.897811 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.897782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chng5\" (UniqueName: \"kubernetes.io/projected/48a15bad-c064-4097-b555-ff112a7b777a-kube-api-access-chng5\") pod \"payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") " pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:23.897954 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.897848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a15bad-c064-4097-b555-ff112a7b777a-plugins-config-volume\") pod \"payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") " pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:23.919100 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.919053    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"]
Sep 17 17:52:23.999012 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.998979    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chng5\" (UniqueName: \"kubernetes.io/projected/48a15bad-c064-4097-b555-ff112a7b777a-kube-api-access-chng5\") pod \"payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") " pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:23.999163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.999135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phmhq\" (UniqueName: \"kubernetes.io/projected/9589ca9d-adff-4397-a4f5-96de77f8c058-kube-api-access-phmhq\") pod \"payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:23.999233 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.999181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9589ca9d-adff-4397-a4f5-96de77f8c058-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:23.999320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.999240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a15bad-c064-4097-b555-ff112a7b777a-plugins-config-volume\") pod \"payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") " pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:23.999912 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:23.999894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a15bad-c064-4097-b555-ff112a7b777a-plugins-config-volume\") pod \"payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") " pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:24.009409 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.009387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chng5\" (UniqueName: \"kubernetes.io/projected/48a15bad-c064-4097-b555-ff112a7b777a-kube-api-access-chng5\") pod \"payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") " pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:24.047728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.047683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:24.098831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.098543    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:24.099961 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.099925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phmhq\" (UniqueName: \"kubernetes.io/projected/9589ca9d-adff-4397-a4f5-96de77f8c058-kube-api-access-phmhq\") pod \"payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:24.100466 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.100443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9589ca9d-adff-4397-a4f5-96de77f8c058-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:24.101232 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.101206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9589ca9d-adff-4397-a4f5-96de77f8c058-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:24.115972 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.115948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phmhq\" (UniqueName: \"kubernetes.io/projected/9589ca9d-adff-4397-a4f5-96de77f8c058-kube-api-access-phmhq\") pod \"payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:24.129826 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.129800    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:24.339451 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.338713    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"]
Sep 17 17:52:24.342945 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:52:24.342921    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a15bad_c064_4097_b555_ff112a7b777a.slice/crio-6439361611b87a0e6d9e8998a923a73f59aac02e54b0cdffc5814850e886e32b WatchSource:0}: Error finding container 6439361611b87a0e6d9e8998a923a73f59aac02e54b0cdffc5814850e886e32b: Status 404 returned error can't find the container with id 6439361611b87a0e6d9e8998a923a73f59aac02e54b0cdffc5814850e886e32b
Sep 17 17:52:24.400418 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.400390    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa9c41d-6d73-45af-86ae-9f90014d5b35" path="/var/lib/kubelet/pods/4fa9c41d-6d73-45af-86ae-9f90014d5b35/volumes"
Sep 17 17:52:24.422591 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:24.422557    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"]
Sep 17 17:52:24.425250 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:52:24.425227    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9589ca9d_adff_4397_a4f5_96de77f8c058.slice/crio-625e7bee5cbedc930b9c744c5ad91b3c21066f4e6bb6ea186afa865d4cc92e21 WatchSource:0}: Error finding container 625e7bee5cbedc930b9c744c5ad91b3c21066f4e6bb6ea186afa865d4cc92e21: Status 404 returned error can't find the container with id 625e7bee5cbedc930b9c744c5ad91b3c21066f4e6bb6ea186afa865d4cc92e21
Sep 17 17:52:25.092845 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.092814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:25.136106 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.136071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n" event={"ID":"48a15bad-c064-4097-b555-ff112a7b777a","Type":"ContainerStarted","Data":"c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb"}
Sep 17 17:52:25.136296 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.136128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n" event={"ID":"48a15bad-c064-4097-b555-ff112a7b777a","Type":"ContainerStarted","Data":"6439361611b87a0e6d9e8998a923a73f59aac02e54b0cdffc5814850e886e32b"}
Sep 17 17:52:25.136296 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.136229    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:25.137878 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.137855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j" event={"ID":"9589ca9d-adff-4397-a4f5-96de77f8c058","Type":"ContainerStarted","Data":"de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5"}
Sep 17 17:52:25.137998 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.137897    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:25.137998 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.137914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j" event={"ID":"9589ca9d-adff-4397-a4f5-96de77f8c058","Type":"ContainerStarted","Data":"625e7bee5cbedc930b9c744c5ad91b3c21066f4e6bb6ea186afa865d4cc92e21"}
Sep 17 17:52:25.243249 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.243196    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j" podStartSLOduration=2.243177704 podStartE2EDuration="2.243177704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:25.242861638 +0000 UTC m=+1253.020699310" watchObservedRunningTime="2026-09-17 17:52:25.243177704 +0000 UTC m=+1253.021015340"
Sep 17 17:52:25.244149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:25.244110    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n" podStartSLOduration=2.244099191 podStartE2EDuration="2.244099191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:25.200896467 +0000 UTC m=+1252.978734102" watchObservedRunningTime="2026-09-17 17:52:25.244099191 +0000 UTC m=+1253.021936826"
Sep 17 17:52:26.394658 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:26.394628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:26.519427 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:26.519394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:27.334399 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.334357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:27.437986 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.437957    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"]
Sep 17 17:52:27.438379 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.438149    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf" podUID="1ba95f2e-7c90-4515-8dd4-c520a773a353" containerName="payload-processing" containerID="cri-o://81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9" gracePeriod=30
Sep 17 17:52:27.440737 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.440711    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"]
Sep 17 17:52:27.440935 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.440906    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g" podUID="51cd31dd-e03c-4451-ae39-e4101a9814b5" containerName="payload-pre-processing" containerID="cri-o://d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a" gracePeriod=30
Sep 17 17:52:27.479345 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.479315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:27.576238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.576204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:27.673742 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.673697    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"]
Sep 17 17:52:27.675471 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.675441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:27.676479 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.676455    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dfb277-t68jc"]
Sep 17 17:52:27.729770 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.729737    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:52:27.732573 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.732557    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:52:27.744449 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.744427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:27.838138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.838112    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmt2n\" (UniqueName: \"kubernetes.io/projected/51cd31dd-e03c-4451-ae39-e4101a9814b5-kube-api-access-qmt2n\") pod \"51cd31dd-e03c-4451-ae39-e4101a9814b5\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") "
Sep 17 17:52:27.838274 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.838156    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g5r5\" (UniqueName: \"kubernetes.io/projected/1ba95f2e-7c90-4515-8dd4-c520a773a353-kube-api-access-6g5r5\") pod \"1ba95f2e-7c90-4515-8dd4-c520a773a353\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") "
Sep 17 17:52:27.838337 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.838289    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd31dd-e03c-4451-ae39-e4101a9814b5-plugins-config-volume\") pod \"51cd31dd-e03c-4451-ae39-e4101a9814b5\" (UID: \"51cd31dd-e03c-4451-ae39-e4101a9814b5\") "
Sep 17 17:52:27.838392 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.838336    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba95f2e-7c90-4515-8dd4-c520a773a353-plugins-config-volume\") pod \"1ba95f2e-7c90-4515-8dd4-c520a773a353\" (UID: \"1ba95f2e-7c90-4515-8dd4-c520a773a353\") "
Sep 17 17:52:27.838695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.838670    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51cd31dd-e03c-4451-ae39-e4101a9814b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51cd31dd-e03c-4451-ae39-e4101a9814b5" (UID: "51cd31dd-e03c-4451-ae39-e4101a9814b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:27.838819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.838751    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd31dd-e03c-4451-ae39-e4101a9814b5-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:27.838819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.838757    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba95f2e-7c90-4515-8dd4-c520a773a353-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ba95f2e-7c90-4515-8dd4-c520a773a353" (UID: "1ba95f2e-7c90-4515-8dd4-c520a773a353"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:27.840232 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.840205    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51cd31dd-e03c-4451-ae39-e4101a9814b5-kube-api-access-qmt2n" (OuterVolumeSpecName: "kube-api-access-qmt2n") pod "51cd31dd-e03c-4451-ae39-e4101a9814b5" (UID: "51cd31dd-e03c-4451-ae39-e4101a9814b5"). InnerVolumeSpecName "kube-api-access-qmt2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:27.840232 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.840227    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba95f2e-7c90-4515-8dd4-c520a773a353-kube-api-access-6g5r5" (OuterVolumeSpecName: "kube-api-access-6g5r5") pod "1ba95f2e-7c90-4515-8dd4-c520a773a353" (UID: "1ba95f2e-7c90-4515-8dd4-c520a773a353"). InnerVolumeSpecName "kube-api-access-6g5r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:27.939937 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.939874    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmt2n\" (UniqueName: \"kubernetes.io/projected/51cd31dd-e03c-4451-ae39-e4101a9814b5-kube-api-access-qmt2n\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:27.939937 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.939896    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g5r5\" (UniqueName: \"kubernetes.io/projected/1ba95f2e-7c90-4515-8dd4-c520a773a353-kube-api-access-6g5r5\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:27.939937 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:27.939908    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba95f2e-7c90-4515-8dd4-c520a773a353-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:52:28.018448 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.018423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:28.119952 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.119926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:28.159133 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.159098    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ba95f2e-7c90-4515-8dd4-c520a773a353" containerID="81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9" exitCode=0
Sep 17 17:52:28.159133 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.159132    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"
Sep 17 17:52:28.159343 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.159169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf" event={"ID":"1ba95f2e-7c90-4515-8dd4-c520a773a353","Type":"ContainerDied","Data":"81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9"}
Sep 17 17:52:28.159343 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.159225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf" event={"ID":"1ba95f2e-7c90-4515-8dd4-c520a773a353","Type":"ContainerDied","Data":"28a72a60c64e068b106061f953b02ec76e0481678025f0fbb82eb70c75bc63de"}
Sep 17 17:52:28.159343 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.159258    2559 scope.go:117] "RemoveContainer" containerID="81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9"
Sep 17 17:52:28.160804 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.160779    2559 generic.go:356] "Generic (PLEG): container finished" podID="51cd31dd-e03c-4451-ae39-e4101a9814b5" containerID="d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a" exitCode=0
Sep 17 17:52:28.160923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.160812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g" event={"ID":"51cd31dd-e03c-4451-ae39-e4101a9814b5","Type":"ContainerDied","Data":"d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a"}
Sep 17 17:52:28.160923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.160828    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"
Sep 17 17:52:28.160923 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.160876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g" event={"ID":"51cd31dd-e03c-4451-ae39-e4101a9814b5","Type":"ContainerDied","Data":"bde18de2eb8342bd56e539a5276d14a02aa71b5a07380df715efaa2f6cc7ae4c"}
Sep 17 17:52:28.179364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.179347    2559 scope.go:117] "RemoveContainer" containerID="81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9"
Sep 17 17:52:28.179669 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:28.179641    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9\": container with ID starting with 81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9 not found: ID does not exist" containerID="81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9"
Sep 17 17:52:28.179769 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.179684    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9"} err="failed to get container status \"81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9\": rpc error: code = NotFound desc = could not find container \"81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9\": container with ID starting with 81fc673af2b9dfd6ab6943324041d8dcd1ab20d1ccea08e809323b81b57bc7d9 not found: ID does not exist"
Sep 17 17:52:28.179769 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.179708    2559 scope.go:117] "RemoveContainer" containerID="d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a"
Sep 17 17:52:28.188340 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.188322    2559 scope.go:117] "RemoveContainer" containerID="d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a"
Sep 17 17:52:28.188644 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:28.188627    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a\": container with ID starting with d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a not found: ID does not exist" containerID="d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a"
Sep 17 17:52:28.188690 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.188651    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a"} err="failed to get container status \"d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a\": rpc error: code = NotFound desc = could not find container \"d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a\": container with ID starting with d58887e8291b4833c23c0f40ef23fc6adef16e01cb42322e0113aa233eae902a not found: ID does not exist"
Sep 17 17:52:28.197254 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.197204    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"]
Sep 17 17:52:28.201922 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.201902    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dfb277-7d594699bb-b5z7g"]
Sep 17 17:52:28.205672 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:52:28.205647    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba95f2e_7c90_4515_8dd4_c520a773a353.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cd31dd_e03c_4451_ae39_e4101a9814b5.slice/crio-bde18de2eb8342bd56e539a5276d14a02aa71b5a07380df715efaa2f6cc7ae4c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cd31dd_e03c_4451_ae39_e4101a9814b5.slice\": RecentStats: unable to find data in memory cache]"
Sep 17 17:52:28.207668 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.207652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:28.214063 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.214043    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"]
Sep 17 17:52:28.217781 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.217762    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-dfb277-567c889f47-8s4hf"]
Sep 17 17:52:28.399917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.399882    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba95f2e-7c90-4515-8dd4-c520a773a353" path="/var/lib/kubelet/pods/1ba95f2e-7c90-4515-8dd4-c520a773a353/volumes"
Sep 17 17:52:28.400309 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.400292    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51cd31dd-e03c-4451-ae39-e4101a9814b5" path="/var/lib/kubelet/pods/51cd31dd-e03c-4451-ae39-e4101a9814b5/volumes"
Sep 17 17:52:28.400643 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:28.400628    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6535bab8-80cb-4cb9-9584-50c719e9fb68" path="/var/lib/kubelet/pods/6535bab8-80cb-4cb9-9584-50c719e9fb68/volumes"
Sep 17 17:52:29.251639 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:29.251608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:30.658535 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:30.658494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:31.352057 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:31.352026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:31.831147 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:31.831109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:32.895576 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:32.895541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:33.912686 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:33.912653    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:34.439456 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:34.439427    2559 scope.go:117] "RemoveContainer" containerID="b6d90ab13e5ce79e657a5bcd2599c89b0e4e34c064a55fc83b5f0a360819a52c"
Sep 17 17:52:34.448207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:34.448187    2559 scope.go:117] "RemoveContainer" containerID="3744bb2db3f02d98e9c941f5b81d453b0f8cacf406731b4318b1da307769c2cf"
Sep 17 17:52:35.373111 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:35.373076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:35.502197 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:35.502170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:35.817110 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:35.817082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:35.982322 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:35.982292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:36.147282 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:36.147201    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:52:36.147282 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:36.147268    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:52:36.305622 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:36.305591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:36.407768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:36.407686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:36.748924 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:36.748893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:37.211829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:37.211725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:37.385039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:37.385007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:38.322831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:38.322802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:39.260411 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:39.260383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:39.602650 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:39.602555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:39.687751 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:39.687722    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:40.293527 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:40.293485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:41.407672 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:41.407635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:42.787267 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:42.787236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:43.570911 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.570871    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"]
Sep 17 17:52:43.571353 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.571334    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba95f2e-7c90-4515-8dd4-c520a773a353" containerName="payload-processing"
Sep 17 17:52:43.571448 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.571355    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba95f2e-7c90-4515-8dd4-c520a773a353" containerName="payload-processing"
Sep 17 17:52:43.571448 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.571372    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51cd31dd-e03c-4451-ae39-e4101a9814b5" containerName="payload-pre-processing"
Sep 17 17:52:43.571448 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.571379    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51cd31dd-e03c-4451-ae39-e4101a9814b5" containerName="payload-pre-processing"
Sep 17 17:52:43.571646 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.571510    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51cd31dd-e03c-4451-ae39-e4101a9814b5" containerName="payload-pre-processing"
Sep 17 17:52:43.571646 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.571556    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba95f2e-7c90-4515-8dd4-c520a773a353" containerName="payload-processing"
Sep 17 17:52:43.575975 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.575952    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.580695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.580675    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-abb363-dockercfg-ljzvd\""
Sep 17 17:52:43.580815 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.580712    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-abb363\""
Sep 17 17:52:43.600388 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.600366    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"]
Sep 17 17:52:43.682073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.682045    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lvcn\" (UniqueName: \"kubernetes.io/projected/2a961110-a788-401f-b2df-557d405f9749-kube-api-access-5lvcn\") pod \"payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.682196 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.682085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a961110-a788-401f-b2df-557d405f9749-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.710009 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.709977    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"]
Sep 17 17:52:43.712458 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.712439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:43.728826 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.728805    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"]
Sep 17 17:52:43.782796 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.782762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lvcn\" (UniqueName: \"kubernetes.io/projected/2a961110-a788-401f-b2df-557d405f9749-kube-api-access-5lvcn\") pod \"payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.782959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.782813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a961110-a788-401f-b2df-557d405f9749-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.782959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.782848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:43.782959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.782876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwpkh\" (UniqueName: \"kubernetes.io/projected/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-kube-api-access-wwpkh\") pod \"payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:43.783577 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.783560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a961110-a788-401f-b2df-557d405f9749-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.797461 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.797432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lvcn\" (UniqueName: \"kubernetes.io/projected/2a961110-a788-401f-b2df-557d405f9749-kube-api-access-5lvcn\") pod \"payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.883492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.883423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:43.883492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.883457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwpkh\" (UniqueName: \"kubernetes.io/projected/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-kube-api-access-wwpkh\") pod \"payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:43.884162 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.884143    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:43.886277 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.886260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:43.898706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:43.898685    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwpkh\" (UniqueName: \"kubernetes.io/projected/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-kube-api-access-wwpkh\") pod \"payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:44.022262 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.022230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:44.171000 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.170977    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"]
Sep 17 17:52:44.172597 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:52:44.172573    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a961110_a788_401f_b2df_557d405f9749.slice/crio-93fe225a00961f5f5eae301dae155dfd0588594575962ef1150b7357b9434844 WatchSource:0}: Error finding container 93fe225a00961f5f5eae301dae155dfd0588594575962ef1150b7357b9434844: Status 404 returned error can't find the container with id 93fe225a00961f5f5eae301dae155dfd0588594575962ef1150b7357b9434844
Sep 17 17:52:44.249502 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.249475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:44.268021 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.267990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh" event={"ID":"2a961110-a788-401f-b2df-557d405f9749","Type":"ContainerStarted","Data":"d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea"}
Sep 17 17:52:44.268126 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.268037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh" event={"ID":"2a961110-a788-401f-b2df-557d405f9749","Type":"ContainerStarted","Data":"93fe225a00961f5f5eae301dae155dfd0588594575962ef1150b7357b9434844"}
Sep 17 17:52:44.268168 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.268120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:44.326229 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:52:44.326201    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f15da8_e60e_459c_9b4c_70a1ed57bb84.slice/crio-ff431a5fec850ff7ce83db790d2359d088df8eee195e48aeb6dad831b2d6eed8 WatchSource:0}: Error finding container ff431a5fec850ff7ce83db790d2359d088df8eee195e48aeb6dad831b2d6eed8: Status 404 returned error can't find the container with id ff431a5fec850ff7ce83db790d2359d088df8eee195e48aeb6dad831b2d6eed8
Sep 17 17:52:44.328096 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.328070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"]
Sep 17 17:52:44.343286 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:44.343246    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh" podStartSLOduration=1.343230255 podStartE2EDuration="1.343230255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:44.34091831 +0000 UTC m=+1272.118755944" watchObservedRunningTime="2026-09-17 17:52:44.343230255 +0000 UTC m=+1272.121067890"
Sep 17 17:52:45.183655 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:45.183624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:45.276772 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:45.276736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn" event={"ID":"d4f15da8-e60e-459c-9b4c-70a1ed57bb84","Type":"ContainerStarted","Data":"6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f"}
Sep 17 17:52:45.276955 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:45.276795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn" event={"ID":"d4f15da8-e60e-459c-9b4c-70a1ed57bb84","Type":"ContainerStarted","Data":"ff431a5fec850ff7ce83db790d2359d088df8eee195e48aeb6dad831b2d6eed8"}
Sep 17 17:52:45.277017 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:45.276985    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:45.311971 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:45.311924    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn" podStartSLOduration=2.311910749 podStartE2EDuration="2.311910749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:45.31148643 +0000 UTC m=+1273.089324066" watchObservedRunningTime="2026-09-17 17:52:45.311910749 +0000 UTC m=+1273.089748383"
Sep 17 17:52:46.139867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:46.139834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:47.282563 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:47.282510    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:48.583971 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:48.583940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:55.279941 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:55.279909    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 17:52:56.285822 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:56.285796    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 17:52:56.581726 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:56.581643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:56.644151 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:56.644121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:52:58.443431 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:52:58.443400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:04.038287 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:04.038255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:06.496951 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:06.496922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:07.705150 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:07.705119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:07.947255 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:07.947213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:08.913980 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:08.913947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:09.694534 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:09.694482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:09.992163 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:09.992081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:10.217778 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:10.217743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:10.381185 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:10.381155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:10.598356 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:10.598323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:11.379374 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:11.379347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:12.737123 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:12.737099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:14.025375 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:14.025310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:14.143224 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:14.143188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:14.574935 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:14.574906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:15.352451 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:15.352421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:15.447706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:15.447672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:15.547726 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:15.547698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:16.159825 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.159789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:16.261705 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.261677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:16.298105 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.298070    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"]
Sep 17 17:53:16.303875 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.303852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.306917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.306897    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-7b7c8c\""
Sep 17 17:53:16.321265 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.321241    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"]
Sep 17 17:53:16.382039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.382010    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"]
Sep 17 17:53:16.385599 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.385582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.388661 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.388642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-7b7c8c-dockercfg-6l9dc\""
Sep 17 17:53:16.399114 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.399093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwsm2\" (UniqueName: \"kubernetes.io/projected/c7a77e26-909f-4441-bc2d-688997a9f192-kube-api-access-cwsm2\") pod \"payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.399208 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.399124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgs64\" (UniqueName: \"kubernetes.io/projected/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-kube-api-access-xgs64\") pod \"payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.399289 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.399268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a77e26-909f-4441-bc2d-688997a9f192-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.399338 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.399324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.402177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.402158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"]
Sep 17 17:53:16.500589 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.500562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.500736 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.500612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwsm2\" (UniqueName: \"kubernetes.io/projected/c7a77e26-909f-4441-bc2d-688997a9f192-kube-api-access-cwsm2\") pod \"payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.500736 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.500646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgs64\" (UniqueName: \"kubernetes.io/projected/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-kube-api-access-xgs64\") pod \"payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.500812 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.500757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a77e26-909f-4441-bc2d-688997a9f192-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.501384 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.501359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.501503 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.501480    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a77e26-909f-4441-bc2d-688997a9f192-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.512401 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.512377    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgs64\" (UniqueName: \"kubernetes.io/projected/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-kube-api-access-xgs64\") pod \"payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.515589 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.515505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwsm2\" (UniqueName: \"kubernetes.io/projected/c7a77e26-909f-4441-bc2d-688997a9f192-kube-api-access-cwsm2\") pod \"payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.614240 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.614209    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:16.696994 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.696748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:16.798505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.798476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:16.896674 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.896646    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"]
Sep 17 17:53:16.898199 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:53:16.898177    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a77e26_909f_4441_bc2d_688997a9f192.slice/crio-de3204d86bcd2d0b2df5dcb9da6250c76b7f543f218eac5707f3cf7395b5aa86 WatchSource:0}: Error finding container de3204d86bcd2d0b2df5dcb9da6250c76b7f543f218eac5707f3cf7395b5aa86: Status 404 returned error can't find the container with id de3204d86bcd2d0b2df5dcb9da6250c76b7f543f218eac5707f3cf7395b5aa86
Sep 17 17:53:16.988959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:16.988938    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"]
Sep 17 17:53:16.991739 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:53:16.991714    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4ba3bb_f94e_426d_a76b_24b914f5a7f0.slice/crio-7138d08625890be86a07f661c78aa92b73a1e9b542a1763a057c58bf1b1e9ee7 WatchSource:0}: Error finding container 7138d08625890be86a07f661c78aa92b73a1e9b542a1763a057c58bf1b1e9ee7: Status 404 returned error can't find the container with id 7138d08625890be86a07f661c78aa92b73a1e9b542a1763a057c58bf1b1e9ee7
Sep 17 17:53:17.483413 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.483319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2" event={"ID":"c7a77e26-909f-4441-bc2d-688997a9f192","Type":"ContainerStarted","Data":"003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738"}
Sep 17 17:53:17.483413 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.483379    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:17.483413 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.483401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2" event={"ID":"c7a77e26-909f-4441-bc2d-688997a9f192","Type":"ContainerStarted","Data":"de3204d86bcd2d0b2df5dcb9da6250c76b7f543f218eac5707f3cf7395b5aa86"}
Sep 17 17:53:17.485325 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.485292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s" event={"ID":"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0","Type":"ContainerStarted","Data":"e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec"}
Sep 17 17:53:17.485464 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.485392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:17.485464 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.485410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s" event={"ID":"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0","Type":"ContainerStarted","Data":"7138d08625890be86a07f661c78aa92b73a1e9b542a1763a057c58bf1b1e9ee7"}
Sep 17 17:53:17.525184 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.525138    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2" podStartSLOduration=1.5251245180000002 podStartE2EDuration="1.525124518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:53:17.512570865 +0000 UTC m=+1305.290408496" watchObservedRunningTime="2026-09-17 17:53:17.525124518 +0000 UTC m=+1305.302962151"
Sep 17 17:53:17.609489 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:17.609425    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s" podStartSLOduration=1.609402986 podStartE2EDuration="1.609402986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:53:17.60092121 +0000 UTC m=+1305.378758843" watchObservedRunningTime="2026-09-17 17:53:17.609402986 +0000 UTC m=+1305.387240628"
Sep 17 17:53:18.711683 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:18.711647    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:19.571298 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:19.571271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:20.627873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:20.627831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:21.510433 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:21.510405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:22.371688 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:22.371654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:23.200393 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:23.200364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:24.704772 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:24.704738    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:26.216170 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:26.216140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:27.325951 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:27.325918    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:28.494242 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:28.494213    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 17:53:28.494663 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:28.494275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 17:53:28.524389 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:28.524364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:28.750608 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:28.750562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:29.803149 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:29.803115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:30.820667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:30.820633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:32.294706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:32.294673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:33.135505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:33.135470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:34.503152 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:34.503118    2559 scope.go:117] "RemoveContainer" containerID="a7bad071fb43aaf98a7a47887d05e4e82796c04f4b36c635b49ea65e4800f9f6"
Sep 17 17:53:34.514735 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:34.514714    2559 scope.go:117] "RemoveContainer" containerID="b87b245100fd7ceaa9c48d219ecb5b16c29d3cbeb27f809f669130e0565df9ee"
Sep 17 17:53:41.839754 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:53:41.839720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:05.986727 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:05.986646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:15.360321 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:15.360286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:22.992049 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:22.992009    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:33.488561 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:33.488498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:34.542347 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:34.542315    2559 scope.go:117] "RemoveContainer" containerID="dfab61949229d23a31c085a7d64ec4951c63d144e492f1e27673a733fad62c56"
Sep 17 17:54:38.758161 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.758122    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"]
Sep 17 17:54:38.762987 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.762971    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"
Sep 17 17:54:38.765814 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.765789    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:54:38.765958 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.765938    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:54:38.773251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.773226    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"]
Sep 17 17:54:38.878412 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.878381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b086dee5-eca3-4841-9762-af63e56ff537-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f9224635-pq25f\" (UID: \"b086dee5-eca3-4841-9762-af63e56ff537\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"
Sep 17 17:54:38.979221 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.979177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b086dee5-eca3-4841-9762-af63e56ff537-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f9224635-pq25f\" (UID: \"b086dee5-eca3-4841-9762-af63e56ff537\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"
Sep 17 17:54:38.979829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:38.979808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b086dee5-eca3-4841-9762-af63e56ff537-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f9224635-pq25f\" (UID: \"b086dee5-eca3-4841-9762-af63e56ff537\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"
Sep 17 17:54:39.076191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:39.076109    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"
Sep 17 17:54:39.091503 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:39.091479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:39.366171 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:39.366139    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"]
Sep 17 17:54:39.367843 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:54:39.367816    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb086dee5_eca3_4841_9762_af63e56ff537.slice/crio-3311612f2972fc65d8a441394703fb87b8605d73803ccf9917c15526fbd2a294 WatchSource:0}: Error finding container 3311612f2972fc65d8a441394703fb87b8605d73803ccf9917c15526fbd2a294: Status 404 returned error can't find the container with id 3311612f2972fc65d8a441394703fb87b8605d73803ccf9917c15526fbd2a294
Sep 17 17:54:39.998751 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:39.998716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f" event={"ID":"b086dee5-eca3-4841-9762-af63e56ff537","Type":"ContainerStarted","Data":"12ee3f18d104afd1443a56d0f1669ea6f7520473495fea54dd8f8573a7171090"}
Sep 17 17:54:39.999130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:39.998777    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f" event={"ID":"b086dee5-eca3-4841-9762-af63e56ff537","Type":"ContainerStarted","Data":"3311612f2972fc65d8a441394703fb87b8605d73803ccf9917c15526fbd2a294"}
Sep 17 17:54:40.011728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:40.011699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:40.023745 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:40.023704    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f" podStartSLOduration=2.023691848 podStartE2EDuration="2.023691848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:54:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:54:40.021920261 +0000 UTC m=+1387.799757895" watchObservedRunningTime="2026-09-17 17:54:40.023691848 +0000 UTC m=+1387.801529483"
Sep 17 17:54:40.919639 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:40.919610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:41.006274 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:41.006242    2559 generic.go:356] "Generic (PLEG): container finished" podID="b086dee5-eca3-4841-9762-af63e56ff537" containerID="12ee3f18d104afd1443a56d0f1669ea6f7520473495fea54dd8f8573a7171090" exitCode=0
Sep 17 17:54:41.006680 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:41.006319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f" event={"ID":"b086dee5-eca3-4841-9762-af63e56ff537","Type":"ContainerDied","Data":"12ee3f18d104afd1443a56d0f1669ea6f7520473495fea54dd8f8573a7171090"}
Sep 17 17:54:42.059303 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:42.059274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:42.155775 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:42.155743    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"
Sep 17 17:54:42.310485 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:42.310406    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b086dee5-eca3-4841-9762-af63e56ff537-maas-api-service-ca\") pod \"b086dee5-eca3-4841-9762-af63e56ff537\" (UID: \"b086dee5-eca3-4841-9762-af63e56ff537\") "
Sep 17 17:54:42.310714 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:42.310692    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b086dee5-eca3-4841-9762-af63e56ff537-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b086dee5-eca3-4841-9762-af63e56ff537" (UID: "b086dee5-eca3-4841-9762-af63e56ff537"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:54:42.411412 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:42.411387    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b086dee5-eca3-4841-9762-af63e56ff537-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:54:42.900496 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:42.900464    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:43.019789 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:43.019763    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"
Sep 17 17:54:43.019959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:43.019807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f" event={"ID":"b086dee5-eca3-4841-9762-af63e56ff537","Type":"ContainerDied","Data":"3311612f2972fc65d8a441394703fb87b8605d73803ccf9917c15526fbd2a294"}
Sep 17 17:54:43.019959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:43.019858    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3311612f2972fc65d8a441394703fb87b8605d73803ccf9917c15526fbd2a294"
Sep 17 17:54:43.984343 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:43.984297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:45.205861 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:45.205826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:46.237274 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:46.237242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:47.045703 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:47.045659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:54.623987 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.623955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:54.687564 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.687512    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"]
Sep 17 17:54:54.688251 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.688193    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n" podUID="48a15bad-c064-4097-b555-ff112a7b777a" containerName="payload-processing" containerID="cri-o://c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb" gracePeriod=30
Sep 17 17:54:54.693504 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.693476    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"]
Sep 17 17:54:54.693735 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.693705    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j" podUID="9589ca9d-adff-4397-a4f5-96de77f8c058" containerName="payload-pre-processing" containerID="cri-o://de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5" gracePeriod=30
Sep 17 17:54:54.724988 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.724960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:54.831093 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.829046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:54.912926 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.912885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:54.947326 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.947299    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:54:54.975492 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.975467    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:54:54.991315 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.991287    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"]
Sep 17 17:54:54.999013 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:54.998986    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f9224635-pq25f"]
Sep 17 17:54:55.020252 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.020230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:55.028151 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.028125    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9589ca9d-adff-4397-a4f5-96de77f8c058-plugins-config-volume\") pod \"9589ca9d-adff-4397-a4f5-96de77f8c058\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") "
Sep 17 17:54:55.028281 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.028189    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chng5\" (UniqueName: \"kubernetes.io/projected/48a15bad-c064-4097-b555-ff112a7b777a-kube-api-access-chng5\") pod \"48a15bad-c064-4097-b555-ff112a7b777a\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") "
Sep 17 17:54:55.028281 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.028254    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a15bad-c064-4097-b555-ff112a7b777a-plugins-config-volume\") pod \"48a15bad-c064-4097-b555-ff112a7b777a\" (UID: \"48a15bad-c064-4097-b555-ff112a7b777a\") "
Sep 17 17:54:55.028385 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.028364    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phmhq\" (UniqueName: \"kubernetes.io/projected/9589ca9d-adff-4397-a4f5-96de77f8c058-kube-api-access-phmhq\") pod \"9589ca9d-adff-4397-a4f5-96de77f8c058\" (UID: \"9589ca9d-adff-4397-a4f5-96de77f8c058\") "
Sep 17 17:54:55.028651 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.028560    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9589ca9d-adff-4397-a4f5-96de77f8c058-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9589ca9d-adff-4397-a4f5-96de77f8c058" (UID: "9589ca9d-adff-4397-a4f5-96de77f8c058"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:54:55.028777 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.028745    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a15bad-c064-4097-b555-ff112a7b777a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48a15bad-c064-4097-b555-ff112a7b777a" (UID: "48a15bad-c064-4097-b555-ff112a7b777a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:54:55.030497 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.030471    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9589ca9d-adff-4397-a4f5-96de77f8c058-kube-api-access-phmhq" (OuterVolumeSpecName: "kube-api-access-phmhq") pod "9589ca9d-adff-4397-a4f5-96de77f8c058" (UID: "9589ca9d-adff-4397-a4f5-96de77f8c058"). InnerVolumeSpecName "kube-api-access-phmhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:54:55.030583 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.030510    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a15bad-c064-4097-b555-ff112a7b777a-kube-api-access-chng5" (OuterVolumeSpecName: "kube-api-access-chng5") pod "48a15bad-c064-4097-b555-ff112a7b777a" (UID: "48a15bad-c064-4097-b555-ff112a7b777a"). InnerVolumeSpecName "kube-api-access-chng5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:54:55.098172 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.098141    2559 generic.go:356] "Generic (PLEG): container finished" podID="9589ca9d-adff-4397-a4f5-96de77f8c058" containerID="de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5" exitCode=0
Sep 17 17:54:55.098291 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.098188    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"
Sep 17 17:54:55.098291 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.098223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j" event={"ID":"9589ca9d-adff-4397-a4f5-96de77f8c058","Type":"ContainerDied","Data":"de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5"}
Sep 17 17:54:55.098291 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.098275    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j" event={"ID":"9589ca9d-adff-4397-a4f5-96de77f8c058","Type":"ContainerDied","Data":"625e7bee5cbedc930b9c744c5ad91b3c21066f4e6bb6ea186afa865d4cc92e21"}
Sep 17 17:54:55.098396 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.098300    2559 scope.go:117] "RemoveContainer" containerID="de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5"
Sep 17 17:54:55.099877 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.099853    2559 generic.go:356] "Generic (PLEG): container finished" podID="48a15bad-c064-4097-b555-ff112a7b777a" containerID="c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb" exitCode=0
Sep 17 17:54:55.099989 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.099903    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"
Sep 17 17:54:55.100054 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.099903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n" event={"ID":"48a15bad-c064-4097-b555-ff112a7b777a","Type":"ContainerDied","Data":"c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb"}
Sep 17 17:54:55.100054 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.100030    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n" event={"ID":"48a15bad-c064-4097-b555-ff112a7b777a","Type":"ContainerDied","Data":"6439361611b87a0e6d9e8998a923a73f59aac02e54b0cdffc5814850e886e32b"}
Sep 17 17:54:55.108858 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.108841    2559 scope.go:117] "RemoveContainer" containerID="de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5"
Sep 17 17:54:55.109279 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:54:55.109124    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5\": container with ID starting with de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5 not found: ID does not exist" containerID="de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5"
Sep 17 17:54:55.109279 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.109147    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5"} err="failed to get container status \"de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5\": rpc error: code = NotFound desc = could not find container \"de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5\": container with ID starting with de476a00c3a345f5cb5243517f12cc56ee6c43494230abbab12f2b98a6fd97e5 not found: ID does not exist"
Sep 17 17:54:55.109279 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.109163    2559 scope.go:117] "RemoveContainer" containerID="c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb"
Sep 17 17:54:55.117509 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.117495    2559 scope.go:117] "RemoveContainer" containerID="c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb"
Sep 17 17:54:55.117802 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:54:55.117782    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb\": container with ID starting with c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb not found: ID does not exist" containerID="c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb"
Sep 17 17:54:55.117886 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.117806    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb"} err="failed to get container status \"c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb\": rpc error: code = NotFound desc = could not find container \"c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb\": container with ID starting with c5e1b2d2203ca3af39cc8225272c8cb0dccb5e172fef2d85fae43d21b173ccbb not found: ID does not exist"
Sep 17 17:54:55.129444 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.129425    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phmhq\" (UniqueName: \"kubernetes.io/projected/9589ca9d-adff-4397-a4f5-96de77f8c058-kube-api-access-phmhq\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:54:55.129444 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.129445    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9589ca9d-adff-4397-a4f5-96de77f8c058-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:54:55.129574 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.129455    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chng5\" (UniqueName: \"kubernetes.io/projected/48a15bad-c064-4097-b555-ff112a7b777a-kube-api-access-chng5\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:54:55.129574 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.129467    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a15bad-c064-4097-b555-ff112a7b777a-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:54:55.151807 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.151757    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"]
Sep 17 17:54:55.155712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.155690    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f9224635-b9dbbdb9d-v8l4j"]
Sep 17 17:54:55.174590 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.174571    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"]
Sep 17 17:54:55.180658 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.180638    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f9224635-bf7687bd5-44b5n"]
Sep 17 17:54:55.452709 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:55.452611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:56.400552 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:56.400500    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a15bad-c064-4097-b555-ff112a7b777a" path="/var/lib/kubelet/pods/48a15bad-c064-4097-b555-ff112a7b777a/volumes"
Sep 17 17:54:56.400925 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:56.400897    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9589ca9d-adff-4397-a4f5-96de77f8c058" path="/var/lib/kubelet/pods/9589ca9d-adff-4397-a4f5-96de77f8c058/volumes"
Sep 17 17:54:56.401190 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:56.401177    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b086dee5-eca3-4841-9762-af63e56ff537" path="/var/lib/kubelet/pods/b086dee5-eca3-4841-9762-af63e56ff537/volumes"
Sep 17 17:54:57.042490 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:57.042457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:57.848304 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:57.848266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:58.228562 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:58.228468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:58.874908 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:58.874879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:59.738535 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:54:59.738484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:00.650645 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:00.650606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:01.483654 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:01.483610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:01.680580 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:01.680538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:01.781708 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:01.781669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:03.315648 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:03.315621    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:11.026356 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:11.026320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:37.974990 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:37.974946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:38.866888 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:38.866852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:39.166551 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:39.166449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:41.633886 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:41.633856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:41.928885 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:41.928798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:49.321697 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:49.321648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:49.395461 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:49.395433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:49.606894 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:49.606799    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:50.906390 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:50.906351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:51.003544 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:51.003484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:51.109247 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:51.109203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:51.783254 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:51.783226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:51.887833 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:51.887802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:53.359065 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:53.359015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:59.888385 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:59.888333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:55:59.990204 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:55:59.990166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:00.595332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:00.595299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:01.557556 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:01.557504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:04.818208 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:04.818179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:04.918973 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:04.918938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:05.338669 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:05.338623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:07.085667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:07.085636    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:07.200141 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:07.200112    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:07.282539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:07.282472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:17.778026 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:17.777992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:17.999735 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:17.999709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:22.821710 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:22.821670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:34.454841 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:34.454816    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:56:34.461863 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:34.461842    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 17:56:34.587639 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:34.587608    2559 scope.go:117] "RemoveContainer" containerID="be2e4bfd8ff5be187b61d59a17122828e409ba21427e0ee5f52630477e276ed0"
Sep 17 17:56:34.596814 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:34.596792    2559 scope.go:117] "RemoveContainer" containerID="1ffd6350fd338043d53ea260eb710817b4ad9f4b5361c64ad15b823fa85eafe5"
Sep 17 17:56:39.015419 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:39.015383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:47.919383 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:47.919295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:48.029286 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:48.029241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:48.299412 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:48.299386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:48.811342 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:48.811310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:48.970627 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:48.970597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:51.746722 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:51.746695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:52.399322 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:52.399293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:52.624454 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:52.624424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:52.810924 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:52.810896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:54.185631 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:54.185596    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:56.231173 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:56.231146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:57.650054 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:57.650024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:56:58.935182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:56:58.935150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:00.203340 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:00.203310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:01.409688 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:01.409658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:02.655712 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:02.655678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:02.755817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:02.755789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:02.865364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:02.865339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:03.719208 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:03.719181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:03.918258 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:03.918200    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:04.091707 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.091680    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"]
Sep 17 17:57:04.092207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092180    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b086dee5-eca3-4841-9762-af63e56ff537" containerName="revoke-keys"
Sep 17 17:57:04.092207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092202    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b086dee5-eca3-4841-9762-af63e56ff537" containerName="revoke-keys"
Sep 17 17:57:04.092207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092213    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9589ca9d-adff-4397-a4f5-96de77f8c058" containerName="payload-pre-processing"
Sep 17 17:57:04.092406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092219    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9589ca9d-adff-4397-a4f5-96de77f8c058" containerName="payload-pre-processing"
Sep 17 17:57:04.092406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092229    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a15bad-c064-4097-b555-ff112a7b777a" containerName="payload-processing"
Sep 17 17:57:04.092406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092235    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a15bad-c064-4097-b555-ff112a7b777a" containerName="payload-processing"
Sep 17 17:57:04.092406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092320    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b086dee5-eca3-4841-9762-af63e56ff537" containerName="revoke-keys"
Sep 17 17:57:04.092406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092334    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9589ca9d-adff-4397-a4f5-96de77f8c058" containerName="payload-pre-processing"
Sep 17 17:57:04.092406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.092348    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="48a15bad-c064-4097-b555-ff112a7b777a" containerName="payload-processing"
Sep 17 17:57:04.095706 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.095687    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.103722 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.103702    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-ab64d6\""
Sep 17 17:57:04.117212 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.117185    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"]
Sep 17 17:57:04.199719 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.199685    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"]
Sep 17 17:57:04.203467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.203451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.213092 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.213072    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-ab64d6-dockercfg-c7rpt\""
Sep 17 17:57:04.225821 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.225797    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"]
Sep 17 17:57:04.238824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.238801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60ef853-ad3e-4c75-824c-79f75c485a5a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.238917 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.238827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnffr\" (UniqueName: \"kubernetes.io/projected/c60ef853-ad3e-4c75-824c-79f75c485a5a-kube-api-access-pnffr\") pod \"payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.339976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.339940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgbxn\" (UniqueName: \"kubernetes.io/projected/8b9594e5-668a-495c-ad93-40c4c7a76e7d-kube-api-access-pgbxn\") pod \"payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.340138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.340051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9594e5-668a-495c-ad93-40c4c7a76e7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.340138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.340087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60ef853-ad3e-4c75-824c-79f75c485a5a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.340138 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.340111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnffr\" (UniqueName: \"kubernetes.io/projected/c60ef853-ad3e-4c75-824c-79f75c485a5a-kube-api-access-pnffr\") pod \"payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.340735 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.340718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60ef853-ad3e-4c75-824c-79f75c485a5a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.355473 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.355429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnffr\" (UniqueName: \"kubernetes.io/projected/c60ef853-ad3e-4c75-824c-79f75c485a5a-kube-api-access-pnffr\") pod \"payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.407055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.407027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.441603 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.441571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9594e5-668a-495c-ad93-40c4c7a76e7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.441738 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.441644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgbxn\" (UniqueName: \"kubernetes.io/projected/8b9594e5-668a-495c-ad93-40c4c7a76e7d-kube-api-access-pgbxn\") pod \"payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.442294 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.442270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9594e5-668a-495c-ad93-40c4c7a76e7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.457039 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.456475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgbxn\" (UniqueName: \"kubernetes.io/projected/8b9594e5-668a-495c-ad93-40c4c7a76e7d-kube-api-access-pgbxn\") pod \"payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.514098 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.514068    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:04.694925 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:57:04.694897    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60ef853_ad3e_4c75_824c_79f75c485a5a.slice/crio-8f3c68621dcb4754cbb8353803ec96cfe32ebd6dd09b2ff10117e525d90fa3d5 WatchSource:0}: Error finding container 8f3c68621dcb4754cbb8353803ec96cfe32ebd6dd09b2ff10117e525d90fa3d5: Status 404 returned error can't find the container with id 8f3c68621dcb4754cbb8353803ec96cfe32ebd6dd09b2ff10117e525d90fa3d5
Sep 17 17:57:04.706229 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.706143    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"]
Sep 17 17:57:04.813332 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.813295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:04.832955 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.832930    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"]
Sep 17 17:57:04.834839 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:57:04.834814    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9594e5_668a_495c_ad93_40c4c7a76e7d.slice/crio-e89419b9e5b485a727894c24f55dffb85d39f050a00b0ee86b3b9fbd23f65497 WatchSource:0}: Error finding container e89419b9e5b485a727894c24f55dffb85d39f050a00b0ee86b3b9fbd23f65497: Status 404 returned error can't find the container with id e89419b9e5b485a727894c24f55dffb85d39f050a00b0ee86b3b9fbd23f65497
Sep 17 17:57:04.886960 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.886909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w" event={"ID":"8b9594e5-668a-495c-ad93-40c4c7a76e7d","Type":"ContainerStarted","Data":"e89419b9e5b485a727894c24f55dffb85d39f050a00b0ee86b3b9fbd23f65497"}
Sep 17 17:57:04.888599 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.888578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4" event={"ID":"c60ef853-ad3e-4c75-824c-79f75c485a5a","Type":"ContainerStarted","Data":"c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f"}
Sep 17 17:57:04.888711 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.888616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4" event={"ID":"c60ef853-ad3e-4c75-824c-79f75c485a5a","Type":"ContainerStarted","Data":"8f3c68621dcb4754cbb8353803ec96cfe32ebd6dd09b2ff10117e525d90fa3d5"}
Sep 17 17:57:04.888711 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.888647    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:04.965761 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:04.965656    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4" podStartSLOduration=0.965639608 podStartE2EDuration="965.639608ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:04.964840442 +0000 UTC m=+1532.742678077" watchObservedRunningTime="2026-09-17 17:57:04.965639608 +0000 UTC m=+1532.743477242"
Sep 17 17:57:05.898092 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:05.898058    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w" event={"ID":"8b9594e5-668a-495c-ad93-40c4c7a76e7d","Type":"ContainerStarted","Data":"30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b"}
Sep 17 17:57:05.898542 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:05.898284    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:05.932698 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:05.932652    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w" podStartSLOduration=1.932637158 podStartE2EDuration="1.932637158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:05.931139706 +0000 UTC m=+1533.708977345" watchObservedRunningTime="2026-09-17 17:57:05.932637158 +0000 UTC m=+1533.710474793"
Sep 17 17:57:06.435611 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:06.435574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:08.479891 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.479855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:08.597978 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.597947    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"]
Sep 17 17:57:08.601695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.601680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"
Sep 17 17:57:08.606288 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.606266    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:57:08.606288 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.606267    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:57:08.614639 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.614616    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"]
Sep 17 17:57:08.684987 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.684959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bc2d1de-a3ae-4d25-96fd-9a2740348b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5\" (UID: \"8bc2d1de-a3ae-4d25-96fd-9a2740348b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"
Sep 17 17:57:08.785808 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.785787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bc2d1de-a3ae-4d25-96fd-9a2740348b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5\" (UID: \"8bc2d1de-a3ae-4d25-96fd-9a2740348b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"
Sep 17 17:57:08.786369 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.786352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bc2d1de-a3ae-4d25-96fd-9a2740348b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5\" (UID: \"8bc2d1de-a3ae-4d25-96fd-9a2740348b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"
Sep 17 17:57:08.913270 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:08.913246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"
Sep 17 17:57:09.008441 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:09.008406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:09.228777 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:09.228751    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"]
Sep 17 17:57:09.230389 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:57:09.230364    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc2d1de_a3ae_4d25_96fd_9a2740348b55.slice/crio-826a9599411dca376467e0484de6a6f89b4fbd1217ededc2d56e6004eaa18384 WatchSource:0}: Error finding container 826a9599411dca376467e0484de6a6f89b4fbd1217ededc2d56e6004eaa18384: Status 404 returned error can't find the container with id 826a9599411dca376467e0484de6a6f89b4fbd1217ededc2d56e6004eaa18384
Sep 17 17:57:09.924684 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:09.924606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5" event={"ID":"8bc2d1de-a3ae-4d25-96fd-9a2740348b55","Type":"ContainerStarted","Data":"c75a6db30db5fdf56b8bd48178958f8e8aa1aaa8fbb92c9195cb92e7763b6af5"}
Sep 17 17:57:09.925020 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:09.924694    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5" event={"ID":"8bc2d1de-a3ae-4d25-96fd-9a2740348b55","Type":"ContainerStarted","Data":"826a9599411dca376467e0484de6a6f89b4fbd1217ededc2d56e6004eaa18384"}
Sep 17 17:57:09.968024 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:09.967978    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5" podStartSLOduration=1.967965279 podStartE2EDuration="1.967965279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:09.964598812 +0000 UTC m=+1537.742436448" watchObservedRunningTime="2026-09-17 17:57:09.967965279 +0000 UTC m=+1537.745802914"
Sep 17 17:57:10.932632 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:10.932589    2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc2d1de-a3ae-4d25-96fd-9a2740348b55" containerID="c75a6db30db5fdf56b8bd48178958f8e8aa1aaa8fbb92c9195cb92e7763b6af5" exitCode=0
Sep 17 17:57:10.933073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:10.932636    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5" event={"ID":"8bc2d1de-a3ae-4d25-96fd-9a2740348b55","Type":"ContainerDied","Data":"c75a6db30db5fdf56b8bd48178958f8e8aa1aaa8fbb92c9195cb92e7763b6af5"}
Sep 17 17:57:11.124089 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:11.124053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:11.222341 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:11.222245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:11.389640 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:11.389605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:12.068786 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.068765    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"
Sep 17 17:57:12.220939 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.220858    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bc2d1de-a3ae-4d25-96fd-9a2740348b55-maas-api-service-ca\") pod \"8bc2d1de-a3ae-4d25-96fd-9a2740348b55\" (UID: \"8bc2d1de-a3ae-4d25-96fd-9a2740348b55\") "
Sep 17 17:57:12.221229 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.221207    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc2d1de-a3ae-4d25-96fd-9a2740348b55-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8bc2d1de-a3ae-4d25-96fd-9a2740348b55" (UID: "8bc2d1de-a3ae-4d25-96fd-9a2740348b55"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:12.286976 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.286947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:12.322472 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.322442    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bc2d1de-a3ae-4d25-96fd-9a2740348b55-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:12.945191 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.945159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5" event={"ID":"8bc2d1de-a3ae-4d25-96fd-9a2740348b55","Type":"ContainerDied","Data":"826a9599411dca376467e0484de6a6f89b4fbd1217ededc2d56e6004eaa18384"}
Sep 17 17:57:12.945339 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.945210    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="826a9599411dca376467e0484de6a6f89b4fbd1217ededc2d56e6004eaa18384"
Sep 17 17:57:12.945339 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:12.945164    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"
Sep 17 17:57:13.293463 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:13.293430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:13.617729 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:13.617651    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"]
Sep 17 17:57:13.708418 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:13.708389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:14.368568 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:14.368536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:15.789328 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:15.789297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:15.901224 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:15.901194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:57:16.758578 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:16.758546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:16.907456 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:16.907427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:57:17.188611 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:17.188506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:17.651665 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:17.651635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:18.118572 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:18.118536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:18.494882 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:18.494794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:18.866570 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:18.866536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:19.967834 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:19.967798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:21.592654 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:21.592624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:21.718667 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:21.718634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:23.705192 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:23.705159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:25.108346 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:25.108321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:26.113446 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:26.113410    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:27.297469 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:27.297440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:28.445018 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.444989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:28.637481 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.637443    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2" podUID="f1003b54-0b60-4884-a142-e5ddb6e456ac" containerName="main" containerID="cri-o://bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2" gracePeriod=45
Sep 17 17:57:28.722773 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.722699    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2" podUID="f1003b54-0b60-4884-a142-e5ddb6e456ac" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": dial tcp 10.134.0.52:8000: connect: connection refused"
Sep 17 17:57:28.905057 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.905026    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:57:28.984959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.984882    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-tmp-dir\") pod \"f1003b54-0b60-4884-a142-e5ddb6e456ac\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") "
Sep 17 17:57:28.984959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.984936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-dshm\") pod \"f1003b54-0b60-4884-a142-e5ddb6e456ac\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") "
Sep 17 17:57:28.985156 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985010    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1003b54-0b60-4884-a142-e5ddb6e456ac-tls-certs\") pod \"f1003b54-0b60-4884-a142-e5ddb6e456ac\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") "
Sep 17 17:57:28.985156 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985063    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-model-cache\") pod \"f1003b54-0b60-4884-a142-e5ddb6e456ac\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") "
Sep 17 17:57:28.985156 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985105    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzvw8\" (UniqueName: \"kubernetes.io/projected/f1003b54-0b60-4884-a142-e5ddb6e456ac-kube-api-access-xzvw8\") pod \"f1003b54-0b60-4884-a142-e5ddb6e456ac\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") "
Sep 17 17:57:28.985314 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985157    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-home\") pod \"f1003b54-0b60-4884-a142-e5ddb6e456ac\" (UID: \"f1003b54-0b60-4884-a142-e5ddb6e456ac\") "
Sep 17 17:57:28.985314 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985168    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f1003b54-0b60-4884-a142-e5ddb6e456ac" (UID: "f1003b54-0b60-4884-a142-e5ddb6e456ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.985437 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985368    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "f1003b54-0b60-4884-a142-e5ddb6e456ac" (UID: "f1003b54-0b60-4884-a142-e5ddb6e456ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.985437 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985388    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-home" (OuterVolumeSpecName: "home") pod "f1003b54-0b60-4884-a142-e5ddb6e456ac" (UID: "f1003b54-0b60-4884-a142-e5ddb6e456ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.985698 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985673    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.985698 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985698    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.985891 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.985710    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:28.987558 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.987529    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-dshm" (OuterVolumeSpecName: "dshm") pod "f1003b54-0b60-4884-a142-e5ddb6e456ac" (UID: "f1003b54-0b60-4884-a142-e5ddb6e456ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:28.987718 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.987683    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1003b54-0b60-4884-a142-e5ddb6e456ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f1003b54-0b60-4884-a142-e5ddb6e456ac" (UID: "f1003b54-0b60-4884-a142-e5ddb6e456ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:57:28.987802 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:28.987779    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1003b54-0b60-4884-a142-e5ddb6e456ac-kube-api-access-xzvw8" (OuterVolumeSpecName: "kube-api-access-xzvw8") pod "f1003b54-0b60-4884-a142-e5ddb6e456ac" (UID: "f1003b54-0b60-4884-a142-e5ddb6e456ac"). InnerVolumeSpecName "kube-api-access-xzvw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:29.059901 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.059862    2559 generic.go:356] "Generic (PLEG): container finished" podID="f1003b54-0b60-4884-a142-e5ddb6e456ac" containerID="bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2" exitCode=0
Sep 17 17:57:29.060055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.059909    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"
Sep 17 17:57:29.060055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.059935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2" event={"ID":"f1003b54-0b60-4884-a142-e5ddb6e456ac","Type":"ContainerDied","Data":"bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2"}
Sep 17 17:57:29.060055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.059984    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2" event={"ID":"f1003b54-0b60-4884-a142-e5ddb6e456ac","Type":"ContainerDied","Data":"6fe42ce41443ca36ca4057be102197495247e62c56bb8a9203a3ade8cd85d407"}
Sep 17 17:57:29.060055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.060006    2559 scope.go:117] "RemoveContainer" containerID="bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2"
Sep 17 17:57:29.070377 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.070360    2559 scope.go:117] "RemoveContainer" containerID="bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2"
Sep 17 17:57:29.070683 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:57:29.070665    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2\": container with ID starting with bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2 not found: ID does not exist" containerID="bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2"
Sep 17 17:57:29.070735 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.070693    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2"} err="failed to get container status \"bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2\": rpc error: code = NotFound desc = could not find container \"bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2\": container with ID starting with bd72a18accc50d49847c37e09ee19b8c42b1492cb4d9e1b83b3e152db637a9e2 not found: ID does not exist"
Sep 17 17:57:29.086513 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.086489    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1003b54-0b60-4884-a142-e5ddb6e456ac-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:29.086631 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.086510    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzvw8\" (UniqueName: \"kubernetes.io/projected/f1003b54-0b60-4884-a142-e5ddb6e456ac-kube-api-access-xzvw8\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:29.086631 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.086542    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1003b54-0b60-4884-a142-e5ddb6e456ac-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:29.088045 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.088026    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"]
Sep 17 17:57:29.092681 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.092661    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-db7813/simulator-w0-db7813-kserve-6d6576b854-dzqp2"]
Sep 17 17:57:29.646574 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.646547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:29.726676 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.726646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:29.808902 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:29.808868    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.397164 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.397135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.399814 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.399791    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1003b54-0b60-4884-a142-e5ddb6e456ac" path="/var/lib/kubelet/pods/f1003b54-0b60-4884-a142-e5ddb6e456ac/volumes"
Sep 17 17:57:30.492913 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.492878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.687064 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.686983    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"]
Sep 17 17:57:30.687639 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.687619    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc2d1de-a3ae-4d25-96fd-9a2740348b55" containerName="revoke-keys"
Sep 17 17:57:30.687728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.687642    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc2d1de-a3ae-4d25-96fd-9a2740348b55" containerName="revoke-keys"
Sep 17 17:57:30.687728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.687665    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1003b54-0b60-4884-a142-e5ddb6e456ac" containerName="main"
Sep 17 17:57:30.687728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.687673    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1003b54-0b60-4884-a142-e5ddb6e456ac" containerName="main"
Sep 17 17:57:30.687885 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.687784    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1003b54-0b60-4884-a142-e5ddb6e456ac" containerName="main"
Sep 17 17:57:30.687885 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.687798    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc2d1de-a3ae-4d25-96fd-9a2740348b55" containerName="revoke-keys"
Sep 17 17:57:30.692117 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.692095    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:30.695343 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.695327    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-08f4f7\""
Sep 17 17:57:30.695418 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.695376    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-08f4f7-dockercfg-cdzjc\""
Sep 17 17:57:30.708649 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.708624    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"]
Sep 17 17:57:30.803170 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.803140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ebf4c76-0d1a-4f77-87f2-180601a19169-plugins-config-volume\") pod \"payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") " pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:30.803351 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.803190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtnjr\" (UniqueName: \"kubernetes.io/projected/1ebf4c76-0d1a-4f77-87f2-180601a19169-kube-api-access-wtnjr\") pod \"payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") " pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:30.904220 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.904184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ebf4c76-0d1a-4f77-87f2-180601a19169-plugins-config-volume\") pod \"payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") " pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:30.904400 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.904233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtnjr\" (UniqueName: \"kubernetes.io/projected/1ebf4c76-0d1a-4f77-87f2-180601a19169-kube-api-access-wtnjr\") pod \"payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") " pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:30.904972 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.904948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ebf4c76-0d1a-4f77-87f2-180601a19169-plugins-config-volume\") pod \"payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") " pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:30.913497 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:30.913474    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtnjr\" (UniqueName: \"kubernetes.io/projected/1ebf4c76-0d1a-4f77-87f2-180601a19169-kube-api-access-wtnjr\") pod \"payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") " pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:31.002022 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:31.001990    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:31.019151 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:31.019122    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:31.296587 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:31.296550    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"]
Sep 17 17:57:31.296893 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:57:31.296863    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebf4c76_0d1a_4f77_87f2_180601a19169.slice/crio-ffff03da85d2de7f25a94d12096c56bafcb73099b6f6b2f65012254bd16a482a WatchSource:0}: Error finding container ffff03da85d2de7f25a94d12096c56bafcb73099b6f6b2f65012254bd16a482a: Status 404 returned error can't find the container with id ffff03da85d2de7f25a94d12096c56bafcb73099b6f6b2f65012254bd16a482a
Sep 17 17:57:32.088071 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:32.088033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq" event={"ID":"1ebf4c76-0d1a-4f77-87f2-180601a19169","Type":"ContainerStarted","Data":"612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2"}
Sep 17 17:57:32.088477 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:32.088089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq" event={"ID":"1ebf4c76-0d1a-4f77-87f2-180601a19169","Type":"ContainerStarted","Data":"ffff03da85d2de7f25a94d12096c56bafcb73099b6f6b2f65012254bd16a482a"}
Sep 17 17:57:32.088477 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:32.088132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:32.120369 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:32.120318    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq" podStartSLOduration=2.1203028760000002 podStartE2EDuration="2.120302876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:32.118246244 +0000 UTC m=+1559.896083877" watchObservedRunningTime="2026-09-17 17:57:32.120302876 +0000 UTC m=+1559.898140511"
Sep 17 17:57:32.123140 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:32.123117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:34.466080 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.466048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:34.577086 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.577053    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"]
Sep 17 17:57:34.577310 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.577268    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f" podUID="d3fee711-5b5d-4be6-8059-046bd7c93f19" containerName="payload-processing" containerID="cri-o://88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b" gracePeriod=30
Sep 17 17:57:34.611557 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.611510    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"]
Sep 17 17:57:34.611787 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.611762    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv" podUID="e2455d2f-a04b-4af9-b028-f4c9cf56a372" containerName="payload-pre-processing" containerID="cri-o://ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843" gracePeriod=30
Sep 17 17:57:34.638652 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.638623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:34.833114 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.832986    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:34.913140 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.913114    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:57:34.915093 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:34.915068    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:57:35.009834 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.009799    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:35.042493 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.042470    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2lbk\" (UniqueName: \"kubernetes.io/projected/e2455d2f-a04b-4af9-b028-f4c9cf56a372-kube-api-access-k2lbk\") pod \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") "
Sep 17 17:57:35.042643 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.042583    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3fee711-5b5d-4be6-8059-046bd7c93f19-plugins-config-volume\") pod \"d3fee711-5b5d-4be6-8059-046bd7c93f19\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") "
Sep 17 17:57:35.042643 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.042632    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46lhv\" (UniqueName: \"kubernetes.io/projected/d3fee711-5b5d-4be6-8059-046bd7c93f19-kube-api-access-46lhv\") pod \"d3fee711-5b5d-4be6-8059-046bd7c93f19\" (UID: \"d3fee711-5b5d-4be6-8059-046bd7c93f19\") "
Sep 17 17:57:35.042750 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.042704    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2455d2f-a04b-4af9-b028-f4c9cf56a372-plugins-config-volume\") pod \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\" (UID: \"e2455d2f-a04b-4af9-b028-f4c9cf56a372\") "
Sep 17 17:57:35.043245 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.043211    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3fee711-5b5d-4be6-8059-046bd7c93f19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3fee711-5b5d-4be6-8059-046bd7c93f19" (UID: "d3fee711-5b5d-4be6-8059-046bd7c93f19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:35.043357 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.043312    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2455d2f-a04b-4af9-b028-f4c9cf56a372-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2455d2f-a04b-4af9-b028-f4c9cf56a372" (UID: "e2455d2f-a04b-4af9-b028-f4c9cf56a372"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:35.044813 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.044791    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2455d2f-a04b-4af9-b028-f4c9cf56a372-kube-api-access-k2lbk" (OuterVolumeSpecName: "kube-api-access-k2lbk") pod "e2455d2f-a04b-4af9-b028-f4c9cf56a372" (UID: "e2455d2f-a04b-4af9-b028-f4c9cf56a372"). InnerVolumeSpecName "kube-api-access-k2lbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:35.045071 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.045050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3fee711-5b5d-4be6-8059-046bd7c93f19-kube-api-access-46lhv" (OuterVolumeSpecName: "kube-api-access-46lhv") pod "d3fee711-5b5d-4be6-8059-046bd7c93f19" (UID: "d3fee711-5b5d-4be6-8059-046bd7c93f19"). InnerVolumeSpecName "kube-api-access-46lhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:35.071223 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.071193    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"]
Sep 17 17:57:35.087756 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.087730    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db7813-lqwh5"]
Sep 17 17:57:35.107205 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.107179    2559 generic.go:356] "Generic (PLEG): container finished" podID="d3fee711-5b5d-4be6-8059-046bd7c93f19" containerID="88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b" exitCode=0
Sep 17 17:57:35.107286 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.107219    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"
Sep 17 17:57:35.107286 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.107265    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f" event={"ID":"d3fee711-5b5d-4be6-8059-046bd7c93f19","Type":"ContainerDied","Data":"88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b"}
Sep 17 17:57:35.107406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.107315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f" event={"ID":"d3fee711-5b5d-4be6-8059-046bd7c93f19","Type":"ContainerDied","Data":"1013f3deae5e62078885fbbbca1203caebd1e27cd96d6683dc1937669530eaf0"}
Sep 17 17:57:35.107406 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.107348    2559 scope.go:117] "RemoveContainer" containerID="88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b"
Sep 17 17:57:35.108067 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.108042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:35.108684 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.108665    2559 generic.go:356] "Generic (PLEG): container finished" podID="e2455d2f-a04b-4af9-b028-f4c9cf56a372" containerID="ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843" exitCode=0
Sep 17 17:57:35.108776 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.108692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv" event={"ID":"e2455d2f-a04b-4af9-b028-f4c9cf56a372","Type":"ContainerDied","Data":"ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843"}
Sep 17 17:57:35.108776 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.108714    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"
Sep 17 17:57:35.108776 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.108751    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv" event={"ID":"e2455d2f-a04b-4af9-b028-f4c9cf56a372","Type":"ContainerDied","Data":"b37f0a35f51ea115e53c9a6eb1cd4183b4633ddf186d89178c6c4e2dea0a5bf9"}
Sep 17 17:57:35.116927 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.116911    2559 scope.go:117] "RemoveContainer" containerID="88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b"
Sep 17 17:57:35.117199 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:57:35.117178    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b\": container with ID starting with 88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b not found: ID does not exist" containerID="88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b"
Sep 17 17:57:35.117280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.117210    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b"} err="failed to get container status \"88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b\": rpc error: code = NotFound desc = could not find container \"88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b\": container with ID starting with 88b5a3633390161895dd2c431885e92e4eb112a585cae74e049a99d8a3fe426b not found: ID does not exist"
Sep 17 17:57:35.117280 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.117234    2559 scope.go:117] "RemoveContainer" containerID="ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843"
Sep 17 17:57:35.125913 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.125892    2559 scope.go:117] "RemoveContainer" containerID="ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843"
Sep 17 17:57:35.126187 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:57:35.126168    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843\": container with ID starting with ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843 not found: ID does not exist" containerID="ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843"
Sep 17 17:57:35.126325 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.126195    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843"} err="failed to get container status \"ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843\": rpc error: code = NotFound desc = could not find container \"ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843\": container with ID starting with ec13133d7030aac2a0c659e47046bc7e6afbc74d502fad94018c587381340843 not found: ID does not exist"
Sep 17 17:57:35.143483 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.143462    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3fee711-5b5d-4be6-8059-046bd7c93f19-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:35.143483 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.143483    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46lhv\" (UniqueName: \"kubernetes.io/projected/d3fee711-5b5d-4be6-8059-046bd7c93f19-kube-api-access-46lhv\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:35.143686 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.143493    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2455d2f-a04b-4af9-b028-f4c9cf56a372-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:35.143686 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.143503    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2lbk\" (UniqueName: \"kubernetes.io/projected/e2455d2f-a04b-4af9-b028-f4c9cf56a372-kube-api-access-k2lbk\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:35.154737 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.147392    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"]
Sep 17 17:57:35.154737 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.153605    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db7813-ccbc75cbb-j24vv"]
Sep 17 17:57:35.181700 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.181675    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"]
Sep 17 17:57:35.203391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.203364    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db7813-76c447b48f-w6b9f"]
Sep 17 17:57:35.414126 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.414052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:35.606200 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:35.606167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:36.399762 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:36.399723    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc2d1de-a3ae-4d25-96fd-9a2740348b55" path="/var/lib/kubelet/pods/8bc2d1de-a3ae-4d25-96fd-9a2740348b55/volumes"
Sep 17 17:57:36.400207 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:36.400186    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3fee711-5b5d-4be6-8059-046bd7c93f19" path="/var/lib/kubelet/pods/d3fee711-5b5d-4be6-8059-046bd7c93f19/volumes"
Sep 17 17:57:36.400611 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:36.400593    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2455d2f-a04b-4af9-b028-f4c9cf56a372" path="/var/lib/kubelet/pods/e2455d2f-a04b-4af9-b028-f4c9cf56a372/volumes"
Sep 17 17:57:36.613907 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:36.613874    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:37.713469 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:37.713433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:38.956268 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:38.956235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:40.312889 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:40.312861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:41.237303 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:41.237271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:41.326105 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:41.326068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:42.504204 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:42.504174    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:43.096391 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:43.096362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:57:43.412768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:43.412693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:43.519270 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:43.519245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:43.829818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:43.829788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:44.194182 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.194104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:44.225249 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.225223    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"]
Sep 17 17:57:44.225676 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.225662    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2455d2f-a04b-4af9-b028-f4c9cf56a372" containerName="payload-pre-processing"
Sep 17 17:57:44.225730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.225678    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2455d2f-a04b-4af9-b028-f4c9cf56a372" containerName="payload-pre-processing"
Sep 17 17:57:44.225730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.225689    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3fee711-5b5d-4be6-8059-046bd7c93f19" containerName="payload-processing"
Sep 17 17:57:44.225730 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.225695    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3fee711-5b5d-4be6-8059-046bd7c93f19" containerName="payload-processing"
Sep 17 17:57:44.225827 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.225762    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3fee711-5b5d-4be6-8059-046bd7c93f19" containerName="payload-processing"
Sep 17 17:57:44.225827 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.225771    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2455d2f-a04b-4af9-b028-f4c9cf56a372" containerName="payload-pre-processing"
Sep 17 17:57:44.230866 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.230848    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"
Sep 17 17:57:44.239320 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.239300    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:57:44.239445 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.239300    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:57:44.243670 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.243649    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"]
Sep 17 17:57:44.337698 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.337663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679c9f02-3f46-442e-b676-883b1c2ebb66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l\" (UID: \"679c9f02-3f46-442e-b676-883b1c2ebb66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"
Sep 17 17:57:44.438496 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.438460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679c9f02-3f46-442e-b676-883b1c2ebb66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l\" (UID: \"679c9f02-3f46-442e-b676-883b1c2ebb66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"
Sep 17 17:57:44.439118 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.439094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679c9f02-3f46-442e-b676-883b1c2ebb66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l\" (UID: \"679c9f02-3f46-442e-b676-883b1c2ebb66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"
Sep 17 17:57:44.541985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.541957    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"
Sep 17 17:57:44.820611 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:57:44.820579    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679c9f02_3f46_442e_b676_883b1c2ebb66.slice/crio-5daaccc8ff2ae89ff775c6671920d40b21a0c7f273b09fc4ca6454ec264a9920 WatchSource:0}: Error finding container 5daaccc8ff2ae89ff775c6671920d40b21a0c7f273b09fc4ca6454ec264a9920: Status 404 returned error can't find the container with id 5daaccc8ff2ae89ff775c6671920d40b21a0c7f273b09fc4ca6454ec264a9920
Sep 17 17:57:44.820750 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:44.820631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"]
Sep 17 17:57:45.176480 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:45.176445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l" event={"ID":"679c9f02-3f46-442e-b676-883b1c2ebb66","Type":"ContainerStarted","Data":"1f9973aa2d82d7cc8424a087c3670f873ed6745305400ff6920f01ca213f6543"}
Sep 17 17:57:45.176612 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:45.176504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l" event={"ID":"679c9f02-3f46-442e-b676-883b1c2ebb66","Type":"ContainerStarted","Data":"5daaccc8ff2ae89ff775c6671920d40b21a0c7f273b09fc4ca6454ec264a9920"}
Sep 17 17:57:45.201797 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:45.201750    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l" podStartSLOduration=1.20173411 podStartE2EDuration="1.20173411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:45.201323491 +0000 UTC m=+1572.979161126" watchObservedRunningTime="2026-09-17 17:57:45.20173411 +0000 UTC m=+1572.979571744"
Sep 17 17:57:45.351728 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:45.351645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.184297 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:46.184265    2559 generic.go:356] "Generic (PLEG): container finished" podID="679c9f02-3f46-442e-b676-883b1c2ebb66" containerID="1f9973aa2d82d7cc8424a087c3670f873ed6745305400ff6920f01ca213f6543" exitCode=0
Sep 17 17:57:46.184678 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:46.184309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l" event={"ID":"679c9f02-3f46-442e-b676-883b1c2ebb66","Type":"ContainerDied","Data":"1f9973aa2d82d7cc8424a087c3670f873ed6745305400ff6920f01ca213f6543"}
Sep 17 17:57:46.285966 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:46.285939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:47.351206 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:47.351172    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"
Sep 17 17:57:47.364326 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:47.364295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:47.471597 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:47.470945    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679c9f02-3f46-442e-b676-883b1c2ebb66-maas-api-service-ca\") pod \"679c9f02-3f46-442e-b676-883b1c2ebb66\" (UID: \"679c9f02-3f46-442e-b676-883b1c2ebb66\") "
Sep 17 17:57:47.471597 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:47.471582    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/679c9f02-3f46-442e-b676-883b1c2ebb66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "679c9f02-3f46-442e-b676-883b1c2ebb66" (UID: "679c9f02-3f46-442e-b676-883b1c2ebb66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:47.572167 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:47.572129    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679c9f02-3f46-442e-b676-883b1c2ebb66-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:57:48.198959 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:48.198927    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"
Sep 17 17:57:48.199177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:48.198962    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l" event={"ID":"679c9f02-3f46-442e-b676-883b1c2ebb66","Type":"ContainerDied","Data":"5daaccc8ff2ae89ff775c6671920d40b21a0c7f273b09fc4ca6454ec264a9920"}
Sep 17 17:57:48.199177 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:48.199020    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5daaccc8ff2ae89ff775c6671920d40b21a0c7f273b09fc4ca6454ec264a9920"
Sep 17 17:57:48.622833 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:48.622801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:49.755030 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:49.754993    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:50.709364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:50.709329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:50.846823 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:50.846784    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:50.947063 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:50.947033    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:51.761735 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:51.761707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:52.347833 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:52.347803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:52.740793 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:52.740711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:53.574902 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:53.574864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:58.214699 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:58.214665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:59.763781 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:59.763751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:59.806410 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:59.806373    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"]
Sep 17 17:57:59.806695 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:59.806668    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4" podUID="c60ef853-ad3e-4c75-824c-79f75c485a5a" containerName="payload-processing" containerID="cri-o://c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f" gracePeriod=30
Sep 17 17:57:59.816567 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:59.814643    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"]
Sep 17 17:57:59.816567 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:59.816132    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w" podUID="8b9594e5-668a-495c-ad93-40c4c7a76e7d" containerName="payload-pre-processing" containerID="cri-o://30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b" gracePeriod=30
Sep 17 17:57:59.852824 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:59.852785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:59.948235 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:57:59.948194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:00.027106 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.027075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:00.040495 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.040464    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"]
Sep 17 17:58:00.045336 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.045305    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab64d6-xd92l"]
Sep 17 17:58:00.096225 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.096203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:00.103097 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.103077    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:58:00.105099 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.105083    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:58:00.183029 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.183001    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9594e5-668a-495c-ad93-40c4c7a76e7d-plugins-config-volume\") pod \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") "
Sep 17 17:58:00.183198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.183106    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgbxn\" (UniqueName: \"kubernetes.io/projected/8b9594e5-668a-495c-ad93-40c4c7a76e7d-kube-api-access-pgbxn\") pod \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\" (UID: \"8b9594e5-668a-495c-ad93-40c4c7a76e7d\") "
Sep 17 17:58:00.183198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.183131    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60ef853-ad3e-4c75-824c-79f75c485a5a-plugins-config-volume\") pod \"c60ef853-ad3e-4c75-824c-79f75c485a5a\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") "
Sep 17 17:58:00.183198 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.183157    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnffr\" (UniqueName: \"kubernetes.io/projected/c60ef853-ad3e-4c75-824c-79f75c485a5a-kube-api-access-pnffr\") pod \"c60ef853-ad3e-4c75-824c-79f75c485a5a\" (UID: \"c60ef853-ad3e-4c75-824c-79f75c485a5a\") "
Sep 17 17:58:00.183495 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.183466    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b9594e5-668a-495c-ad93-40c4c7a76e7d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8b9594e5-668a-495c-ad93-40c4c7a76e7d" (UID: "8b9594e5-668a-495c-ad93-40c4c7a76e7d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:00.183601 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.183510    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c60ef853-ad3e-4c75-824c-79f75c485a5a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c60ef853-ad3e-4c75-824c-79f75c485a5a" (UID: "c60ef853-ad3e-4c75-824c-79f75c485a5a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:00.185282 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.185253    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c60ef853-ad3e-4c75-824c-79f75c485a5a-kube-api-access-pnffr" (OuterVolumeSpecName: "kube-api-access-pnffr") pod "c60ef853-ad3e-4c75-824c-79f75c485a5a" (UID: "c60ef853-ad3e-4c75-824c-79f75c485a5a"). InnerVolumeSpecName "kube-api-access-pnffr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:00.185387 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.185350    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9594e5-668a-495c-ad93-40c4c7a76e7d-kube-api-access-pgbxn" (OuterVolumeSpecName: "kube-api-access-pgbxn") pod "8b9594e5-668a-495c-ad93-40c4c7a76e7d" (UID: "8b9594e5-668a-495c-ad93-40c4c7a76e7d"). InnerVolumeSpecName "kube-api-access-pgbxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:00.272317 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.272226    2559 generic.go:356] "Generic (PLEG): container finished" podID="c60ef853-ad3e-4c75-824c-79f75c485a5a" containerID="c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f" exitCode=0
Sep 17 17:58:00.272317 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.272282    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"
Sep 17 17:58:00.272317 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.272310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4" event={"ID":"c60ef853-ad3e-4c75-824c-79f75c485a5a","Type":"ContainerDied","Data":"c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f"}
Sep 17 17:58:00.272615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.272365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4" event={"ID":"c60ef853-ad3e-4c75-824c-79f75c485a5a","Type":"ContainerDied","Data":"8f3c68621dcb4754cbb8353803ec96cfe32ebd6dd09b2ff10117e525d90fa3d5"}
Sep 17 17:58:00.272615 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.272393    2559 scope.go:117] "RemoveContainer" containerID="c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f"
Sep 17 17:58:00.273982 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.273952    2559 generic.go:356] "Generic (PLEG): container finished" podID="8b9594e5-668a-495c-ad93-40c4c7a76e7d" containerID="30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b" exitCode=0
Sep 17 17:58:00.274119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.273984    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"
Sep 17 17:58:00.274119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.274004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w" event={"ID":"8b9594e5-668a-495c-ad93-40c4c7a76e7d","Type":"ContainerDied","Data":"30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b"}
Sep 17 17:58:00.274119 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.274046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w" event={"ID":"8b9594e5-668a-495c-ad93-40c4c7a76e7d","Type":"ContainerDied","Data":"e89419b9e5b485a727894c24f55dffb85d39f050a00b0ee86b3b9fbd23f65497"}
Sep 17 17:58:00.283464 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.283448    2559 scope.go:117] "RemoveContainer" containerID="c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f"
Sep 17 17:58:00.283873 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:58:00.283776    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f\": container with ID starting with c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f not found: ID does not exist" containerID="c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f"
Sep 17 17:58:00.283873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.283808    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f"} err="failed to get container status \"c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f\": rpc error: code = NotFound desc = could not find container \"c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f\": container with ID starting with c3cf18ff83e71cbe02c101aed7eac41836cbafa1a31981dfe6c6ffb56c0c263f not found: ID does not exist"
Sep 17 17:58:00.283873 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.283831    2559 scope.go:117] "RemoveContainer" containerID="30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b"
Sep 17 17:58:00.284055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.283971    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgbxn\" (UniqueName: \"kubernetes.io/projected/8b9594e5-668a-495c-ad93-40c4c7a76e7d-kube-api-access-pgbxn\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:00.284055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.283992    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60ef853-ad3e-4c75-824c-79f75c485a5a-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:00.284055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.284007    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnffr\" (UniqueName: \"kubernetes.io/projected/c60ef853-ad3e-4c75-824c-79f75c485a5a-kube-api-access-pnffr\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:00.284055 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.284020    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9594e5-668a-495c-ad93-40c4c7a76e7d-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:00.292443 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.292425    2559 scope.go:117] "RemoveContainer" containerID="30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b"
Sep 17 17:58:00.292764 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:58:00.292745    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b\": container with ID starting with 30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b not found: ID does not exist" containerID="30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b"
Sep 17 17:58:00.292828 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.292771    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b"} err="failed to get container status \"30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b\": rpc error: code = NotFound desc = could not find container \"30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b\": container with ID starting with 30eb7259c11fc3b29b82ef5cbc66d9edfeb7e6720b77fccd4a4082b52928581b not found: ID does not exist"
Sep 17 17:58:00.304013 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.303967    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"]
Sep 17 17:58:00.306985 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.306966    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab64d6-7457d4789-6blj4"]
Sep 17 17:58:00.318774 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.318746    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"]
Sep 17 17:58:00.321337 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.321315    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab64d6-75bfbccdbb-6ld8w"]
Sep 17 17:58:00.377238 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.377209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:00.401026 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.400999    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="679c9f02-3f46-442e-b676-883b1c2ebb66" path="/var/lib/kubelet/pods/679c9f02-3f46-442e-b676-883b1c2ebb66/volumes"
Sep 17 17:58:00.401356 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.401343    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b9594e5-668a-495c-ad93-40c4c7a76e7d" path="/var/lib/kubelet/pods/8b9594e5-668a-495c-ad93-40c4c7a76e7d/volumes"
Sep 17 17:58:00.401722 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.401709    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c60ef853-ad3e-4c75-824c-79f75c485a5a" path="/var/lib/kubelet/pods/c60ef853-ad3e-4c75-824c-79f75c485a5a/volumes"
Sep 17 17:58:00.487360 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:00.487316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:01.410958 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:01.410928    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:02.402117 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:02.402092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:03.567800 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:03.567773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:04.733028 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:04.732997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:06.135303 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:06.135270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:07.304662 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:07.304630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:08.538726 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:08.538687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:08.650802 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:08.650776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:08.777747 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:08.777698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:09.001597 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.001573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:09.348576 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.348486    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"]
Sep 17 17:58:09.348937 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.348923    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c60ef853-ad3e-4c75-824c-79f75c485a5a" containerName="payload-processing"
Sep 17 17:58:09.348981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.348939    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c60ef853-ad3e-4c75-824c-79f75c485a5a" containerName="payload-processing"
Sep 17 17:58:09.348981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.348961    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679c9f02-3f46-442e-b676-883b1c2ebb66" containerName="revoke-keys"
Sep 17 17:58:09.348981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.348966    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="679c9f02-3f46-442e-b676-883b1c2ebb66" containerName="revoke-keys"
Sep 17 17:58:09.349075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.348989    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9594e5-668a-495c-ad93-40c4c7a76e7d" containerName="payload-pre-processing"
Sep 17 17:58:09.349075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.348995    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9594e5-668a-495c-ad93-40c4c7a76e7d" containerName="payload-pre-processing"
Sep 17 17:58:09.349075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.349060    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9594e5-668a-495c-ad93-40c4c7a76e7d" containerName="payload-pre-processing"
Sep 17 17:58:09.349075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.349068    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="679c9f02-3f46-442e-b676-883b1c2ebb66" containerName="revoke-keys"
Sep 17 17:58:09.349075 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.349076    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c60ef853-ad3e-4c75-824c-79f75c485a5a" containerName="payload-processing"
Sep 17 17:58:09.353634 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.353617    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"
Sep 17 17:58:09.357034 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.357011    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:58:09.357158 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.357073    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:58:09.380579 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.380547    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"]
Sep 17 17:58:09.473254 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.473218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9f9b960-3c71-472a-8df2-fc1d5aaf20d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv\" (UID: \"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"
Sep 17 17:58:09.574323 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.574287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9f9b960-3c71-472a-8df2-fc1d5aaf20d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv\" (UID: \"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"
Sep 17 17:58:09.574990 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.574968    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9f9b960-3c71-472a-8df2-fc1d5aaf20d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv\" (UID: \"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"
Sep 17 17:58:09.662831 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.662752    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"
Sep 17 17:58:09.963215 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:09.963181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"]
Sep 17 17:58:09.964450 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:58:09.964423    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f9b960_3c71_472a_8df2_fc1d5aaf20d2.slice/crio-cf45c406d6b5076d5c50aec282815474e9742f8fad41dce63615632e9fe9fac2 WatchSource:0}: Error finding container cf45c406d6b5076d5c50aec282815474e9742f8fad41dce63615632e9fe9fac2: Status 404 returned error can't find the container with id cf45c406d6b5076d5c50aec282815474e9742f8fad41dce63615632e9fe9fac2
Sep 17 17:58:10.337664 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:10.337631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv" event={"ID":"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2","Type":"ContainerStarted","Data":"760afea53b9605d75519ccafb981c77d118a98ef04604458689ed2799a2223ad"}
Sep 17 17:58:10.337848 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:10.337685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv" event={"ID":"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2","Type":"ContainerStarted","Data":"cf45c406d6b5076d5c50aec282815474e9742f8fad41dce63615632e9fe9fac2"}
Sep 17 17:58:10.675466 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:10.675425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:11.344629 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:11.344589    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9f9b960-3c71-472a-8df2-fc1d5aaf20d2" containerID="760afea53b9605d75519ccafb981c77d118a98ef04604458689ed2799a2223ad" exitCode=0
Sep 17 17:58:11.344815 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:11.344676    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv" event={"ID":"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2","Type":"ContainerDied","Data":"760afea53b9605d75519ccafb981c77d118a98ef04604458689ed2799a2223ad"}
Sep 17 17:58:11.905833 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:11.905798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:11.999400 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:11.999369    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:12.487868 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:12.487844    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"
Sep 17 17:58:12.602988 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:12.602903    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9f9b960-3c71-472a-8df2-fc1d5aaf20d2-maas-api-service-ca\") pod \"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2\" (UID: \"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2\") "
Sep 17 17:58:12.603234 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:12.603213    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9f9b960-3c71-472a-8df2-fc1d5aaf20d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9f9b960-3c71-472a-8df2-fc1d5aaf20d2" (UID: "e9f9b960-3c71-472a-8df2-fc1d5aaf20d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:12.704099 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:12.704070    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9f9b960-3c71-472a-8df2-fc1d5aaf20d2-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:13.018068 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:13.018034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:13.358333 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:13.358247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv" event={"ID":"e9f9b960-3c71-472a-8df2-fc1d5aaf20d2","Type":"ContainerDied","Data":"cf45c406d6b5076d5c50aec282815474e9742f8fad41dce63615632e9fe9fac2"}
Sep 17 17:58:13.358333 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:13.358274    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"
Sep 17 17:58:13.358333 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:13.358330    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf45c406d6b5076d5c50aec282815474e9742f8fad41dce63615632e9fe9fac2"
Sep 17 17:58:13.868477 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:13.868447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:14.793206 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:14.793170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:15.803828 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:15.803802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:16.629263 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:16.629232    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:19.511707 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:19.511670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:22.037843 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:22.037812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:22.122485 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:22.122447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:25.481428 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.481385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:25.519244 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.519209    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"]
Sep 17 17:58:25.519459 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.519433    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq" podUID="1ebf4c76-0d1a-4f77-87f2-180601a19169" containerName="payload-processing" containerID="cri-o://612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2" gracePeriod=30
Sep 17 17:58:25.560844 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.560808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:25.640315 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.640291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:25.781345 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.781314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:25.784829 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.784808    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:58:25.880412 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.880380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:25.886693 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.886663    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"]
Sep 17 17:58:25.889213 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.889189    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-08f4f7-lx9mv"]
Sep 17 17:58:25.932690 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.932658    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtnjr\" (UniqueName: \"kubernetes.io/projected/1ebf4c76-0d1a-4f77-87f2-180601a19169-kube-api-access-wtnjr\") pod \"1ebf4c76-0d1a-4f77-87f2-180601a19169\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") "
Sep 17 17:58:25.932690 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.932693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ebf4c76-0d1a-4f77-87f2-180601a19169-plugins-config-volume\") pod \"1ebf4c76-0d1a-4f77-87f2-180601a19169\" (UID: \"1ebf4c76-0d1a-4f77-87f2-180601a19169\") "
Sep 17 17:58:25.933169 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.933140    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ebf4c76-0d1a-4f77-87f2-180601a19169-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ebf4c76-0d1a-4f77-87f2-180601a19169" (UID: "1ebf4c76-0d1a-4f77-87f2-180601a19169"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:25.934779 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:25.934751    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebf4c76-0d1a-4f77-87f2-180601a19169-kube-api-access-wtnjr" (OuterVolumeSpecName: "kube-api-access-wtnjr") pod "1ebf4c76-0d1a-4f77-87f2-180601a19169" (UID: "1ebf4c76-0d1a-4f77-87f2-180601a19169"). InnerVolumeSpecName "kube-api-access-wtnjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:26.034128 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.034041    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtnjr\" (UniqueName: \"kubernetes.io/projected/1ebf4c76-0d1a-4f77-87f2-180601a19169-kube-api-access-wtnjr\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:26.034128 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.034071    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ebf4c76-0d1a-4f77-87f2-180601a19169-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:26.264317 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.264281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:26.369772 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.369691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:26.400722 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.400688    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9f9b960-3c71-472a-8df2-fc1d5aaf20d2" path="/var/lib/kubelet/pods/e9f9b960-3c71-472a-8df2-fc1d5aaf20d2/volumes"
Sep 17 17:58:26.439297 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.439260    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ebf4c76-0d1a-4f77-87f2-180601a19169" containerID="612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2" exitCode=0
Sep 17 17:58:26.439482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.439306    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"
Sep 17 17:58:26.439482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.439329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq" event={"ID":"1ebf4c76-0d1a-4f77-87f2-180601a19169","Type":"ContainerDied","Data":"612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2"}
Sep 17 17:58:26.439482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.439374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq" event={"ID":"1ebf4c76-0d1a-4f77-87f2-180601a19169","Type":"ContainerDied","Data":"ffff03da85d2de7f25a94d12096c56bafcb73099b6f6b2f65012254bd16a482a"}
Sep 17 17:58:26.439482 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.439397    2559 scope.go:117] "RemoveContainer" containerID="612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2"
Sep 17 17:58:26.451353 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.451312    2559 scope.go:117] "RemoveContainer" containerID="612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2"
Sep 17 17:58:26.451846 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:58:26.451819    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2\": container with ID starting with 612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2 not found: ID does not exist" containerID="612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2"
Sep 17 17:58:26.451957 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.451855    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2"} err="failed to get container status \"612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2\": rpc error: code = NotFound desc = could not find container \"612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2\": container with ID starting with 612459e582b64aea3f439dcacf2ebe4e87bff8ccdd01c7b520dcb335994c81a2 not found: ID does not exist"
Sep 17 17:58:26.471100 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.471059    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"]
Sep 17 17:58:26.481747 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:26.481719    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-08f4f7-7478ddfdd7-bg4qq"]
Sep 17 17:58:27.297323 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:27.297287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:28.400073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:28.400044    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ebf4c76-0d1a-4f77-87f2-180601a19169" path="/var/lib/kubelet/pods/1ebf4c76-0d1a-4f77-87f2-180601a19169/volumes"
Sep 17 17:58:28.628461 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:28.628430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:29.787675 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:29.787641    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:30.696867 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:30.696837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:31.788327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:31.788287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:33.285702 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.285652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:33.381763 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.381723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:33.509683 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.509653    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:33.842556 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.842502    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"]
Sep 17 17:58:33.843003 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.842983    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebf4c76-0d1a-4f77-87f2-180601a19169" containerName="payload-processing"
Sep 17 17:58:33.843099 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.843006    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebf4c76-0d1a-4f77-87f2-180601a19169" containerName="payload-processing"
Sep 17 17:58:33.843099 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.843022    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9f9b960-3c71-472a-8df2-fc1d5aaf20d2" containerName="revoke-keys"
Sep 17 17:58:33.843099 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.843030    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9f9b960-3c71-472a-8df2-fc1d5aaf20d2" containerName="revoke-keys"
Sep 17 17:58:33.843253 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.843156    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9f9b960-3c71-472a-8df2-fc1d5aaf20d2" containerName="revoke-keys"
Sep 17 17:58:33.843253 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.843173    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebf4c76-0d1a-4f77-87f2-180601a19169" containerName="payload-processing"
Sep 17 17:58:33.847660 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.847636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"
Sep 17 17:58:33.850988 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.850965    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:58:33.851083 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.850973    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:58:33.855993 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:33.855870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"]
Sep 17 17:58:34.014746 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.014717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d02b869-505a-4ee6-a5ed-fee5314a5a5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf\" (UID: \"6d02b869-505a-4ee6-a5ed-fee5314a5a5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"
Sep 17 17:58:34.115819 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.115741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d02b869-505a-4ee6-a5ed-fee5314a5a5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf\" (UID: \"6d02b869-505a-4ee6-a5ed-fee5314a5a5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"
Sep 17 17:58:34.116372 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.116353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d02b869-505a-4ee6-a5ed-fee5314a5a5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf\" (UID: \"6d02b869-505a-4ee6-a5ed-fee5314a5a5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"
Sep 17 17:58:34.160174 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.160141    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"
Sep 17 17:58:34.433272 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.433245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"]
Sep 17 17:58:34.434267 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:58:34.434236    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d02b869_505a_4ee6_a5ed_fee5314a5a5c.slice/crio-66cc844066be960c7f35b232b7d6c33c51f62ca8fb3438a1391909e9a4428e37 WatchSource:0}: Error finding container 66cc844066be960c7f35b232b7d6c33c51f62ca8fb3438a1391909e9a4428e37: Status 404 returned error can't find the container with id 66cc844066be960c7f35b232b7d6c33c51f62ca8fb3438a1391909e9a4428e37
Sep 17 17:58:34.490855 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.490819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf" event={"ID":"6d02b869-505a-4ee6-a5ed-fee5314a5a5c","Type":"ContainerStarted","Data":"66cc844066be960c7f35b232b7d6c33c51f62ca8fb3438a1391909e9a4428e37"}
Sep 17 17:58:34.719211 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.719121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:34.728980 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.728954    2559 scope.go:117] "RemoveContainer" containerID="75bd4cc780132f0092bbe082889eb79eb777e908b2a911d73455abf56baa062f"
Sep 17 17:58:34.738563 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:34.738535    2559 scope.go:117] "RemoveContainer" containerID="e65181cb9afb2d2f3c81e12c0b609cf3a9a7b04b37285a237af49982f38de0b9"
Sep 17 17:58:35.499378 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:35.499342    2559 generic.go:356] "Generic (PLEG): container finished" podID="6d02b869-505a-4ee6-a5ed-fee5314a5a5c" containerID="f859d232b2edeeb800fd8b7e63797c2fb447f54b473884a21213dff8c335ce77" exitCode=0
Sep 17 17:58:35.499766 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:35.499424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf" event={"ID":"6d02b869-505a-4ee6-a5ed-fee5314a5a5c","Type":"ContainerDied","Data":"f859d232b2edeeb800fd8b7e63797c2fb447f54b473884a21213dff8c335ce77"}
Sep 17 17:58:35.683499 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:35.683467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:36.641240 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:36.641217    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"
Sep 17 17:58:36.679141 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:36.679117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:36.737942 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:36.737918    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d02b869-505a-4ee6-a5ed-fee5314a5a5c-maas-api-service-ca\") pod \"6d02b869-505a-4ee6-a5ed-fee5314a5a5c\" (UID: \"6d02b869-505a-4ee6-a5ed-fee5314a5a5c\") "
Sep 17 17:58:36.738276 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:36.738255    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d02b869-505a-4ee6-a5ed-fee5314a5a5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d02b869-505a-4ee6-a5ed-fee5314a5a5c" (UID: "6d02b869-505a-4ee6-a5ed-fee5314a5a5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:36.839300 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:36.839219    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d02b869-505a-4ee6-a5ed-fee5314a5a5c-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:37.512313 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:37.512280    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf" event={"ID":"6d02b869-505a-4ee6-a5ed-fee5314a5a5c","Type":"ContainerDied","Data":"66cc844066be960c7f35b232b7d6c33c51f62ca8fb3438a1391909e9a4428e37"}
Sep 17 17:58:37.512486 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:37.512318    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"
Sep 17 17:58:37.512486 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:37.512328    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66cc844066be960c7f35b232b7d6c33c51f62ca8fb3438a1391909e9a4428e37"
Sep 17 17:58:37.590569 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:37.590513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:38.740003 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:38.739956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:40.062027 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:40.061994    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:41.056921 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:41.056890    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.062690 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:44.062659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.951031 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:44.950981    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:45.115768 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:45.115737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:45.205926 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:45.205851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:45.345423 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:45.345381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:45.445581 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:45.445542    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"]
Sep 17 17:58:45.455335 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:45.455308    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7e8755-sjltf"]
Sep 17 17:58:45.465817 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:45.465756    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:45.806498 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:45.806467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:46.047900 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:46.047861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:46.399785 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:46.399752    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d02b869-505a-4ee6-a5ed-fee5314a5a5c" path="/var/lib/kubelet/pods/6d02b869-505a-4ee6-a5ed-fee5314a5a5c/volumes"
Sep 17 17:58:47.519818 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:47.519786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:48.611574 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:48.611541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:49.690078 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:49.690047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:50.580659 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:50.580624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:52.172638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.172594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:52.344563 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.344527    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"]
Sep 17 17:58:52.344970 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.344958    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d02b869-505a-4ee6-a5ed-fee5314a5a5c" containerName="revoke-keys"
Sep 17 17:58:52.345019 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.344972    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d02b869-505a-4ee6-a5ed-fee5314a5a5c" containerName="revoke-keys"
Sep 17 17:58:52.345061 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.345052    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d02b869-505a-4ee6-a5ed-fee5314a5a5c" containerName="revoke-keys"
Sep 17 17:58:52.348351 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.348335    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"
Sep 17 17:58:52.352209 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.352188    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 17:58:52.352801 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.352784    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 17:58:52.371798 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.371758    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"]
Sep 17 17:58:52.487663 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.487568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c7826-f6d1-4840-9772-2e0c59927cfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b\" (UID: \"da2c7826-f6d1-4840-9772-2e0c59927cfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"
Sep 17 17:58:52.588432 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.588386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c7826-f6d1-4840-9772-2e0c59927cfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b\" (UID: \"da2c7826-f6d1-4840-9772-2e0c59927cfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"
Sep 17 17:58:52.589060 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.589037    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c7826-f6d1-4840-9772-2e0c59927cfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b\" (UID: \"da2c7826-f6d1-4840-9772-2e0c59927cfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"
Sep 17 17:58:52.657805 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.657776    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"
Sep 17 17:58:52.685702 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.685677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:52.938815 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:52.938781    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"]
Sep 17 17:58:52.941970 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:58:52.941943    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2c7826_f6d1_4840_9772_2e0c59927cfa.slice/crio-0fc7bf1645708e053f70f38f21d7b7c8aef55700f254cdebd2d724421d1cc99a WatchSource:0}: Error finding container 0fc7bf1645708e053f70f38f21d7b7c8aef55700f254cdebd2d724421d1cc99a: Status 404 returned error can't find the container with id 0fc7bf1645708e053f70f38f21d7b7c8aef55700f254cdebd2d724421d1cc99a
Sep 17 17:58:53.145073 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.145044    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:53.258610 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.258584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:53.411194 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.411163    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:53.605288 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.605195    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b" event={"ID":"da2c7826-f6d1-4840-9772-2e0c59927cfa","Type":"ContainerStarted","Data":"a8e849926825f18f5c484cc4164ecbc864e36b83c227411de3c25fc6907ad145"}
Sep 17 17:58:53.605288 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.605250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b" event={"ID":"da2c7826-f6d1-4840-9772-2e0c59927cfa","Type":"ContainerStarted","Data":"0fc7bf1645708e053f70f38f21d7b7c8aef55700f254cdebd2d724421d1cc99a"}
Sep 17 17:58:53.629880 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.629830    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b" podStartSLOduration=1.629814442 podStartE2EDuration="1.629814442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:53.62834859 +0000 UTC m=+1641.406186235" watchObservedRunningTime="2026-09-17 17:58:53.629814442 +0000 UTC m=+1641.407652077"
Sep 17 17:58:53.738460 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.738424    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"]
Sep 17 17:58:53.742268 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.742246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"
Sep 17 17:58:53.756499 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.756469    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"]
Sep 17 17:58:53.800152 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.800116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8d4978-fac2-4826-9329-f2d3ca403d74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k\" (UID: \"fc8d4978-fac2-4826-9329-f2d3ca403d74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"
Sep 17 17:58:53.807567 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.807542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:53.901026 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.900939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8d4978-fac2-4826-9329-f2d3ca403d74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k\" (UID: \"fc8d4978-fac2-4826-9329-f2d3ca403d74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"
Sep 17 17:58:53.901638 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:53.901617    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8d4978-fac2-4826-9329-f2d3ca403d74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k\" (UID: \"fc8d4978-fac2-4826-9329-f2d3ca403d74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"
Sep 17 17:58:54.052347 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:54.052312    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"
Sep 17 17:58:54.345594 ip-10-0-133-160 kubenswrapper[2559]: W0917 17:58:54.345561    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8d4978_fac2_4826_9329_f2d3ca403d74.slice/crio-8a141c49df87d3a6475535dfe0653607db8f7b69120783791e21d84fe93562b0 WatchSource:0}: Error finding container 8a141c49df87d3a6475535dfe0653607db8f7b69120783791e21d84fe93562b0: Status 404 returned error can't find the container with id 8a141c49df87d3a6475535dfe0653607db8f7b69120783791e21d84fe93562b0
Sep 17 17:58:54.346069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:54.346045    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"]
Sep 17 17:58:54.613130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:54.613039    2559 generic.go:356] "Generic (PLEG): container finished" podID="da2c7826-f6d1-4840-9772-2e0c59927cfa" containerID="a8e849926825f18f5c484cc4164ecbc864e36b83c227411de3c25fc6907ad145" exitCode=0
Sep 17 17:58:54.613130 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:54.613119    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b" event={"ID":"da2c7826-f6d1-4840-9772-2e0c59927cfa","Type":"ContainerDied","Data":"a8e849926825f18f5c484cc4164ecbc864e36b83c227411de3c25fc6907ad145"}
Sep 17 17:58:54.614755 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:54.614731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k" event={"ID":"fc8d4978-fac2-4826-9329-f2d3ca403d74","Type":"ContainerStarted","Data":"59e8faf82fb3dbc9bd65abcc5cb7266bafade56baf3de3b5470c6560a5544bd5"}
Sep 17 17:58:54.614848 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:54.614782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k" event={"ID":"fc8d4978-fac2-4826-9329-f2d3ca403d74","Type":"ContainerStarted","Data":"8a141c49df87d3a6475535dfe0653607db8f7b69120783791e21d84fe93562b0"}
Sep 17 17:58:54.666042 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:54.665974    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k" podStartSLOduration=1.665951422 podStartE2EDuration="1.665951422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:54.66298106 +0000 UTC m=+1642.440818698" watchObservedRunningTime="2026-09-17 17:58:54.665951422 +0000 UTC m=+1642.443789060"
Sep 17 17:58:55.090895 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.090865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:55.622415 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.622379    2559 generic.go:356] "Generic (PLEG): container finished" podID="fc8d4978-fac2-4826-9329-f2d3ca403d74" containerID="59e8faf82fb3dbc9bd65abcc5cb7266bafade56baf3de3b5470c6560a5544bd5" exitCode=0
Sep 17 17:58:55.622940 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.622463    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k" event={"ID":"fc8d4978-fac2-4826-9329-f2d3ca403d74","Type":"ContainerDied","Data":"59e8faf82fb3dbc9bd65abcc5cb7266bafade56baf3de3b5470c6560a5544bd5"}
Sep 17 17:58:55.757952 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.757926    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"
Sep 17 17:58:55.820766 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.820730    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c7826-f6d1-4840-9772-2e0c59927cfa-maas-api-service-ca\") pod \"da2c7826-f6d1-4840-9772-2e0c59927cfa\" (UID: \"da2c7826-f6d1-4840-9772-2e0c59927cfa\") "
Sep 17 17:58:55.821113 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.821089    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2c7826-f6d1-4840-9772-2e0c59927cfa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da2c7826-f6d1-4840-9772-2e0c59927cfa" (UID: "da2c7826-f6d1-4840-9772-2e0c59927cfa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:55.922358 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.922263    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c7826-f6d1-4840-9772-2e0c59927cfa-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:55.980793 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:55.980749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:56.630347 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:56.630321    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"
Sep 17 17:58:56.630840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:56.630360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b" event={"ID":"da2c7826-f6d1-4840-9772-2e0c59927cfa","Type":"ContainerDied","Data":"0fc7bf1645708e053f70f38f21d7b7c8aef55700f254cdebd2d724421d1cc99a"}
Sep 17 17:58:56.630840 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:56.630410    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fc7bf1645708e053f70f38f21d7b7c8aef55700f254cdebd2d724421d1cc99a"
Sep 17 17:58:56.769938 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:56.769913    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"
Sep 17 17:58:56.931622 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:56.931590    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8d4978-fac2-4826-9329-f2d3ca403d74-maas-api-service-ca\") pod \"fc8d4978-fac2-4826-9329-f2d3ca403d74\" (UID: \"fc8d4978-fac2-4826-9329-f2d3ca403d74\") "
Sep 17 17:58:56.932059 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:56.932020    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8d4978-fac2-4826-9329-f2d3ca403d74-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fc8d4978-fac2-4826-9329-f2d3ca403d74" (UID: "fc8d4978-fac2-4826-9329-f2d3ca403d74"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:56.971028 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:56.970932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:57.032635 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:57.032593    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8d4978-fac2-4826-9329-f2d3ca403d74-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:58:57.258879 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:57.258851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:57.638034 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:57.637950    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"
Sep 17 17:58:57.638034 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:57.637987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k" event={"ID":"fc8d4978-fac2-4826-9329-f2d3ca403d74","Type":"ContainerDied","Data":"8a141c49df87d3a6475535dfe0653607db8f7b69120783791e21d84fe93562b0"}
Sep 17 17:58:57.638467 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:57.638039    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a141c49df87d3a6475535dfe0653607db8f7b69120783791e21d84fe93562b0"
Sep 17 17:58:57.956921 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:57.956836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:59.005787 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:58:59.005742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:02.619964 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:02.619933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:04.007765 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:04.007732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:04.827270 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:04.827238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:04.885881 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:04.885844    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"]
Sep 17 17:59:04.886123 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:04.886097    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j" podUID="5a589aaa-e31f-41ea-9bec-489c6bd9156f" containerName="payload-processing" containerID="cri-o://c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37" gracePeriod=30
Sep 17 17:59:04.921440 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:04.921405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:05.023854 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.023806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:05.142688 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.142658    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:59:05.192921 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.192893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:05.318124 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.318082    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a589aaa-e31f-41ea-9bec-489c6bd9156f-plugins-config-volume\") pod \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") "
Sep 17 17:59:05.318304 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.318143    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t78np\" (UniqueName: \"kubernetes.io/projected/5a589aaa-e31f-41ea-9bec-489c6bd9156f-kube-api-access-t78np\") pod \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\" (UID: \"5a589aaa-e31f-41ea-9bec-489c6bd9156f\") "
Sep 17 17:59:05.318563 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.318540    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a589aaa-e31f-41ea-9bec-489c6bd9156f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a589aaa-e31f-41ea-9bec-489c6bd9156f" (UID: "5a589aaa-e31f-41ea-9bec-489c6bd9156f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:05.319981 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.319960    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"]
Sep 17 17:59:05.320455 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.320418    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a589aaa-e31f-41ea-9bec-489c6bd9156f-kube-api-access-t78np" (OuterVolumeSpecName: "kube-api-access-t78np") pod "5a589aaa-e31f-41ea-9bec-489c6bd9156f" (UID: "5a589aaa-e31f-41ea-9bec-489c6bd9156f"). InnerVolumeSpecName "kube-api-access-t78np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:05.320739 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.320717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:05.325443 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.325417    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ef41f8-qwh8k"]
Sep 17 17:59:05.419649 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.419574    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a589aaa-e31f-41ea-9bec-489c6bd9156f-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:59:05.419649 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.419601    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t78np\" (UniqueName: \"kubernetes.io/projected/5a589aaa-e31f-41ea-9bec-489c6bd9156f-kube-api-access-t78np\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:59:05.656334 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.656303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:05.692386 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.692293    2559 generic.go:356] "Generic (PLEG): container finished" podID="5a589aaa-e31f-41ea-9bec-489c6bd9156f" containerID="c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37" exitCode=0
Sep 17 17:59:05.692582 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.692414    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"
Sep 17 17:59:05.692582 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.692433    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j" event={"ID":"5a589aaa-e31f-41ea-9bec-489c6bd9156f","Type":"ContainerDied","Data":"c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37"}
Sep 17 17:59:05.692582 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.692508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j" event={"ID":"5a589aaa-e31f-41ea-9bec-489c6bd9156f","Type":"ContainerDied","Data":"3f556588daf0901f9c7009be7b9df8d68cbdd493b68b5ae66b9e938c67c446fa"}
Sep 17 17:59:05.692582 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.692549    2559 scope.go:117] "RemoveContainer" containerID="c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37"
Sep 17 17:59:05.704451 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.704430    2559 scope.go:117] "RemoveContainer" containerID="c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37"
Sep 17 17:59:05.704978 ip-10-0-133-160 kubenswrapper[2559]: E0917 17:59:05.704949    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37\": container with ID starting with c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37 not found: ID does not exist" containerID="c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37"
Sep 17 17:59:05.705078 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.704992    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37"} err="failed to get container status \"c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37\": rpc error: code = NotFound desc = could not find container \"c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37\": container with ID starting with c27aa4fe3162cde6ecb6e31ee8e97196d327ef98c5c5dddd20c7646b582fee37 not found: ID does not exist"
Sep 17 17:59:05.728021 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.727992    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"]
Sep 17 17:59:05.732619 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.732590    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ef41f8-7c478b46f9-bfx5j"]
Sep 17 17:59:05.756568 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:05.756538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:06.400451 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.400416    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a589aaa-e31f-41ea-9bec-489c6bd9156f" path="/var/lib/kubelet/pods/5a589aaa-e31f-41ea-9bec-489c6bd9156f/volumes"
Sep 17 17:59:06.401388 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.400960    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8d4978-fac2-4826-9329-f2d3ca403d74" path="/var/lib/kubelet/pods/fc8d4978-fac2-4826-9329-f2d3ca403d74/volumes"
Sep 17 17:59:06.457011 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.456983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:06.516841 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.516798    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"]
Sep 17 17:59:06.517105 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.517073    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d" podUID="0366360a-db43-48ea-b224-3e304857d29c" containerName="payload-processing" containerID="cri-o://154c45d358cb6af3234ec14de130b8ea6307af075e1b7cfa3560cff9e856008c" gracePeriod=30
Sep 17 17:59:06.537277 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.537253    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"]
Sep 17 17:59:06.537568 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.537498    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm" podUID="03fa496f-e4f2-455a-87a1-961f945d7c65" containerName="payload-pre-processing" containerID="cri-o://6c4cb0725de9abd2d85cc4aa76a4419537a0ffb90db66a4baa8f86dea22a596b" gracePeriod=30
Sep 17 17:59:06.581675 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.581649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:06.671850 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.671779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:06.702744 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.702475    2559 generic.go:356] "Generic (PLEG): container finished" podID="03fa496f-e4f2-455a-87a1-961f945d7c65" containerID="6c4cb0725de9abd2d85cc4aa76a4419537a0ffb90db66a4baa8f86dea22a596b" exitCode=0
Sep 17 17:59:06.702744 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.702635    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm" event={"ID":"03fa496f-e4f2-455a-87a1-961f945d7c65","Type":"ContainerDied","Data":"6c4cb0725de9abd2d85cc4aa76a4419537a0ffb90db66a4baa8f86dea22a596b"}
Sep 17 17:59:06.706175 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.706131    2559 generic.go:356] "Generic (PLEG): container finished" podID="0366360a-db43-48ea-b224-3e304857d29c" containerID="154c45d358cb6af3234ec14de130b8ea6307af075e1b7cfa3560cff9e856008c" exitCode=0
Sep 17 17:59:06.706329 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.706210    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d" event={"ID":"0366360a-db43-48ea-b224-3e304857d29c","Type":"ContainerDied","Data":"154c45d358cb6af3234ec14de130b8ea6307af075e1b7cfa3560cff9e856008c"}
Sep 17 17:59:06.785362 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.785333    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:59:06.816682 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.816658    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:59:06.934201 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.934117    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l5qq\" (UniqueName: \"kubernetes.io/projected/03fa496f-e4f2-455a-87a1-961f945d7c65-kube-api-access-5l5qq\") pod \"03fa496f-e4f2-455a-87a1-961f945d7c65\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") "
Sep 17 17:59:06.934364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.934224    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03fa496f-e4f2-455a-87a1-961f945d7c65-plugins-config-volume\") pod \"03fa496f-e4f2-455a-87a1-961f945d7c65\" (UID: \"03fa496f-e4f2-455a-87a1-961f945d7c65\") "
Sep 17 17:59:06.934364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.934284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0366360a-db43-48ea-b224-3e304857d29c-plugins-config-volume\") pod \"0366360a-db43-48ea-b224-3e304857d29c\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") "
Sep 17 17:59:06.934364 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.934304    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cl68\" (UniqueName: \"kubernetes.io/projected/0366360a-db43-48ea-b224-3e304857d29c-kube-api-access-6cl68\") pod \"0366360a-db43-48ea-b224-3e304857d29c\" (UID: \"0366360a-db43-48ea-b224-3e304857d29c\") "
Sep 17 17:59:06.934691 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.934658    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03fa496f-e4f2-455a-87a1-961f945d7c65-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03fa496f-e4f2-455a-87a1-961f945d7c65" (UID: "03fa496f-e4f2-455a-87a1-961f945d7c65"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:06.934755 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.934669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0366360a-db43-48ea-b224-3e304857d29c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0366360a-db43-48ea-b224-3e304857d29c" (UID: "0366360a-db43-48ea-b224-3e304857d29c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:06.936436 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.936412    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fa496f-e4f2-455a-87a1-961f945d7c65-kube-api-access-5l5qq" (OuterVolumeSpecName: "kube-api-access-5l5qq") pod "03fa496f-e4f2-455a-87a1-961f945d7c65" (UID: "03fa496f-e4f2-455a-87a1-961f945d7c65"). InnerVolumeSpecName "kube-api-access-5l5qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:06.936539 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.936449    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0366360a-db43-48ea-b224-3e304857d29c-kube-api-access-6cl68" (OuterVolumeSpecName: "kube-api-access-6cl68") pod "0366360a-db43-48ea-b224-3e304857d29c" (UID: "0366360a-db43-48ea-b224-3e304857d29c"). InnerVolumeSpecName "kube-api-access-6cl68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:06.943069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:06.943046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:07.035614 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.035567    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l5qq\" (UniqueName: \"kubernetes.io/projected/03fa496f-e4f2-455a-87a1-961f945d7c65-kube-api-access-5l5qq\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:59:07.035614 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.035606    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03fa496f-e4f2-455a-87a1-961f945d7c65-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:59:07.035614 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.035622    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0366360a-db43-48ea-b224-3e304857d29c-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:59:07.035871 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.035634    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cl68\" (UniqueName: \"kubernetes.io/projected/0366360a-db43-48ea-b224-3e304857d29c-kube-api-access-6cl68\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 17:59:07.044843 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.044807    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"]
Sep 17 17:59:07.052616 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.052590    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8aeea1-nz68b"]
Sep 17 17:59:07.063206 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.063178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:07.174456 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.174411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:07.363864 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.363818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:07.714048 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.713958    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"
Sep 17 17:59:07.714048 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.713998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d" event={"ID":"0366360a-db43-48ea-b224-3e304857d29c","Type":"ContainerDied","Data":"b7192a6c30d0b4038c92e0c0aae663e9e5bb415c25040ba30e36282e9d9df828"}
Sep 17 17:59:07.714624 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.714060    2559 scope.go:117] "RemoveContainer" containerID="154c45d358cb6af3234ec14de130b8ea6307af075e1b7cfa3560cff9e856008c"
Sep 17 17:59:07.715505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.715477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm" event={"ID":"03fa496f-e4f2-455a-87a1-961f945d7c65","Type":"ContainerDied","Data":"49af0e68933f8de23456d10eb87c74a35516ee871711a30175f005fd552bc0c1"}
Sep 17 17:59:07.715505 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.715486    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"
Sep 17 17:59:07.725224 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.725091    2559 scope.go:117] "RemoveContainer" containerID="6c4cb0725de9abd2d85cc4aa76a4419537a0ffb90db66a4baa8f86dea22a596b"
Sep 17 17:59:07.739905 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.739879    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"]
Sep 17 17:59:07.747584 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.747560    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8aeea1-d6fb4c8cc-hh62d"]
Sep 17 17:59:07.760408 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.760382    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"]
Sep 17 17:59:07.763885 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:07.763850    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8aeea1-67c66c75b6-tzrhm"]
Sep 17 17:59:08.047871 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:08.047838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:08.400327 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:08.400245    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0366360a-db43-48ea-b224-3e304857d29c" path="/var/lib/kubelet/pods/0366360a-db43-48ea-b224-3e304857d29c/volumes"
Sep 17 17:59:08.400645 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:08.400631    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03fa496f-e4f2-455a-87a1-961f945d7c65" path="/var/lib/kubelet/pods/03fa496f-e4f2-455a-87a1-961f945d7c65/volumes"
Sep 17 17:59:08.400948 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:08.400937    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2c7826-f6d1-4840-9772-2e0c59927cfa" path="/var/lib/kubelet/pods/da2c7826-f6d1-4840-9772-2e0c59927cfa/volumes"
Sep 17 17:59:09.398544 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:09.398488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:10.321126 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:10.321095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:11.955839 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:11.955809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:12.055950 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:12.055922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:12.233779 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:12.233702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:14.630967 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:14.630935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:14.691727 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:14.691696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:14.924485 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:14.924405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:28.668888 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:28.668849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:30.285821 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:30.285794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:34.328953 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:34.328923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:34.425444 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:34.425416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:36.643069 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:36.643034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:53.276557 ip-10-0-133-160 kubenswrapper[2559]: I0917 17:59:53.276459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:00.152056 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152025    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"]
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152402    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2c7826-f6d1-4840-9772-2e0c59927cfa" containerName="revoke-keys"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152414    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2c7826-f6d1-4840-9772-2e0c59927cfa" containerName="revoke-keys"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152429    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fa496f-e4f2-455a-87a1-961f945d7c65" containerName="payload-pre-processing"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152435    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fa496f-e4f2-455a-87a1-961f945d7c65" containerName="payload-pre-processing"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152442    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a589aaa-e31f-41ea-9bec-489c6bd9156f" containerName="payload-processing"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152448    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a589aaa-e31f-41ea-9bec-489c6bd9156f" containerName="payload-processing"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152459    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0366360a-db43-48ea-b224-3e304857d29c" containerName="payload-processing"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152464    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0366360a-db43-48ea-b224-3e304857d29c" containerName="payload-processing"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152476    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8d4978-fac2-4826-9329-f2d3ca403d74" containerName="revoke-keys"
Sep 17 18:00:00.152557 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152481    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8d4978-fac2-4826-9329-f2d3ca403d74" containerName="revoke-keys"
Sep 17 18:00:00.152877 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152568    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc8d4978-fac2-4826-9329-f2d3ca403d74" containerName="revoke-keys"
Sep 17 18:00:00.152877 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152578    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="03fa496f-e4f2-455a-87a1-961f945d7c65" containerName="payload-pre-processing"
Sep 17 18:00:00.152877 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152588    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a589aaa-e31f-41ea-9bec-489c6bd9156f" containerName="payload-processing"
Sep 17 18:00:00.152877 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152593    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0366360a-db43-48ea-b224-3e304857d29c" containerName="payload-processing"
Sep 17 18:00:00.152877 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.152599    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2c7826-f6d1-4840-9772-2e0c59927cfa" containerName="revoke-keys"
Sep 17 18:00:00.155398 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.155381    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24"]
Sep 17 18:00:00.155506 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.155489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"
Sep 17 18:00:00.158690 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.158671    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24"
Sep 17 18:00:00.158827 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.158727    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 18:00:00.165914 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.165899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"
Sep 17 18:00:00.170594 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.170479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24"]
Sep 17 18:00:00.174430 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.174412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24"
Sep 17 18:00:00.183045 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.183026    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"]
Sep 17 18:00:00.487496 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.487468    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24"]
Sep 17 18:00:00.489009 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:00:00.488978    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fded79_26b2_404e_b089_c863180e37ff.slice/crio-ad9d2e71ee4cc23e512fa4a11a99d084de09f5dd418dd972a84d0ad6f6ddf523 WatchSource:0}: Error finding container ad9d2e71ee4cc23e512fa4a11a99d084de09f5dd418dd972a84d0ad6f6ddf523: Status 404 returned error can't find the container with id ad9d2e71ee4cc23e512fa4a11a99d084de09f5dd418dd972a84d0ad6f6ddf523
Sep 17 18:00:00.492600 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:00:00.492577    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142f88d0_1065_4ebb_89d0_109751afffd9.slice/crio-d3e37dc9bf445353fea0cf0c9545120c946e377e7e2ed6dad50be0ff81eb7618 WatchSource:0}: Error finding container d3e37dc9bf445353fea0cf0c9545120c946e377e7e2ed6dad50be0ff81eb7618: Status 404 returned error can't find the container with id d3e37dc9bf445353fea0cf0c9545120c946e377e7e2ed6dad50be0ff81eb7618
Sep 17 18:00:00.493137 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:00.493115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"]
Sep 17 18:00:01.034340 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:01.034247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx" event={"ID":"142f88d0-1065-4ebb-89d0-109751afffd9","Type":"ContainerStarted","Data":"fbea33390bbc0621c312017172815eb35466e44f2d7189d18dfa05869a6fd5c6"}
Sep 17 18:00:01.034340 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:01.034301    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx" event={"ID":"142f88d0-1065-4ebb-89d0-109751afffd9","Type":"ContainerStarted","Data":"d3e37dc9bf445353fea0cf0c9545120c946e377e7e2ed6dad50be0ff81eb7618"}
Sep 17 18:00:01.036002 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:01.035976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24" event={"ID":"a4fded79-26b2-404e-b089-c863180e37ff","Type":"ContainerStarted","Data":"bc0f5ef25b700036dcb192b2cb7c0e7ea4e572b88c8327a1eff7a23f154a5ca2"}
Sep 17 18:00:01.036118 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:01.036018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24" event={"ID":"a4fded79-26b2-404e-b089-c863180e37ff","Type":"ContainerStarted","Data":"ad9d2e71ee4cc23e512fa4a11a99d084de09f5dd418dd972a84d0ad6f6ddf523"}
Sep 17 18:00:01.052637 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:01.052593    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx" podStartSLOduration=1.052579475 podStartE2EDuration="1.052579475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:00:01.050502654 +0000 UTC m=+1708.828340289" watchObservedRunningTime="2026-09-17 18:00:01.052579475 +0000 UTC m=+1708.830417109"
Sep 17 18:00:01.068305 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:01.068262    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24" podStartSLOduration=1.068247315 podStartE2EDuration="1.068247315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:00:01.066922287 +0000 UTC m=+1708.844759922" watchObservedRunningTime="2026-09-17 18:00:01.068247315 +0000 UTC m=+1708.846084947"
Sep 17 18:00:01.196316 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:01.196287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:02.043510 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:02.043477    2559 generic.go:356] "Generic (PLEG): container finished" podID="142f88d0-1065-4ebb-89d0-109751afffd9" containerID="fbea33390bbc0621c312017172815eb35466e44f2d7189d18dfa05869a6fd5c6" exitCode=0
Sep 17 18:00:02.043702 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:02.043567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx" event={"ID":"142f88d0-1065-4ebb-89d0-109751afffd9","Type":"ContainerDied","Data":"fbea33390bbc0621c312017172815eb35466e44f2d7189d18dfa05869a6fd5c6"}
Sep 17 18:00:02.045127 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:02.045105    2559 generic.go:356] "Generic (PLEG): container finished" podID="a4fded79-26b2-404e-b089-c863180e37ff" containerID="bc0f5ef25b700036dcb192b2cb7c0e7ea4e572b88c8327a1eff7a23f154a5ca2" exitCode=0
Sep 17 18:00:02.045246 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:02.045133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24" event={"ID":"a4fded79-26b2-404e-b089-c863180e37ff","Type":"ContainerDied","Data":"bc0f5ef25b700036dcb192b2cb7c0e7ea4e572b88c8327a1eff7a23f154a5ca2"}
Sep 17 18:00:03.205881 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:03.205857    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24"
Sep 17 18:00:03.209057 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:03.209035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"
Sep 17 18:00:04.060836 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:04.060808    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24"
Sep 17 18:00:04.061017 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:04.060858    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827800-bqr24" event={"ID":"a4fded79-26b2-404e-b089-c863180e37ff","Type":"ContainerDied","Data":"ad9d2e71ee4cc23e512fa4a11a99d084de09f5dd418dd972a84d0ad6f6ddf523"}
Sep 17 18:00:04.061017 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:04.060911    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad9d2e71ee4cc23e512fa4a11a99d084de09f5dd418dd972a84d0ad6f6ddf523"
Sep 17 18:00:04.062260 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:04.062234    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"
Sep 17 18:00:04.062372 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:04.062233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx" event={"ID":"142f88d0-1065-4ebb-89d0-109751afffd9","Type":"ContainerDied","Data":"d3e37dc9bf445353fea0cf0c9545120c946e377e7e2ed6dad50be0ff81eb7618"}
Sep 17 18:00:04.062372 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:04.062348    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3e37dc9bf445353fea0cf0c9545120c946e377e7e2ed6dad50be0ff81eb7618"
Sep 17 18:00:09.064737 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:09.064705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:15.361935 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:15.361900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:56.444852 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:56.444811    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:57.284238 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:00:57.284211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:06.257101 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:01:06.257062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:30.757711 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:01:30.757659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:30.860103 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:01:30.860073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:34.502405 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:01:34.502377    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 18:01:34.508046 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:01:34.508027    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 18:01:34.833942 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:01:34.833859    2559 scope.go:117] "RemoveContainer" containerID="12ee3f18d104afd1443a56d0f1669ea6f7520473495fea54dd8f8573a7171090"
Sep 17 18:01:47.057218 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:01:47.057177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:02.439327 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:02.439301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:24.730748 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:24.730705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:25.763736 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:25.763705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:26.228603 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:26.228502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:26.629279 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:26.629250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:26.738947 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:26.738914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:29.459326 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:29.459279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:30.098646 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:30.098615    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:30.193171 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:30.193137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:30.385076 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:30.385001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:31.164732 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:31.164701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:32.066732 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:32.066699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:32.165775 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:32.165746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:32.281650 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:32.281620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:32.622529 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:32.622498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:32.726405 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:32.726370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:55.142790 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:55.142709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:57.725676 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:57.725639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:59.147438 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:59.147403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:59.608770 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:59.608738    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:59.735721 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:59.735694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:59.839926 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:02:59.839896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:00.771792 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:00.771759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:02.529333 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:02.529292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:02.645621 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:02.645581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:02.879274 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:02.879197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:03.553788 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:03.553755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:03.849826 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:03.849731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:04.276483 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.276447    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"]
Sep 17 18:03:04.276857 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.276844    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4fded79-26b2-404e-b089-c863180e37ff" containerName="cleanup"
Sep 17 18:03:04.276905 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.276858    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4fded79-26b2-404e-b089-c863180e37ff" containerName="cleanup"
Sep 17 18:03:04.276905 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.276884    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142f88d0-1065-4ebb-89d0-109751afffd9" containerName="cleanup"
Sep 17 18:03:04.276905 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.276892    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="142f88d0-1065-4ebb-89d0-109751afffd9" containerName="cleanup"
Sep 17 18:03:04.277000 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.276956    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="142f88d0-1065-4ebb-89d0-109751afffd9" containerName="cleanup"
Sep 17 18:03:04.277000 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.276964    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4fded79-26b2-404e-b089-c863180e37ff" containerName="cleanup"
Sep 17 18:03:04.280075 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.280058    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.283729 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.283707    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-b77ab2\""
Sep 17 18:03:04.284130 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.284112    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-b77ab2-dockercfg-5lln4\""
Sep 17 18:03:04.312132 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.312103    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"]
Sep 17 18:03:04.314901 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.314872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9699c47-bb88-4d87-8108-f0fac0918646-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.315034 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.314922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8nlh\" (UniqueName: \"kubernetes.io/projected/b9699c47-bb88-4d87-8108-f0fac0918646-kube-api-access-t8nlh\") pod \"payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.415656 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.415625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9699c47-bb88-4d87-8108-f0fac0918646-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.415834 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.415675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8nlh\" (UniqueName: \"kubernetes.io/projected/b9699c47-bb88-4d87-8108-f0fac0918646-kube-api-access-t8nlh\") pod \"payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.416327 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.416306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9699c47-bb88-4d87-8108-f0fac0918646-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.428134 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.428102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8nlh\" (UniqueName: \"kubernetes.io/projected/b9699c47-bb88-4d87-8108-f0fac0918646-kube-api-access-t8nlh\") pod \"payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.589983 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.589897    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:04.881972 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.881886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:04.892097 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:04.892074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"]
Sep 17 18:03:04.893677 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:03:04.893650    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9699c47_bb88_4d87_8108_f0fac0918646.slice/crio-b439e1c7f902575019df50fba2a11911c25dd090f23331f3ae62525ad14f5024 WatchSource:0}: Error finding container b439e1c7f902575019df50fba2a11911c25dd090f23331f3ae62525ad14f5024: Status 404 returned error can't find the container with id b439e1c7f902575019df50fba2a11911c25dd090f23331f3ae62525ad14f5024
Sep 17 18:03:05.129235 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:05.129200    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx" event={"ID":"b9699c47-bb88-4d87-8108-f0fac0918646","Type":"ContainerStarted","Data":"82e127d0e81049c88fb2b140b44d09a0f85af3d268d01f8c648d648d4b59af4b"}
Sep 17 18:03:05.129429 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:05.129255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx" event={"ID":"b9699c47-bb88-4d87-8108-f0fac0918646","Type":"ContainerStarted","Data":"b439e1c7f902575019df50fba2a11911c25dd090f23331f3ae62525ad14f5024"}
Sep 17 18:03:05.129429 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:05.129277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:05.176717 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:05.176610    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx" podStartSLOduration=1.176587158 podStartE2EDuration="1.176587158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:03:05.161035531 +0000 UTC m=+1892.938873167" watchObservedRunningTime="2026-09-17 18:03:05.176587158 +0000 UTC m=+1892.954424796"
Sep 17 18:03:06.103215 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:06.103180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:09.088721 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:09.088686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:10.631481 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:10.631447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:16.138429 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:16.138397    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:03:24.731958 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:24.731924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:26.383437 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:26.383382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:27.346996 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:27.346959    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:28.276284 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:28.276255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:29.456599 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:29.456570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:29.756221 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:29.756182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:30.559751 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:30.559719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:34.868617 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:34.868584    2559 scope.go:117] "RemoveContainer" containerID="c75a6db30db5fdf56b8bd48178958f8e8aa1aaa8fbb92c9195cb92e7763b6af5"
Sep 17 18:03:34.987372 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:34.987335    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-v2ghz_5cbcb970-eed0-4ee7-9c15-9f0329ca2946/payload-processing/0.log"
Sep 17 18:03:35.126930 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:35.126845    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx_b9699c47-bb88-4d87-8108-f0fac0918646/payload-processing/0.log"
Sep 17 18:03:42.099964 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:42.099927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:50.120059 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:03:50.120016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:21.786065 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:21.785990    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-v2ghz_5cbcb970-eed0-4ee7-9c15-9f0329ca2946/payload-processing/0.log"
Sep 17 18:04:21.923779 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:21.923751    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx_b9699c47-bb88-4d87-8108-f0fac0918646/payload-processing/0.log"
Sep 17 18:04:22.058645 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:22.058562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx_b9699c47-bb88-4d87-8108-f0fac0918646/payload-processing/0.log"
Sep 17 18:04:22.363967 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:22.363870    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:22.752903 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:22.752869    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:23.003292 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:23.003208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:25.789032 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:25.788995    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:25.884348 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:25.884312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:25.995187 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:25.995151    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:27.050245 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:27.050213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:28.238426 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:28.238389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:29.308488 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:29.308451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:30.229860 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:30.229823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:30.321013 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:30.320982    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:30.489080 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:30.488999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:30.604049 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:30.604019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:31.014683 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.014649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:31.148341 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.148303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:31.278591 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.278491    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"]
Sep 17 18:04:31.281441 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.281419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.288109 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.288084    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-58f131\""
Sep 17 18:04:31.288276 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.288255    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-58f131-dockercfg-twl9n\""
Sep 17 18:04:31.307861 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.307830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"]
Sep 17 18:04:31.343814 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.343773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzdw\" (UniqueName: \"kubernetes.io/projected/172c5242-fc93-49c9-8357-73ed1732ff02-kube-api-access-5kzdw\") pod \"payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.343814 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.343820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/172c5242-fc93-49c9-8357-73ed1732ff02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.445318 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.445276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzdw\" (UniqueName: \"kubernetes.io/projected/172c5242-fc93-49c9-8357-73ed1732ff02-kube-api-access-5kzdw\") pod \"payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.445318 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.445322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/172c5242-fc93-49c9-8357-73ed1732ff02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.446083 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.446063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/172c5242-fc93-49c9-8357-73ed1732ff02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.462255 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.462216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzdw\" (UniqueName: \"kubernetes.io/projected/172c5242-fc93-49c9-8357-73ed1732ff02-kube-api-access-5kzdw\") pod \"payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.592075 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.591979    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:31.883640 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:31.883611    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"]
Sep 17 18:04:31.885149 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:04:31.885122    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172c5242_fc93_49c9_8357_73ed1732ff02.slice/crio-67d6abcc2eb8c617c579b85bf8020fabc605d0bafdc1905d6c706ae3e8d0bd57 WatchSource:0}: Error finding container 67d6abcc2eb8c617c579b85bf8020fabc605d0bafdc1905d6c706ae3e8d0bd57: Status 404 returned error can't find the container with id 67d6abcc2eb8c617c579b85bf8020fabc605d0bafdc1905d6c706ae3e8d0bd57
Sep 17 18:04:32.670209 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:32.670169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc" event={"ID":"172c5242-fc93-49c9-8357-73ed1732ff02","Type":"ContainerStarted","Data":"5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0"}
Sep 17 18:04:32.670661 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:32.670242    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:32.670661 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:32.670267    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc" event={"ID":"172c5242-fc93-49c9-8357-73ed1732ff02","Type":"ContainerStarted","Data":"67d6abcc2eb8c617c579b85bf8020fabc605d0bafdc1905d6c706ae3e8d0bd57"}
Sep 17 18:04:32.700317 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:32.700264    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc" podStartSLOduration=1.700247084 podStartE2EDuration="1.700247084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:32.698604587 +0000 UTC m=+1980.476442220" watchObservedRunningTime="2026-09-17 18:04:32.700247084 +0000 UTC m=+1980.478084718"
Sep 17 18:04:34.894877 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:34.894844    2559 scope.go:117] "RemoveContainer" containerID="1f9973aa2d82d7cc8424a087c3670f873ed6745305400ff6920f01ca213f6543"
Sep 17 18:04:34.903838 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:34.903817    2559 scope.go:117] "RemoveContainer" containerID="f859d232b2edeeb800fd8b7e63797c2fb447f54b473884a21213dff8c335ce77"
Sep 17 18:04:34.912036 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:34.912012    2559 scope.go:117] "RemoveContainer" containerID="760afea53b9605d75519ccafb981c77d118a98ef04604458689ed2799a2223ad"
Sep 17 18:04:43.680460 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:43.680422    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:04:50.066686 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:50.066651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:50.168566 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:50.168534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:54.885054 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:54.885024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:55.861891 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:55.861855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:55.963492 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:55.963460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:56.641358 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.641316    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"]
Sep 17 18:04:56.646403 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.646381    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"
Sep 17 18:04:56.649390 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.649369    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 18:04:56.649533 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.649393    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 18:04:56.659454 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.659431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"]
Sep 17 18:04:56.694698 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.694655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edeccc7-466e-4426-8197-ade6a908846d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244\" (UID: \"0edeccc7-466e-4426-8197-ade6a908846d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"
Sep 17 18:04:56.795645 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.795592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edeccc7-466e-4426-8197-ade6a908846d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244\" (UID: \"0edeccc7-466e-4426-8197-ade6a908846d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"
Sep 17 18:04:56.796231 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.796210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edeccc7-466e-4426-8197-ade6a908846d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244\" (UID: \"0edeccc7-466e-4426-8197-ade6a908846d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"
Sep 17 18:04:56.956718 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:56.956633    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"
Sep 17 18:04:57.239098 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:57.239068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"]
Sep 17 18:04:57.241935 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:04:57.241910    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edeccc7_466e_4426_8197_ade6a908846d.slice/crio-b2c0c277d4a596382a44cf535ee153bd41f96152777ebe49d97b752d1079c0a2 WatchSource:0}: Error finding container b2c0c277d4a596382a44cf535ee153bd41f96152777ebe49d97b752d1079c0a2: Status 404 returned error can't find the container with id b2c0c277d4a596382a44cf535ee153bd41f96152777ebe49d97b752d1079c0a2
Sep 17 18:04:57.296048 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:57.296021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:57.832986 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:57.832897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244" event={"ID":"0edeccc7-466e-4426-8197-ade6a908846d","Type":"ContainerStarted","Data":"1ed84841bd09b755c792127854adba66cbd097bec24285afa15fb16ae8f51712"}
Sep 17 18:04:57.832986 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:57.832956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244" event={"ID":"0edeccc7-466e-4426-8197-ade6a908846d","Type":"ContainerStarted","Data":"b2c0c277d4a596382a44cf535ee153bd41f96152777ebe49d97b752d1079c0a2"}
Sep 17 18:04:57.862858 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:57.862803    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244" podStartSLOduration=1.862785652 podStartE2EDuration="1.862785652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:57.862318445 +0000 UTC m=+2005.640156081" watchObservedRunningTime="2026-09-17 18:04:57.862785652 +0000 UTC m=+2005.640623288"
Sep 17 18:04:58.333929 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:58.333900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:58.839951 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:58.839913    2559 generic.go:356] "Generic (PLEG): container finished" podID="0edeccc7-466e-4426-8197-ade6a908846d" containerID="1ed84841bd09b755c792127854adba66cbd097bec24285afa15fb16ae8f51712" exitCode=0
Sep 17 18:04:58.840156 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:58.839993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244" event={"ID":"0edeccc7-466e-4426-8197-ade6a908846d","Type":"ContainerDied","Data":"1ed84841bd09b755c792127854adba66cbd097bec24285afa15fb16ae8f51712"}
Sep 17 18:04:59.233881 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:59.233771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:59.983590 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:04:59.983563    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"
Sep 17 18:05:00.022896 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:00.022861    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edeccc7-466e-4426-8197-ade6a908846d-maas-api-service-ca\") pod \"0edeccc7-466e-4426-8197-ade6a908846d\" (UID: \"0edeccc7-466e-4426-8197-ade6a908846d\") "
Sep 17 18:05:00.023203 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:00.023183    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0edeccc7-466e-4426-8197-ade6a908846d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0edeccc7-466e-4426-8197-ade6a908846d" (UID: "0edeccc7-466e-4426-8197-ade6a908846d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:05:00.124683 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:00.124589    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edeccc7-466e-4426-8197-ade6a908846d-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:05:00.275063 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:00.275034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:00.853413 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:00.853365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244" event={"ID":"0edeccc7-466e-4426-8197-ade6a908846d","Type":"ContainerDied","Data":"b2c0c277d4a596382a44cf535ee153bd41f96152777ebe49d97b752d1079c0a2"}
Sep 17 18:05:00.853620 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:00.853423    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2c0c277d4a596382a44cf535ee153bd41f96152777ebe49d97b752d1079c0a2"
Sep 17 18:05:00.853620 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:00.853374    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"
Sep 17 18:05:01.172724 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:01.172638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:02.180779 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:02.180746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:02.904469 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:02.904435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:03.007918 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:03.007887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:07.827400 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:07.827353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:08.781730 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:08.781697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:08.876621 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:08.876583    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"]
Sep 17 18:05:08.877031 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:08.876843    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc" podUID="172c5242-fc93-49c9-8357-73ed1732ff02" containerName="payload-processing" containerID="cri-o://5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0" gracePeriod=30
Sep 17 18:05:08.959278 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:08.959235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:09.074655 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.074626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:09.137051 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.137018    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:05:09.197966 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.197935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:09.213211 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.213174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kzdw\" (UniqueName: \"kubernetes.io/projected/172c5242-fc93-49c9-8357-73ed1732ff02-kube-api-access-5kzdw\") pod \"172c5242-fc93-49c9-8357-73ed1732ff02\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") "
Sep 17 18:05:09.213369 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.213263    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/172c5242-fc93-49c9-8357-73ed1732ff02-plugins-config-volume\") pod \"172c5242-fc93-49c9-8357-73ed1732ff02\" (UID: \"172c5242-fc93-49c9-8357-73ed1732ff02\") "
Sep 17 18:05:09.213700 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.213669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/172c5242-fc93-49c9-8357-73ed1732ff02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "172c5242-fc93-49c9-8357-73ed1732ff02" (UID: "172c5242-fc93-49c9-8357-73ed1732ff02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:05:09.215396 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.215370    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172c5242-fc93-49c9-8357-73ed1732ff02-kube-api-access-5kzdw" (OuterVolumeSpecName: "kube-api-access-5kzdw") pod "172c5242-fc93-49c9-8357-73ed1732ff02" (UID: "172c5242-fc93-49c9-8357-73ed1732ff02"). InnerVolumeSpecName "kube-api-access-5kzdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:05:09.302459 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.302369    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:09.314697 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.314668    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kzdw\" (UniqueName: \"kubernetes.io/projected/172c5242-fc93-49c9-8357-73ed1732ff02-kube-api-access-5kzdw\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:05:09.314697 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.314695    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/172c5242-fc93-49c9-8357-73ed1732ff02-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:05:09.362426 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.362383    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"]
Sep 17 18:05:09.369910 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.369881    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-58f131-qs244"]
Sep 17 18:05:09.776999 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.776968    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:09.905936 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.905903    2559 generic.go:356] "Generic (PLEG): container finished" podID="172c5242-fc93-49c9-8357-73ed1732ff02" containerID="5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0" exitCode=0
Sep 17 18:05:09.906380 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.905951    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"
Sep 17 18:05:09.906380 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.905993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc" event={"ID":"172c5242-fc93-49c9-8357-73ed1732ff02","Type":"ContainerDied","Data":"5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0"}
Sep 17 18:05:09.906380 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.906037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc" event={"ID":"172c5242-fc93-49c9-8357-73ed1732ff02","Type":"ContainerDied","Data":"67d6abcc2eb8c617c579b85bf8020fabc605d0bafdc1905d6c706ae3e8d0bd57"}
Sep 17 18:05:09.906380 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.906061    2559 scope.go:117] "RemoveContainer" containerID="5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0"
Sep 17 18:05:09.915529 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.915502    2559 scope.go:117] "RemoveContainer" containerID="5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0"
Sep 17 18:05:09.915800 ip-10-0-133-160 kubenswrapper[2559]: E0917 18:05:09.915782    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0\": container with ID starting with 5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0 not found: ID does not exist" containerID="5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0"
Sep 17 18:05:09.915900 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.915810    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0"} err="failed to get container status \"5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0\": rpc error: code = NotFound desc = could not find container \"5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0\": container with ID starting with 5b8c9d89ddc92939ac2a93591cc69ff68a3c13b766e02e9e02fc630e24a6c2b0 not found: ID does not exist"
Sep 17 18:05:09.947870 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.947840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:09.948322 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.948300    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"]
Sep 17 18:05:09.963074 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:09.963039    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-58f131-696fd4b947-7ngbc"]
Sep 17 18:05:10.399779 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:10.399750    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0edeccc7-466e-4426-8197-ade6a908846d" path="/var/lib/kubelet/pods/0edeccc7-466e-4426-8197-ade6a908846d/volumes"
Sep 17 18:05:10.400118 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:10.400106    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="172c5242-fc93-49c9-8357-73ed1732ff02" path="/var/lib/kubelet/pods/172c5242-fc93-49c9-8357-73ed1732ff02/volumes"
Sep 17 18:05:11.514527 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:11.514493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:12.821978 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:12.821942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:13.917127 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:13.917096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:15.230707 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:15.230668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:17.476280 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:17.476248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:17.602673 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:17.602643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:17.895495 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:17.895468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:21.810087 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.810053    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"]
Sep 17 18:05:21.810465 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.810448    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172c5242-fc93-49c9-8357-73ed1732ff02" containerName="payload-processing"
Sep 17 18:05:21.810465 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.810460    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="172c5242-fc93-49c9-8357-73ed1732ff02" containerName="payload-processing"
Sep 17 18:05:21.810553 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.810480    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0edeccc7-466e-4426-8197-ade6a908846d" containerName="revoke-keys"
Sep 17 18:05:21.810553 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.810486    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0edeccc7-466e-4426-8197-ade6a908846d" containerName="revoke-keys"
Sep 17 18:05:21.810623 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.810556    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="172c5242-fc93-49c9-8357-73ed1732ff02" containerName="payload-processing"
Sep 17 18:05:21.810623 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.810565    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0edeccc7-466e-4426-8197-ade6a908846d" containerName="revoke-keys"
Sep 17 18:05:21.815042 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.815022    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"
Sep 17 18:05:21.817789 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.817765    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 18:05:21.817950 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.817930    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 18:05:21.913572 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.913536    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"]
Sep 17 18:05:21.944808 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:21.944773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9424d1f-67b4-4c8c-bb6d-7b539de8f036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc\" (UID: \"c9424d1f-67b4-4c8c-bb6d-7b539de8f036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"
Sep 17 18:05:22.045501 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:22.045464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9424d1f-67b4-4c8c-bb6d-7b539de8f036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc\" (UID: \"c9424d1f-67b4-4c8c-bb6d-7b539de8f036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"
Sep 17 18:05:22.046106 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:22.046086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9424d1f-67b4-4c8c-bb6d-7b539de8f036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc\" (UID: \"c9424d1f-67b4-4c8c-bb6d-7b539de8f036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"
Sep 17 18:05:22.052435 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:22.052410    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:22.125669 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:22.125575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"
Sep 17 18:05:22.413449 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:22.413420    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"]
Sep 17 18:05:22.414809 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:05:22.414785    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9424d1f_67b4_4c8c_bb6d_7b539de8f036.slice/crio-bae90e30eb183fae72a11d90fa4ad11e9ddd2a49240dd5afd26456d15d15242f WatchSource:0}: Error finding container bae90e30eb183fae72a11d90fa4ad11e9ddd2a49240dd5afd26456d15d15242f: Status 404 returned error can't find the container with id bae90e30eb183fae72a11d90fa4ad11e9ddd2a49240dd5afd26456d15d15242f
Sep 17 18:05:22.988971 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:22.988874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc" event={"ID":"c9424d1f-67b4-4c8c-bb6d-7b539de8f036","Type":"ContainerStarted","Data":"15e417d9f63c9caaebad440a7efbe95ec42c24ff70191a9c41ab0fa3f952ef74"}
Sep 17 18:05:22.988971 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:22.988925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc" event={"ID":"c9424d1f-67b4-4c8c-bb6d-7b539de8f036","Type":"ContainerStarted","Data":"bae90e30eb183fae72a11d90fa4ad11e9ddd2a49240dd5afd26456d15d15242f"}
Sep 17 18:05:23.041868 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:23.041815    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc" podStartSLOduration=2.041799534 podStartE2EDuration="2.041799534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:05:23.035438258 +0000 UTC m=+2030.813275892" watchObservedRunningTime="2026-09-17 18:05:23.041799534 +0000 UTC m=+2030.819637169"
Sep 17 18:05:23.312422 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:23.312391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:23.996587 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:23.996555    2559 generic.go:356] "Generic (PLEG): container finished" podID="c9424d1f-67b4-4c8c-bb6d-7b539de8f036" containerID="15e417d9f63c9caaebad440a7efbe95ec42c24ff70191a9c41ab0fa3f952ef74" exitCode=0
Sep 17 18:05:23.996944 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:23.996617    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc" event={"ID":"c9424d1f-67b4-4c8c-bb6d-7b539de8f036","Type":"ContainerDied","Data":"15e417d9f63c9caaebad440a7efbe95ec42c24ff70191a9c41ab0fa3f952ef74"}
Sep 17 18:05:24.599697 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:24.599669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:25.143683 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:25.143657    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"
Sep 17 18:05:25.277994 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:25.277899    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9424d1f-67b4-4c8c-bb6d-7b539de8f036-maas-api-service-ca\") pod \"c9424d1f-67b4-4c8c-bb6d-7b539de8f036\" (UID: \"c9424d1f-67b4-4c8c-bb6d-7b539de8f036\") "
Sep 17 18:05:25.278283 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:25.278259    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9424d1f-67b4-4c8c-bb6d-7b539de8f036-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c9424d1f-67b4-4c8c-bb6d-7b539de8f036" (UID: "c9424d1f-67b4-4c8c-bb6d-7b539de8f036"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:05:25.379200 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:25.379165    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9424d1f-67b4-4c8c-bb6d-7b539de8f036-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:05:25.525910 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:25.525877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:26.009889 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:26.009858    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"
Sep 17 18:05:26.010096 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:26.009895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc" event={"ID":"c9424d1f-67b4-4c8c-bb6d-7b539de8f036","Type":"ContainerDied","Data":"bae90e30eb183fae72a11d90fa4ad11e9ddd2a49240dd5afd26456d15d15242f"}
Sep 17 18:05:26.010096 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:26.009941    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bae90e30eb183fae72a11d90fa4ad11e9ddd2a49240dd5afd26456d15d15242f"
Sep 17 18:05:26.570028 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:26.569996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:27.626863 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:27.626833    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:34.942311 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:34.942280    2559 scope.go:117] "RemoveContainer" containerID="a8e849926825f18f5c484cc4164ecbc864e36b83c227411de3c25fc6907ad145"
Sep 17 18:05:34.951212 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:34.951192    2559 scope.go:117] "RemoveContainer" containerID="59e8faf82fb3dbc9bd65abcc5cb7266bafade56baf3de3b5470c6560a5544bd5"
Sep 17 18:05:37.617999 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:37.617962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:37.760226 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:37.760195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:37.869778 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:37.869701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:37.999735 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:37.999704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:38.115277 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:38.115242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:38.124737 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:38.124658    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"]
Sep 17 18:05:38.131433 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:38.131404    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dba35d-gttwc"]
Sep 17 18:05:38.399669 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:38.399594    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9424d1f-67b4-4c8c-bb6d-7b539de8f036" path="/var/lib/kubelet/pods/c9424d1f-67b4-4c8c-bb6d-7b539de8f036/volumes"
Sep 17 18:05:38.521660 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:38.521629    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:38.678723 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:38.678635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:39.804937 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:39.804910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:41.014284 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:41.014250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:42.077845 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:42.077817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:43.599803 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:43.599768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:54.606015 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:54.605936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:54.666690 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:05:54.666640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:12.711478 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:12.711442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:20.428270 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:20.428233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:22.192824 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:22.192792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:28.782449 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:28.782397    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:28.843547 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:28.843484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:29.096139 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.096020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:29.431629 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.431545    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"]
Sep 17 18:06:29.431982 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.431968    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9424d1f-67b4-4c8c-bb6d-7b539de8f036" containerName="revoke-keys"
Sep 17 18:06:29.432031 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.431984    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9424d1f-67b4-4c8c-bb6d-7b539de8f036" containerName="revoke-keys"
Sep 17 18:06:29.432067 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.432046    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9424d1f-67b4-4c8c-bb6d-7b539de8f036" containerName="revoke-keys"
Sep 17 18:06:29.435265 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.435246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"
Sep 17 18:06:29.439319 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.439295    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 18:06:29.439412 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.439295    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 18:06:29.448111 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.448084    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"]
Sep 17 18:06:29.571884 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.571854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9055f0-d5f5-4e53-82da-8ba509846c97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr\" (UID: \"9d9055f0-d5f5-4e53-82da-8ba509846c97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"
Sep 17 18:06:29.672658 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.672630    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9055f0-d5f5-4e53-82da-8ba509846c97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr\" (UID: \"9d9055f0-d5f5-4e53-82da-8ba509846c97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"
Sep 17 18:06:29.673212 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.673192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9055f0-d5f5-4e53-82da-8ba509846c97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr\" (UID: \"9d9055f0-d5f5-4e53-82da-8ba509846c97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"
Sep 17 18:06:29.745926 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:29.745852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"
Sep 17 18:06:30.024633 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:30.024603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"]
Sep 17 18:06:30.025051 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:06:30.025029    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9055f0_d5f5_4e53_82da_8ba509846c97.slice/crio-c6c5fada587582efb6a7f6873bb4bbfd5977f1521cec42478b7a36622f2ecd70 WatchSource:0}: Error finding container c6c5fada587582efb6a7f6873bb4bbfd5977f1521cec42478b7a36622f2ecd70: Status 404 returned error can't find the container with id c6c5fada587582efb6a7f6873bb4bbfd5977f1521cec42478b7a36622f2ecd70
Sep 17 18:06:30.384707 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:30.384680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr" event={"ID":"9d9055f0-d5f5-4e53-82da-8ba509846c97","Type":"ContainerStarted","Data":"54fe8da8f6fd0d48b11b83662fa7c3380f10ff6515b447d1380c90ccec26b4ff"}
Sep 17 18:06:30.384817 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:30.384731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr" event={"ID":"9d9055f0-d5f5-4e53-82da-8ba509846c97","Type":"ContainerStarted","Data":"c6c5fada587582efb6a7f6873bb4bbfd5977f1521cec42478b7a36622f2ecd70"}
Sep 17 18:06:30.408421 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:30.408372    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr" podStartSLOduration=1.4083584390000001 podStartE2EDuration="1.408358439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:06:30.405187601 +0000 UTC m=+2098.183025239" watchObservedRunningTime="2026-09-17 18:06:30.408358439 +0000 UTC m=+2098.186196073"
Sep 17 18:06:30.537093 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:30.537066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:31.392587 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:31.392550    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d9055f0-d5f5-4e53-82da-8ba509846c97" containerID="54fe8da8f6fd0d48b11b83662fa7c3380f10ff6515b447d1380c90ccec26b4ff" exitCode=0
Sep 17 18:06:31.392978 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:31.392693    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr" event={"ID":"9d9055f0-d5f5-4e53-82da-8ba509846c97","Type":"ContainerDied","Data":"54fe8da8f6fd0d48b11b83662fa7c3380f10ff6515b447d1380c90ccec26b4ff"}
Sep 17 18:06:31.575459 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:31.575431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:32.532050 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:32.532025    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"
Sep 17 18:06:32.600101 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:32.600070    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9055f0-d5f5-4e53-82da-8ba509846c97-maas-api-service-ca\") pod \"9d9055f0-d5f5-4e53-82da-8ba509846c97\" (UID: \"9d9055f0-d5f5-4e53-82da-8ba509846c97\") "
Sep 17 18:06:32.600418 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:32.600396    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9055f0-d5f5-4e53-82da-8ba509846c97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d9055f0-d5f5-4e53-82da-8ba509846c97" (UID: "9d9055f0-d5f5-4e53-82da-8ba509846c97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:32.701665 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:32.701580    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9055f0-d5f5-4e53-82da-8ba509846c97-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:06:32.799036 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:32.798990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:33.406999 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:33.406969    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"
Sep 17 18:06:33.406999 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:33.406981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr" event={"ID":"9d9055f0-d5f5-4e53-82da-8ba509846c97","Type":"ContainerDied","Data":"c6c5fada587582efb6a7f6873bb4bbfd5977f1521cec42478b7a36622f2ecd70"}
Sep 17 18:06:33.407260 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:33.407020    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6c5fada587582efb6a7f6873bb4bbfd5977f1521cec42478b7a36622f2ecd70"
Sep 17 18:06:33.776398 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:33.776364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:34.548204 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:34.548175    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 18:06:34.553485 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:34.553461    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 18:06:40.256535 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.256478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:40.295149 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.295109    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"]
Sep 17 18:06:40.295389 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.295363    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx" podUID="b9699c47-bb88-4d87-8108-f0fac0918646" containerName="payload-processing" containerID="cri-o://82e127d0e81049c88fb2b140b44d09a0f85af3d268d01f8c648d648d4b59af4b" gracePeriod=30
Sep 17 18:06:40.357857 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.357827    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:40.447905 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.447870    2559 generic.go:356] "Generic (PLEG): container finished" podID="b9699c47-bb88-4d87-8108-f0fac0918646" containerID="82e127d0e81049c88fb2b140b44d09a0f85af3d268d01f8c648d648d4b59af4b" exitCode=0
Sep 17 18:06:40.448088 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.447945    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx" event={"ID":"b9699c47-bb88-4d87-8108-f0fac0918646","Type":"ContainerDied","Data":"82e127d0e81049c88fb2b140b44d09a0f85af3d268d01f8c648d648d4b59af4b"}
Sep 17 18:06:40.461101 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.461072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:40.554066 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.554037    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:06:40.572166 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.572127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:40.605859 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.605826    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"]
Sep 17 18:06:40.609762 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.609732    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77ab2-f76rr"]
Sep 17 18:06:40.674143 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.674113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:40.680175 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.680154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9699c47-bb88-4d87-8108-f0fac0918646-plugins-config-volume\") pod \"b9699c47-bb88-4d87-8108-f0fac0918646\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") "
Sep 17 18:06:40.680264 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.680238    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8nlh\" (UniqueName: \"kubernetes.io/projected/b9699c47-bb88-4d87-8108-f0fac0918646-kube-api-access-t8nlh\") pod \"b9699c47-bb88-4d87-8108-f0fac0918646\" (UID: \"b9699c47-bb88-4d87-8108-f0fac0918646\") "
Sep 17 18:06:40.680510 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.680490    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9699c47-bb88-4d87-8108-f0fac0918646-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9699c47-bb88-4d87-8108-f0fac0918646" (UID: "b9699c47-bb88-4d87-8108-f0fac0918646"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:40.682324 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.682300    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9699c47-bb88-4d87-8108-f0fac0918646-kube-api-access-t8nlh" (OuterVolumeSpecName: "kube-api-access-t8nlh") pod "b9699c47-bb88-4d87-8108-f0fac0918646" (UID: "b9699c47-bb88-4d87-8108-f0fac0918646"). InnerVolumeSpecName "kube-api-access-t8nlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:40.781278 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.781247    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8nlh\" (UniqueName: \"kubernetes.io/projected/b9699c47-bb88-4d87-8108-f0fac0918646-kube-api-access-t8nlh\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:06:40.781278 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.781273    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9699c47-bb88-4d87-8108-f0fac0918646-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:06:40.988074 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:40.987989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:41.092555 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:41.092489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:41.455476 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:41.455440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx" event={"ID":"b9699c47-bb88-4d87-8108-f0fac0918646","Type":"ContainerDied","Data":"b439e1c7f902575019df50fba2a11911c25dd090f23331f3ae62525ad14f5024"}
Sep 17 18:06:41.455936 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:41.455502    2559 scope.go:117] "RemoveContainer" containerID="82e127d0e81049c88fb2b140b44d09a0f85af3d268d01f8c648d648d4b59af4b"
Sep 17 18:06:41.455936 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:41.455460    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"
Sep 17 18:06:41.485270 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:41.485242    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"]
Sep 17 18:06:41.497277 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:41.497243    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77ab2-5d5c8fd6d5-lpwsx"]
Sep 17 18:06:42.036110 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:42.036074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:42.400038 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:42.399960    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9055f0-d5f5-4e53-82da-8ba509846c97" path="/var/lib/kubelet/pods/9d9055f0-d5f5-4e53-82da-8ba509846c97/volumes"
Sep 17 18:06:42.400338 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:42.400324    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9699c47-bb88-4d87-8108-f0fac0918646" path="/var/lib/kubelet/pods/b9699c47-bb88-4d87-8108-f0fac0918646/volumes"
Sep 17 18:06:43.083984 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:43.083947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:48.428220 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:48.428189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:48.501944 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:48.501909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:48.748943 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:48.748913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:49.147395 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.147318    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"]
Sep 17 18:06:49.147791 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.147776    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9055f0-d5f5-4e53-82da-8ba509846c97" containerName="revoke-keys"
Sep 17 18:06:49.147846 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.147792    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9055f0-d5f5-4e53-82da-8ba509846c97" containerName="revoke-keys"
Sep 17 18:06:49.147846 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.147806    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9699c47-bb88-4d87-8108-f0fac0918646" containerName="payload-processing"
Sep 17 18:06:49.147846 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.147812    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9699c47-bb88-4d87-8108-f0fac0918646" containerName="payload-processing"
Sep 17 18:06:49.147950 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.147885    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9055f0-d5f5-4e53-82da-8ba509846c97" containerName="revoke-keys"
Sep 17 18:06:49.147950 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.147899    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9699c47-bb88-4d87-8108-f0fac0918646" containerName="payload-processing"
Sep 17 18:06:49.152408 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.152387    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"
Sep 17 18:06:49.156462 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.156441    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 18:06:49.156605 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.156484    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 18:06:49.174199 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.174172    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"]
Sep 17 18:06:49.261649 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.261605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffd3232-a5d6-477d-a416-b55837932704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8\" (UID: \"7ffd3232-a5d6-477d-a416-b55837932704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"
Sep 17 18:06:49.335201 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.335166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:49.362402 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.362361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffd3232-a5d6-477d-a416-b55837932704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8\" (UID: \"7ffd3232-a5d6-477d-a416-b55837932704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"
Sep 17 18:06:49.363102 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.363083    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffd3232-a5d6-477d-a416-b55837932704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8\" (UID: \"7ffd3232-a5d6-477d-a416-b55837932704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"
Sep 17 18:06:49.463335 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.463247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"
Sep 17 18:06:49.749114 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:49.749089    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"]
Sep 17 18:06:49.751122 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:06:49.751091    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffd3232_a5d6_477d_a416_b55837932704.slice/crio-f3f5ab49363964ad82dca815210bbe288fffdbdafdd5eb9a21b8330a065c187d WatchSource:0}: Error finding container f3f5ab49363964ad82dca815210bbe288fffdbdafdd5eb9a21b8330a065c187d: Status 404 returned error can't find the container with id f3f5ab49363964ad82dca815210bbe288fffdbdafdd5eb9a21b8330a065c187d
Sep 17 18:06:50.314615 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:50.314506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:50.518305 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:50.518268    2559 generic.go:356] "Generic (PLEG): container finished" podID="7ffd3232-a5d6-477d-a416-b55837932704" containerID="e800089cb031f7236ab846d0950a7383ed05d464ae93dd3a40414014719a5a93" exitCode=0
Sep 17 18:06:50.518739 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:50.518342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8" event={"ID":"7ffd3232-a5d6-477d-a416-b55837932704","Type":"ContainerDied","Data":"e800089cb031f7236ab846d0950a7383ed05d464ae93dd3a40414014719a5a93"}
Sep 17 18:06:50.518739 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:50.518390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8" event={"ID":"7ffd3232-a5d6-477d-a416-b55837932704","Type":"ContainerStarted","Data":"f3f5ab49363964ad82dca815210bbe288fffdbdafdd5eb9a21b8330a065c187d"}
Sep 17 18:06:51.403193 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:51.403163    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:51.658731 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:51.658675    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"
Sep 17 18:06:51.786045 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:51.786011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffd3232-a5d6-477d-a416-b55837932704-maas-api-service-ca\") pod \"7ffd3232-a5d6-477d-a416-b55837932704\" (UID: \"7ffd3232-a5d6-477d-a416-b55837932704\") "
Sep 17 18:06:51.786407 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:51.786379    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ffd3232-a5d6-477d-a416-b55837932704-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ffd3232-a5d6-477d-a416-b55837932704" (UID: "7ffd3232-a5d6-477d-a416-b55837932704"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:51.886833 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:51.886798    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffd3232-a5d6-477d-a416-b55837932704-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:06:52.318969 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:52.318935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:52.531040 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:52.531009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8" event={"ID":"7ffd3232-a5d6-477d-a416-b55837932704","Type":"ContainerDied","Data":"f3f5ab49363964ad82dca815210bbe288fffdbdafdd5eb9a21b8330a065c187d"}
Sep 17 18:06:52.531207 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:52.531056    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3f5ab49363964ad82dca815210bbe288fffdbdafdd5eb9a21b8330a065c187d"
Sep 17 18:06:52.531207 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:52.531020    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"
Sep 17 18:06:54.049056 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:54.049028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:59.906261 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:59.906229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:59.975299 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:59.975259    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"]
Sep 17 18:06:59.975501 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:06:59.975475    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn" podUID="d4f15da8-e60e-459c-9b4c-70a1ed57bb84" containerName="payload-processing" containerID="cri-o://6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f" gracePeriod=30
Sep 17 18:07:00.010159 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.010124    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"]
Sep 17 18:07:00.010370 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.010347    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh" podUID="2a961110-a788-401f-b2df-557d405f9749" containerName="payload-pre-processing" containerID="cri-o://d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea" gracePeriod=30
Sep 17 18:07:00.050398 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.050374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:00.183941 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.183845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:00.268749 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.268718    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 18:07:00.288762 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.288736    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 18:07:00.324648 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.324623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:00.365355 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.365327    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a961110-a788-401f-b2df-557d405f9749-plugins-config-volume\") pod \"2a961110-a788-401f-b2df-557d405f9749\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") "
Sep 17 18:07:00.365547 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.365367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-plugins-config-volume\") pod \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") "
Sep 17 18:07:00.365547 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.365422    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lvcn\" (UniqueName: \"kubernetes.io/projected/2a961110-a788-401f-b2df-557d405f9749-kube-api-access-5lvcn\") pod \"2a961110-a788-401f-b2df-557d405f9749\" (UID: \"2a961110-a788-401f-b2df-557d405f9749\") "
Sep 17 18:07:00.365547 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.365483    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwpkh\" (UniqueName: \"kubernetes.io/projected/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-kube-api-access-wwpkh\") pod \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\" (UID: \"d4f15da8-e60e-459c-9b4c-70a1ed57bb84\") "
Sep 17 18:07:00.365801 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.365778    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4f15da8-e60e-459c-9b4c-70a1ed57bb84" (UID: "d4f15da8-e60e-459c-9b4c-70a1ed57bb84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:00.365844 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.365806    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a961110-a788-401f-b2df-557d405f9749-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2a961110-a788-401f-b2df-557d405f9749" (UID: "2a961110-a788-401f-b2df-557d405f9749"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:00.367683 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.367656    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a961110-a788-401f-b2df-557d405f9749-kube-api-access-5lvcn" (OuterVolumeSpecName: "kube-api-access-5lvcn") pod "2a961110-a788-401f-b2df-557d405f9749" (UID: "2a961110-a788-401f-b2df-557d405f9749"). InnerVolumeSpecName "kube-api-access-5lvcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:00.367797 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.367723    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-kube-api-access-wwpkh" (OuterVolumeSpecName: "kube-api-access-wwpkh") pod "d4f15da8-e60e-459c-9b4c-70a1ed57bb84" (UID: "d4f15da8-e60e-459c-9b4c-70a1ed57bb84"). InnerVolumeSpecName "kube-api-access-wwpkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:00.388401 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.388372    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"]
Sep 17 18:07:00.405239 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.405193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:00.406791 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.406773    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-abb363-sd9p8"]
Sep 17 18:07:00.466726 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.466668    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a961110-a788-401f-b2df-557d405f9749-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:00.466726 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.466688    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:00.466726 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.466700    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lvcn\" (UniqueName: \"kubernetes.io/projected/2a961110-a788-401f-b2df-557d405f9749-kube-api-access-5lvcn\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:00.466726 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.466708    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwpkh\" (UniqueName: \"kubernetes.io/projected/d4f15da8-e60e-459c-9b4c-70a1ed57bb84-kube-api-access-wwpkh\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:00.578053 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.578013    2559 generic.go:356] "Generic (PLEG): container finished" podID="d4f15da8-e60e-459c-9b4c-70a1ed57bb84" containerID="6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f" exitCode=0
Sep 17 18:07:00.578235 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.578076    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"
Sep 17 18:07:00.578235 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.578103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn" event={"ID":"d4f15da8-e60e-459c-9b4c-70a1ed57bb84","Type":"ContainerDied","Data":"6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f"}
Sep 17 18:07:00.578235 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.578162    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn" event={"ID":"d4f15da8-e60e-459c-9b4c-70a1ed57bb84","Type":"ContainerDied","Data":"ff431a5fec850ff7ce83db790d2359d088df8eee195e48aeb6dad831b2d6eed8"}
Sep 17 18:07:00.578235 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.578194    2559 scope.go:117] "RemoveContainer" containerID="6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f"
Sep 17 18:07:00.579659 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.579637    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a961110-a788-401f-b2df-557d405f9749" containerID="d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea" exitCode=0
Sep 17 18:07:00.579768 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.579662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh" event={"ID":"2a961110-a788-401f-b2df-557d405f9749","Type":"ContainerDied","Data":"d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea"}
Sep 17 18:07:00.579768 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.579693    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"
Sep 17 18:07:00.579768 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.579710    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh" event={"ID":"2a961110-a788-401f-b2df-557d405f9749","Type":"ContainerDied","Data":"93fe225a00961f5f5eae301dae155dfd0588594575962ef1150b7357b9434844"}
Sep 17 18:07:00.588280 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.588254    2559 scope.go:117] "RemoveContainer" containerID="6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f"
Sep 17 18:07:00.588554 ip-10-0-133-160 kubenswrapper[2559]: E0917 18:07:00.588513    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f\": container with ID starting with 6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f not found: ID does not exist" containerID="6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f"
Sep 17 18:07:00.588638 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.588560    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f"} err="failed to get container status \"6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f\": rpc error: code = NotFound desc = could not find container \"6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f\": container with ID starting with 6d974be75994fe2ed1bf22cb6f857f538df35c61fcf096f38b9166625ec7bf1f not found: ID does not exist"
Sep 17 18:07:00.588638 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.588575    2559 scope.go:117] "RemoveContainer" containerID="d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea"
Sep 17 18:07:00.596734 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.596717    2559 scope.go:117] "RemoveContainer" containerID="d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea"
Sep 17 18:07:00.596997 ip-10-0-133-160 kubenswrapper[2559]: E0917 18:07:00.596978    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea\": container with ID starting with d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea not found: ID does not exist" containerID="d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea"
Sep 17 18:07:00.597039 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.597004    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea"} err="failed to get container status \"d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea\": rpc error: code = NotFound desc = could not find container \"d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea\": container with ID starting with d963af9440f704263458eb62105e9185112022bfb4da2f17acdf6b43cd9d0aea not found: ID does not exist"
Sep 17 18:07:00.603277 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.603256    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"]
Sep 17 18:07:00.612137 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.612112    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-abb363-5fb9dc4cf7-b9hbn"]
Sep 17 18:07:00.630666 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.630646    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"]
Sep 17 18:07:00.637547 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.637527    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-abb363-78898d64cd-r9gjh"]
Sep 17 18:07:00.754260 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.754217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:00.855480 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:00.855444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:01.792495 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:01.792463    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:02.399437 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:02.399408    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a961110-a788-401f-b2df-557d405f9749" path="/var/lib/kubelet/pods/2a961110-a788-401f-b2df-557d405f9749/volumes"
Sep 17 18:07:02.399772 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:02.399758    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ffd3232-a5d6-477d-a416-b55837932704" path="/var/lib/kubelet/pods/7ffd3232-a5d6-477d-a416-b55837932704/volumes"
Sep 17 18:07:02.400091 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:02.400080    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f15da8-e60e-459c-9b4c-70a1ed57bb84" path="/var/lib/kubelet/pods/d4f15da8-e60e-459c-9b4c-70a1ed57bb84/volumes"
Sep 17 18:07:08.858549 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:08.858499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:08.963288 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:08.963250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:09.217469 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.217389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:09.605765 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.605732    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"]
Sep 17 18:07:09.606166 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606150    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffd3232-a5d6-477d-a416-b55837932704" containerName="revoke-keys"
Sep 17 18:07:09.606272 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606171    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffd3232-a5d6-477d-a416-b55837932704" containerName="revoke-keys"
Sep 17 18:07:09.606272 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606200    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f15da8-e60e-459c-9b4c-70a1ed57bb84" containerName="payload-processing"
Sep 17 18:07:09.606272 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606209    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f15da8-e60e-459c-9b4c-70a1ed57bb84" containerName="payload-processing"
Sep 17 18:07:09.606272 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606231    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a961110-a788-401f-b2df-557d405f9749" containerName="payload-pre-processing"
Sep 17 18:07:09.606272 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606239    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a961110-a788-401f-b2df-557d405f9749" containerName="payload-pre-processing"
Sep 17 18:07:09.606544 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606346    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f15da8-e60e-459c-9b4c-70a1ed57bb84" containerName="payload-processing"
Sep 17 18:07:09.606544 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606365    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ffd3232-a5d6-477d-a416-b55837932704" containerName="revoke-keys"
Sep 17 18:07:09.606544 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.606376    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a961110-a788-401f-b2df-557d405f9749" containerName="payload-pre-processing"
Sep 17 18:07:09.612922 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.612902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"
Sep 17 18:07:09.616367 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.616345    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-h87v6\""
Sep 17 18:07:09.617194 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.617179    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 18:07:09.637616 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.637592    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"]
Sep 17 18:07:09.652180 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.652156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40161bf-45c9-4492-8c21-38299b0a55a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6\" (UID: \"c40161bf-45c9-4492-8c21-38299b0a55a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"
Sep 17 18:07:09.753590 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.753548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40161bf-45c9-4492-8c21-38299b0a55a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6\" (UID: \"c40161bf-45c9-4492-8c21-38299b0a55a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"
Sep 17 18:07:09.754172 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.754155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40161bf-45c9-4492-8c21-38299b0a55a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6\" (UID: \"c40161bf-45c9-4492-8c21-38299b0a55a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"
Sep 17 18:07:09.809439 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.809409    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:09.923340 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:09.923274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"
Sep 17 18:07:10.268969 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:10.268940    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"]
Sep 17 18:07:10.269810 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:07:10.269784    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40161bf_45c9_4492_8c21_38299b0a55a8.slice/crio-2e44f92b3875e3803cab1c351651dd921f2b3288b5a9544a49ba58dba2cb1b69 WatchSource:0}: Error finding container 2e44f92b3875e3803cab1c351651dd921f2b3288b5a9544a49ba58dba2cb1b69: Status 404 returned error can't find the container with id 2e44f92b3875e3803cab1c351651dd921f2b3288b5a9544a49ba58dba2cb1b69
Sep 17 18:07:10.647512 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:10.647483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6" event={"ID":"c40161bf-45c9-4492-8c21-38299b0a55a8","Type":"ContainerStarted","Data":"c4508d5cfd7d34334546797ac9ee456fd4342e25afb0e98b7c259cf07337aaf2"}
Sep 17 18:07:10.647687 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:10.647554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6" event={"ID":"c40161bf-45c9-4492-8c21-38299b0a55a8","Type":"ContainerStarted","Data":"2e44f92b3875e3803cab1c351651dd921f2b3288b5a9544a49ba58dba2cb1b69"}
Sep 17 18:07:10.686739 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:10.686689    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6" podStartSLOduration=1.686673459 podStartE2EDuration="1.686673459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:07:10.684820731 +0000 UTC m=+2138.462658366" watchObservedRunningTime="2026-09-17 18:07:10.686673459 +0000 UTC m=+2138.464511139"
Sep 17 18:07:11.323178 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:11.323149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:11.655725 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:11.655636    2559 generic.go:356] "Generic (PLEG): container finished" podID="c40161bf-45c9-4492-8c21-38299b0a55a8" containerID="c4508d5cfd7d34334546797ac9ee456fd4342e25afb0e98b7c259cf07337aaf2" exitCode=0
Sep 17 18:07:11.655876 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:11.655722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6" event={"ID":"c40161bf-45c9-4492-8c21-38299b0a55a8","Type":"ContainerDied","Data":"c4508d5cfd7d34334546797ac9ee456fd4342e25afb0e98b7c259cf07337aaf2"}
Sep 17 18:07:12.644218 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:12.644189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:12.793027 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:12.793003    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"
Sep 17 18:07:12.879225 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:12.879195    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40161bf-45c9-4492-8c21-38299b0a55a8-maas-api-service-ca\") pod \"c40161bf-45c9-4492-8c21-38299b0a55a8\" (UID: \"c40161bf-45c9-4492-8c21-38299b0a55a8\") "
Sep 17 18:07:12.879571 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:12.879549    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40161bf-45c9-4492-8c21-38299b0a55a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c40161bf-45c9-4492-8c21-38299b0a55a8" (UID: "c40161bf-45c9-4492-8c21-38299b0a55a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:12.980903 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:12.980820    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40161bf-45c9-4492-8c21-38299b0a55a8-maas-api-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:13.668373 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:13.668347    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"
Sep 17 18:07:13.668786 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:13.668342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6" event={"ID":"c40161bf-45c9-4492-8c21-38299b0a55a8","Type":"ContainerDied","Data":"2e44f92b3875e3803cab1c351651dd921f2b3288b5a9544a49ba58dba2cb1b69"}
Sep 17 18:07:13.668786 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:13.668478    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e44f92b3875e3803cab1c351651dd921f2b3288b5a9544a49ba58dba2cb1b69"
Sep 17 18:07:20.497659 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.497571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:20.551690 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.551649    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"]
Sep 17 18:07:20.577919 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.577889    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7b7c8c-29827800-qg8kx"]
Sep 17 18:07:20.641435 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.641399    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"]
Sep 17 18:07:20.641668 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.641642    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2" podUID="c7a77e26-909f-4441-bc2d-688997a9f192" containerName="payload-processing" containerID="cri-o://003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738" gracePeriod=30
Sep 17 18:07:20.652025 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.651994    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"]
Sep 17 18:07:20.652303 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.652225    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s" podUID="ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" containerName="payload-pre-processing" containerID="cri-o://e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec" gracePeriod=30
Sep 17 18:07:20.658770 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.658746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:20.785762 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.785719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:20.924729 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.924704    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 18:07:20.927199 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:20.927176    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 18:07:21.057664 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.057578    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgs64\" (UniqueName: \"kubernetes.io/projected/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-kube-api-access-xgs64\") pod \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") "
Sep 17 18:07:21.057664 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.057616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a77e26-909f-4441-bc2d-688997a9f192-plugins-config-volume\") pod \"c7a77e26-909f-4441-bc2d-688997a9f192\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") "
Sep 17 18:07:21.057855 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.057723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwsm2\" (UniqueName: \"kubernetes.io/projected/c7a77e26-909f-4441-bc2d-688997a9f192-kube-api-access-cwsm2\") pod \"c7a77e26-909f-4441-bc2d-688997a9f192\" (UID: \"c7a77e26-909f-4441-bc2d-688997a9f192\") "
Sep 17 18:07:21.057855 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.057747    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-plugins-config-volume\") pod \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\" (UID: \"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0\") "
Sep 17 18:07:21.058165 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.058131    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a77e26-909f-4441-bc2d-688997a9f192-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7a77e26-909f-4441-bc2d-688997a9f192" (UID: "c7a77e26-909f-4441-bc2d-688997a9f192"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:21.058299 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.058171    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" (UID: "ce4ba3bb-f94e-426d-a76b-24b914f5a7f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:21.059762 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.059744    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a77e26-909f-4441-bc2d-688997a9f192-kube-api-access-cwsm2" (OuterVolumeSpecName: "kube-api-access-cwsm2") pod "c7a77e26-909f-4441-bc2d-688997a9f192" (UID: "c7a77e26-909f-4441-bc2d-688997a9f192"). InnerVolumeSpecName "kube-api-access-cwsm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:21.059854 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.059811    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-kube-api-access-xgs64" (OuterVolumeSpecName: "kube-api-access-xgs64") pod "ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" (UID: "ce4ba3bb-f94e-426d-a76b-24b914f5a7f0"). InnerVolumeSpecName "kube-api-access-xgs64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:21.066848 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.066825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:21.143332 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.143295    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"]
Sep 17 18:07:21.151473 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.151444    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7b7c8c-5l6w6"]
Sep 17 18:07:21.159423 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.159398    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwsm2\" (UniqueName: \"kubernetes.io/projected/c7a77e26-909f-4441-bc2d-688997a9f192-kube-api-access-cwsm2\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:21.159423 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.159421    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:21.159585 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.159436    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgs64\" (UniqueName: \"kubernetes.io/projected/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0-kube-api-access-xgs64\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:21.159585 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.159448    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a77e26-909f-4441-bc2d-688997a9f192-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 17 18:07:21.175122 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.175096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:21.504382 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.504348    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:21.625854 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.625817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:21.722838 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.722800    2559 generic.go:356] "Generic (PLEG): container finished" podID="c7a77e26-909f-4441-bc2d-688997a9f192" containerID="003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738" exitCode=0
Sep 17 18:07:21.723033 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.722849    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"
Sep 17 18:07:21.723033 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.722884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2" event={"ID":"c7a77e26-909f-4441-bc2d-688997a9f192","Type":"ContainerDied","Data":"003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738"}
Sep 17 18:07:21.723033 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.722933    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2" event={"ID":"c7a77e26-909f-4441-bc2d-688997a9f192","Type":"ContainerDied","Data":"de3204d86bcd2d0b2df5dcb9da6250c76b7f543f218eac5707f3cf7395b5aa86"}
Sep 17 18:07:21.723033 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.722962    2559 scope.go:117] "RemoveContainer" containerID="003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738"
Sep 17 18:07:21.724318 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.724277    2559 generic.go:356] "Generic (PLEG): container finished" podID="ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" containerID="e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec" exitCode=0
Sep 17 18:07:21.724404 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.724317    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"
Sep 17 18:07:21.724404 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.724357    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s" event={"ID":"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0","Type":"ContainerDied","Data":"e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec"}
Sep 17 18:07:21.724505 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.724436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s" event={"ID":"ce4ba3bb-f94e-426d-a76b-24b914f5a7f0","Type":"ContainerDied","Data":"7138d08625890be86a07f661c78aa92b73a1e9b542a1763a057c58bf1b1e9ee7"}
Sep 17 18:07:21.740003 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.734720    2559 scope.go:117] "RemoveContainer" containerID="003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738"
Sep 17 18:07:21.740003 ip-10-0-133-160 kubenswrapper[2559]: E0917 18:07:21.735072    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738\": container with ID starting with 003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738 not found: ID does not exist" containerID="003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738"
Sep 17 18:07:21.740003 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.735109    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738"} err="failed to get container status \"003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738\": rpc error: code = NotFound desc = could not find container \"003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738\": container with ID starting with 003068ba62914c26b0783acf6fa286d8a45e5da3122d62103a5e2e7527766738 not found: ID does not exist"
Sep 17 18:07:21.740003 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.735134    2559 scope.go:117] "RemoveContainer" containerID="e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec"
Sep 17 18:07:21.747057 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.747034    2559 scope.go:117] "RemoveContainer" containerID="e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec"
Sep 17 18:07:21.747339 ip-10-0-133-160 kubenswrapper[2559]: E0917 18:07:21.747319    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec\": container with ID starting with e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec not found: ID does not exist" containerID="e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec"
Sep 17 18:07:21.747394 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.747345    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec"} err="failed to get container status \"e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec\": rpc error: code = NotFound desc = could not find container \"e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec\": container with ID starting with e18e667176527868d4d516af4319e88650a828913281e961bc900263ff25d2ec not found: ID does not exist"
Sep 17 18:07:21.766221 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.766150    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"]
Sep 17 18:07:21.772051 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.772025    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7b7c8c-767d47d7c8-qbh6s"]
Sep 17 18:07:21.793466 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.793434    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"]
Sep 17 18:07:21.800283 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:21.800258    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7b7c8c-7b565596f-2m5l2"]
Sep 17 18:07:22.399742 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:22.399713    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="142f88d0-1065-4ebb-89d0-109751afffd9" path="/var/lib/kubelet/pods/142f88d0-1065-4ebb-89d0-109751afffd9/volumes"
Sep 17 18:07:22.400014 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:22.400002    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c40161bf-45c9-4492-8c21-38299b0a55a8" path="/var/lib/kubelet/pods/c40161bf-45c9-4492-8c21-38299b0a55a8/volumes"
Sep 17 18:07:22.400318 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:22.400308    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7a77e26-909f-4441-bc2d-688997a9f192" path="/var/lib/kubelet/pods/c7a77e26-909f-4441-bc2d-688997a9f192/volumes"
Sep 17 18:07:22.400634 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:22.400622    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" path="/var/lib/kubelet/pods/ce4ba3bb-f94e-426d-a76b-24b914f5a7f0/volumes"
Sep 17 18:07:28.987576 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:28.987540    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:29.089338 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:29.089306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:29.315974 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:29.315940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:34.990700 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:07:34.990668    2559 scope.go:117] "RemoveContainer" containerID="fbea33390bbc0621c312017172815eb35466e44f2d7189d18dfa05869a6fd5c6"
Sep 17 18:08:08.353626 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:08:08.353572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:09.449259 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:08:09.449222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:57.317200 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:08:57.317124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:58.904461 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:08:58.904431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:10:24.175860 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:10:24.175743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:10:39.028637 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:10:39.028600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:11:34.587724 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:11:34.587697    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 18:11:34.595863 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:11:34.595843    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88nns_02327afa-0086-45ea-b42c-25008b885900/ovn-acl-logging/0.log"
Sep 17 18:11:35.070909 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:11:35.070879    2559 scope.go:117] "RemoveContainer" containerID="15e417d9f63c9caaebad440a7efbe95ec42c24ff70191a9c41ab0fa3f952ef74"
Sep 17 18:11:35.080215 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:11:35.080192    2559 scope.go:117] "RemoveContainer" containerID="1ed84841bd09b755c792127854adba66cbd097bec24285afa15fb16ae8f51712"
Sep 17 18:11:59.035281 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:11:59.035204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:12:19.775690 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:12:19.775653    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:12:33.878205 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:12:33.878124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:12:34.940306 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:12:34.940272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:12:35.106964 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:12:35.106927    2559 scope.go:117] "RemoveContainer" containerID="54fe8da8f6fd0d48b11b83662fa7c3380f10ff6515b447d1380c90ccec26b4ff"
Sep 17 18:12:52.438135 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:12:52.438099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:05.483674 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:05.483640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:16.920172 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:16.920095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:23.625678 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:23.625645    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b4d9867c8-5jxgs_0929c827-2138-45e1-b125-620ac016dda0/authorino/0.log"
Sep 17 18:13:26.262565 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:26.262504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:29.417026 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:29.416994    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-ppd9z_681e544b-4503-4fae-9f41-1678769fcfe7/copy-manifests/0.log"
Sep 17 18:13:29.429470 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:29.429442    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-ppd9z_681e544b-4503-4fae-9f41-1678769fcfe7/manager/0.log"
Sep 17 18:13:30.193628 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:30.193599    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29827800-bqr24_a4fded79-26b2-404e-b089-c863180e37ff/cleanup/0.log"
Sep 17 18:13:31.060989 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:31.060948    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b4d9867c8-5jxgs_0929c827-2138-45e1-b125-620ac016dda0/authorino/0.log"
Sep 17 18:13:31.400757 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:31.400679    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5nt9j_2e2fac8f-c9d0-4d02-9b82-597707682941/kuadrant-console-plugin/0.log"
Sep 17 18:13:32.315788 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:32.315754    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5499794fdf-gnghq_707cae63-4158-4dc8-91b8-e1c71d6891e3/kube-auth-proxy/0.log"
Sep 17 18:13:32.756086 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:32.756054    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-v2ghz_5cbcb970-eed0-4ee7-9c15-9f0329ca2946/payload-processing/0.log"
Sep 17 18:13:32.867703 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:32.867676    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5955c464-h8wlh_f840393b-d324-47b2-bdf4-9546ade943ae/router/0.log"
Sep 17 18:13:33.429748 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:33.429720    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-c7k5m_8d899a7f-ba45-4aff-8641-3e8a9b7f2f2b/main/0.log"
Sep 17 18:13:33.532660 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:33.532636    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rjmrv_1f076717-e5a4-4ccf-bfb9-fa0f6773d5de/main/0.log"
Sep 17 18:13:33.638879 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:33.638852    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frvvtr_37736117-001c-41a4-b905-015a24dc8a6d/main/0.log"
Sep 17 18:13:34.095363 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:34.095328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:35.132326 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:35.132291    2559 scope.go:117] "RemoveContainer" containerID="e800089cb031f7236ab846d0950a7383ed05d464ae93dd3a40414014719a5a93"
Sep 17 18:13:35.143640 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:35.143612    2559 scope.go:117] "RemoveContainer" containerID="c4508d5cfd7d34334546797ac9ee456fd4342e25afb0e98b7c259cf07337aaf2"
Sep 17 18:13:39.357314 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357279    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8kb2r/must-gather-pcjfn"]
Sep 17 18:13:39.357713 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357660    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40161bf-45c9-4492-8c21-38299b0a55a8" containerName="revoke-keys"
Sep 17 18:13:39.357713 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357676    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40161bf-45c9-4492-8c21-38299b0a55a8" containerName="revoke-keys"
Sep 17 18:13:39.357713 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357705    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" containerName="payload-pre-processing"
Sep 17 18:13:39.357713 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357713    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" containerName="payload-pre-processing"
Sep 17 18:13:39.357957 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357736    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a77e26-909f-4441-bc2d-688997a9f192" containerName="payload-processing"
Sep 17 18:13:39.357957 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357742    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a77e26-909f-4441-bc2d-688997a9f192" containerName="payload-processing"
Sep 17 18:13:39.357957 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357843    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce4ba3bb-f94e-426d-a76b-24b914f5a7f0" containerName="payload-pre-processing"
Sep 17 18:13:39.357957 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357857    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40161bf-45c9-4492-8c21-38299b0a55a8" containerName="revoke-keys"
Sep 17 18:13:39.357957 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.357871    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a77e26-909f-4441-bc2d-688997a9f192" containerName="payload-processing"
Sep 17 18:13:39.362824 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.362805    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.365257 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.365231    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kb2r\"/\"kube-root-ca.crt\""
Sep 17 18:13:39.365401 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.365362    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kb2r\"/\"openshift-service-ca.crt\""
Sep 17 18:13:39.366377 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.366356    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8kb2r\"/\"default-dockercfg-dkft9\""
Sep 17 18:13:39.369164 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.369143    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kb2r/must-gather-pcjfn"]
Sep 17 18:13:39.371071 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.371043    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:39.470821 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.470788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:39.471998 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.471966    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/59790dab-64f9-494a-a3ee-25fca45930f6-must-gather-output\") pod \"must-gather-pcjfn\" (UID: \"59790dab-64f9-494a-a3ee-25fca45930f6\") " pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.472135 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.472023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkfjn\" (UniqueName: \"kubernetes.io/projected/59790dab-64f9-494a-a3ee-25fca45930f6-kube-api-access-vkfjn\") pod \"must-gather-pcjfn\" (UID: \"59790dab-64f9-494a-a3ee-25fca45930f6\") " pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.573295 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.573258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/59790dab-64f9-494a-a3ee-25fca45930f6-must-gather-output\") pod \"must-gather-pcjfn\" (UID: \"59790dab-64f9-494a-a3ee-25fca45930f6\") " pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.573469 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.573315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfjn\" (UniqueName: \"kubernetes.io/projected/59790dab-64f9-494a-a3ee-25fca45930f6-kube-api-access-vkfjn\") pod \"must-gather-pcjfn\" (UID: \"59790dab-64f9-494a-a3ee-25fca45930f6\") " pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.573695 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.573672    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/59790dab-64f9-494a-a3ee-25fca45930f6-must-gather-output\") pod \"must-gather-pcjfn\" (UID: \"59790dab-64f9-494a-a3ee-25fca45930f6\") " pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.581672 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.581648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkfjn\" (UniqueName: \"kubernetes.io/projected/59790dab-64f9-494a-a3ee-25fca45930f6-kube-api-access-vkfjn\") pod \"must-gather-pcjfn\" (UID: \"59790dab-64f9-494a-a3ee-25fca45930f6\") " pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.673730 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.673646    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kb2r/must-gather-pcjfn"
Sep 17 18:13:39.944176 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.944148    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kb2r/must-gather-pcjfn"]
Sep 17 18:13:39.945579 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:13:39.945553    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59790dab_64f9_494a_a3ee_25fca45930f6.slice/crio-3591b4a947ae45b9fe874a2d87694847554464d2a5d3ff8fdb0d5de229e472f0 WatchSource:0}: Error finding container 3591b4a947ae45b9fe874a2d87694847554464d2a5d3ff8fdb0d5de229e472f0: Status 404 returned error can't find the container with id 3591b4a947ae45b9fe874a2d87694847554464d2a5d3ff8fdb0d5de229e472f0
Sep 17 18:13:39.947417 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:39.947398    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 18:13:40.872366 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:40.872339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kb2r/must-gather-pcjfn" event={"ID":"59790dab-64f9-494a-a3ee-25fca45930f6","Type":"ContainerStarted","Data":"2f5299a8fc4e38e727cc7701a44fbf07bd0d55b2df1751488f63401ce9d1908c"}
Sep 17 18:13:40.872831 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:40.872385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kb2r/must-gather-pcjfn" event={"ID":"59790dab-64f9-494a-a3ee-25fca45930f6","Type":"ContainerStarted","Data":"3591b4a947ae45b9fe874a2d87694847554464d2a5d3ff8fdb0d5de229e472f0"}
Sep 17 18:13:41.881495 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:41.881464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kb2r/must-gather-pcjfn" event={"ID":"59790dab-64f9-494a-a3ee-25fca45930f6","Type":"ContainerStarted","Data":"e36e1fb675e20bb3fa24db262f465f0e47f25ff2ab41afc43f15a158edd8ec8c"}
Sep 17 18:13:41.899082 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:41.899017    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8kb2r/must-gather-pcjfn" podStartSLOduration=2.173678797 podStartE2EDuration="2.898999392s" totalImagesPullingTime="725.320595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:13:41.89649974 +0000 UTC m=+2529.674337375" watchObservedRunningTime="2026-09-17 18:13:41.898999392 +0000 UTC m=+2529.676837026"
Sep 17 18:13:42.284558 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:42.284502    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q4x64_b8229b2b-a44d-4f96-a34a-b269c857681f/global-pull-secret-syncer/0.log"
Sep 17 18:13:42.377423 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:42.377372    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7gbrd_830a05c7-e115-47ac-83c4-240716a535a5/konnectivity-agent/0.log"
Sep 17 18:13:42.486778 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:42.486750    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-160.ec2.internal_c7b7a7384449df783f830280a3100b44/haproxy/0.log"
Sep 17 18:13:47.626424 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:47.625208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b4d9867c8-5jxgs_0929c827-2138-45e1-b125-620ac016dda0/authorino/0.log"
Sep 17 18:13:47.703215 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:47.703177    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5nt9j_2e2fac8f-c9d0-4d02-9b82-597707682941/kuadrant-console-plugin/0.log"
Sep 17 18:13:49.280390 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.280362    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69288e4e-fd41-4910-a78f-0d38feb6e19a/alertmanager/0.log"
Sep 17 18:13:49.307894 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.307868    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69288e4e-fd41-4910-a78f-0d38feb6e19a/config-reloader/0.log"
Sep 17 18:13:49.335281 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.335253    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69288e4e-fd41-4910-a78f-0d38feb6e19a/kube-rbac-proxy-web/0.log"
Sep 17 18:13:49.358229 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.358171    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69288e4e-fd41-4910-a78f-0d38feb6e19a/kube-rbac-proxy/0.log"
Sep 17 18:13:49.380387 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.380344    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69288e4e-fd41-4910-a78f-0d38feb6e19a/kube-rbac-proxy-metric/0.log"
Sep 17 18:13:49.406782 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.406747    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69288e4e-fd41-4910-a78f-0d38feb6e19a/prom-label-proxy/0.log"
Sep 17 18:13:49.430326 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.430300    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69288e4e-fd41-4910-a78f-0d38feb6e19a/init-config-reloader/0.log"
Sep 17 18:13:49.474385 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.474322    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-tcwdp_4179cf38-2212-4632-82db-c90a051d0468/cluster-monitoring-operator/0.log"
Sep 17 18:13:49.527665 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.527626    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-6shrt_6dece29b-723c-4cd6-8d28-80a6e877524a/kube-state-metrics/0.log"
Sep 17 18:13:49.581934 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.581833    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-6shrt_6dece29b-723c-4cd6-8d28-80a6e877524a/kube-rbac-proxy-main/0.log"
Sep 17 18:13:49.662202 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.662163    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-6shrt_6dece29b-723c-4cd6-8d28-80a6e877524a/kube-rbac-proxy-self/0.log"
Sep 17 18:13:49.712127 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.712093    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cdb6f78fb-dzhfw_ef2353b9-f1a1-4002-8131-cdeb5254ba49/metrics-server/0.log"
Sep 17 18:13:49.745965 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.745927    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-7fp56_c7484083-69b5-4b0e-a9c4-faf4ebcdb603/monitoring-plugin/0.log"
Sep 17 18:13:49.875030 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.874949    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjqfb_6952b611-7d9f-4440-a148-c7600df46cd1/node-exporter/0.log"
Sep 17 18:13:49.896675 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.896641    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjqfb_6952b611-7d9f-4440-a148-c7600df46cd1/kube-rbac-proxy/0.log"
Sep 17 18:13:49.919203 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:49.919150    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjqfb_6952b611-7d9f-4440-a148-c7600df46cd1/init-textfile/0.log"
Sep 17 18:13:52.009798 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.009769    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-2xr62_855bb4fd-a8a4-43b3-b72f-f969248355f7/networking-console-plugin/0.log"
Sep 17 18:13:52.756419 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.756373    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"]
Sep 17 18:13:52.764537 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.764487    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.769894 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.769861    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"]
Sep 17 18:13:52.839889 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.839855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-lib-modules\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.840073 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.839902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-podres\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.840073 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.839990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-sys\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.840073 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.840012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-proc\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.840073 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.840052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnqtq\" (UniqueName: \"kubernetes.io/projected/b383d0e1-f665-417b-943c-5bddaf49fb30-kube-api-access-mnqtq\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.941361 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-lib-modules\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.941572 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-podres\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.941572 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-sys\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.941572 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-proc\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.941572 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnqtq\" (UniqueName: \"kubernetes.io/projected/b383d0e1-f665-417b-943c-5bddaf49fb30-kube-api-access-mnqtq\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.941958 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941932    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-podres\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.942089 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-sys\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.942157 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.941999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-proc\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.942157 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.942087    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b383d0e1-f665-417b-943c-5bddaf49fb30-lib-modules\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:52.950080 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:52.950045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnqtq\" (UniqueName: \"kubernetes.io/projected/b383d0e1-f665-417b-943c-5bddaf49fb30-kube-api-access-mnqtq\") pod \"perf-node-gather-daemonset-5h5z7\" (UID: \"b383d0e1-f665-417b-943c-5bddaf49fb30\") " pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:53.080986 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:53.080685    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:53.385006 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:53.384973    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"]
Sep 17 18:13:53.387449 ip-10-0-133-160 kubenswrapper[2559]: W0917 18:13:53.387407    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb383d0e1_f665_417b_943c_5bddaf49fb30.slice/crio-6d180c01a78dcaf3bde264b860b5970fbd8686513b4e3e1f67e95e85053a0dab WatchSource:0}: Error finding container 6d180c01a78dcaf3bde264b860b5970fbd8686513b4e3e1f67e95e85053a0dab: Status 404 returned error can't find the container with id 6d180c01a78dcaf3bde264b860b5970fbd8686513b4e3e1f67e95e85053a0dab
Sep 17 18:13:53.989497 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:53.989450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7" event={"ID":"b383d0e1-f665-417b-943c-5bddaf49fb30","Type":"ContainerStarted","Data":"416b44d33e089ae0291951fef88cd907625fa8460704fbdf9a7778f44d2fda50"}
Sep 17 18:13:53.989755 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:53.989544    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7" event={"ID":"b383d0e1-f665-417b-943c-5bddaf49fb30","Type":"ContainerStarted","Data":"6d180c01a78dcaf3bde264b860b5970fbd8686513b4e3e1f67e95e85053a0dab"}
Sep 17 18:13:53.990400 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:53.990370    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:13:55.075115 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:55.075084    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tdcgr_26901103-f82e-4a36-a715-b5331da026ae/dns/0.log"
Sep 17 18:13:55.096813 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:55.096780    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tdcgr_26901103-f82e-4a36-a715-b5331da026ae/kube-rbac-proxy/0.log"
Sep 17 18:13:55.189293 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:55.189264    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsfzf_759dded7-4bac-4cfc-bf37-3fa3fb29e77e/dns-node-resolver/0.log"
Sep 17 18:13:55.738352 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:55.738320    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6765487b5c-k7qgk_20dd6a07-fa8a-416c-8f53-a26b28b1bc4a/registry/0.log"
Sep 17 18:13:55.811055 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:55.811024    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lb54v_f70ab124-950a-49c5-bace-36954153b7a8/node-ca/0.log"
Sep 17 18:13:57.214400 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:57.214364    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5499794fdf-gnghq_707cae63-4158-4dc8-91b8-e1c71d6891e3/kube-auth-proxy/0.log"
Sep 17 18:13:57.349060 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:57.349030    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-v2ghz_5cbcb970-eed0-4ee7-9c15-9f0329ca2946/payload-processing/0.log"
Sep 17 18:13:57.370727 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:57.370698    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5955c464-h8wlh_f840393b-d324-47b2-bdf4-9546ade943ae/router/0.log"
Sep 17 18:13:58.266408 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:58.266374    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hl7ml_6050df6b-3301-4f75-b63d-8ca8693abf23/serve-healthcheck-canary/0.log"
Sep 17 18:13:58.762148 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:58.762117    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-z9tfg_3a112cc5-b12f-4e93-9cd7-89fdbbdafef3/insights-operator/0.log"
Sep 17 18:13:58.764193 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:58.764170    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-z9tfg_3a112cc5-b12f-4e93-9cd7-89fdbbdafef3/insights-operator/1.log"
Sep 17 18:13:58.900954 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:58.900930    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vb6rr_0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7/kube-rbac-proxy/0.log"
Sep 17 18:13:58.919854 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:58.919826    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vb6rr_0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7/exporter/0.log"
Sep 17 18:13:58.939662 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:13:58.939637    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vb6rr_0b52a3ca-a3c8-4dbb-ab70-c7d464e2f1f7/extractor/0.log"
Sep 17 18:14:01.021600 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:01.021569    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7"
Sep 17 18:14:01.040150 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:01.040092    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8kb2r/perf-node-gather-daemonset-5h5z7" podStartSLOduration=9.040069452 podStartE2EDuration="9.040069452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:13:54.011946848 +0000 UTC m=+2541.789784484" watchObservedRunningTime="2026-09-17 18:14:01.040069452 +0000 UTC m=+2548.817907087"
Sep 17 18:14:01.848699 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:01.848664    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-ppd9z_681e544b-4503-4fae-9f41-1678769fcfe7/manager/0.log"
Sep 17 18:14:01.865080 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:01.865041    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-584f5b8894-ppd9z_681e544b-4503-4fae-9f41-1678769fcfe7/copy-manifests/0.log"
Sep 17 18:14:03.300190 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:03.300155    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5499794fdf-gnghq_707cae63-4158-4dc8-91b8-e1c71d6891e3/kube-auth-proxy/0.log"
Sep 17 18:14:03.343173 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:03.343132    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79bc5f98c4-kkcpl_abbab84e-e928-4c95-8de2-32fc2193a148/manager/0.log"
Sep 17 18:14:03.410296 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:03.410260    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-v2ghz_5cbcb970-eed0-4ee7-9c15-9f0329ca2946/payload-processing/0.log"
Sep 17 18:14:03.432571 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:03.432504    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5955c464-h8wlh_f840393b-d324-47b2-bdf4-9546ade943ae/router/0.log"
Sep 17 18:14:05.518154 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:05.518113    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5499794fdf-gnghq_707cae63-4158-4dc8-91b8-e1c71d6891e3/kube-auth-proxy/0.log"
Sep 17 18:14:05.650173 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:05.650142    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-v2ghz_5cbcb970-eed0-4ee7-9c15-9f0329ca2946/payload-processing/0.log"
Sep 17 18:14:05.672799 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:05.672769    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5955c464-h8wlh_f840393b-d324-47b2-bdf4-9546ade943ae/router/0.log"
Sep 17 18:14:08.604910 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:08.604883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-dwt52_352c32dd-8226-421c-b2fa-22211b55209b/migrator/0.log"
Sep 17 18:14:08.623575 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:08.623547    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-dwt52_352c32dd-8226-421c-b2fa-22211b55209b/graceful-termination/0.log"
Sep 17 18:14:08.981122 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:08.981042    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-fqb8c_5443ffee-2e98-43f9-b155-4e2ba193356a/kube-storage-version-migrator-operator/1.log"
Sep 17 18:14:08.981772 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:08.981751    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-fqb8c_5443ffee-2e98-43f9-b155-4e2ba193356a/kube-storage-version-migrator-operator/0.log"
Sep 17 18:14:10.323567 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.323539    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qld8b_ad8edb03-2df1-418a-98bb-260f47c43c52/kube-multus-additional-cni-plugins/0.log"
Sep 17 18:14:10.345487 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.345458    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qld8b_ad8edb03-2df1-418a-98bb-260f47c43c52/egress-router-binary-copy/0.log"
Sep 17 18:14:10.367273 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.367248    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qld8b_ad8edb03-2df1-418a-98bb-260f47c43c52/cni-plugins/0.log"
Sep 17 18:14:10.387424 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.387396    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qld8b_ad8edb03-2df1-418a-98bb-260f47c43c52/bond-cni-plugin/0.log"
Sep 17 18:14:10.408860 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.408834    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qld8b_ad8edb03-2df1-418a-98bb-260f47c43c52/routeoverride-cni/0.log"
Sep 17 18:14:10.428357 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.428333    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qld8b_ad8edb03-2df1-418a-98bb-260f47c43c52/whereabouts-cni-bincopy/0.log"
Sep 17 18:14:10.449949 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.449927    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qld8b_ad8edb03-2df1-418a-98bb-260f47c43c52/whereabouts-cni/0.log"
Sep 17 18:14:10.498677 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.498650    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ktffb_2187be27-fd1a-4ed4-90f1-4af3b8db4e03/kube-multus/0.log"
Sep 17 18:14:10.658067 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.657997    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tv9r5_4fee2f26-af6a-47ef-a183-f3414e107775/network-metrics-daemon/0.log"
Sep 17 18:14:10.674631 ip-10-0-133-160 kubenswrapper[2559]: I0917 18:14:10.674598    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tv9r5_4fee2f26-af6a-47ef-a183-f3414e107775/kube-rbac-proxy/0.log"