Sep 08 00:02:37.995529 ip-10-0-136-92 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 00:02:38.331823 ip-10-0-136-92 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:02:38.331823 ip-10-0-136-92 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 00:02:38.331823 ip-10-0-136-92 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:02:38.331823 ip-10-0-136-92 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 00:02:38.331823 ip-10-0-136-92 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:02:38.333310 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.333220    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 00:02:38.336911 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336894    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:38.336911 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336911    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336916    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336921    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336925    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336928    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336931    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336934    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336937    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336942    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336945    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336948    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336950    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336953    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336955    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336958    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336960    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336963    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336967    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336971    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:38.336985 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336974    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336977    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336979    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336982    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336985    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336988    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336992    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336996    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.336999    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337002    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337005    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337008    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337011    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337014    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337017    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337020    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337023    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337026    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337029    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337031    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:38.337466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337034    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337037    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337039    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337042    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337044    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337047    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337049    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337052    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337054    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337057    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337059    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337062    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337065    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337068    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337071    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337074    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337077    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337079    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337082    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337084    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:38.337942 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337087    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337089    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337092    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337095    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337097    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337102    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337104    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337107    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337110    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337112    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337115    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337117    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337119    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337122    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337125    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337127    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337130    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337143    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337146    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337149    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:38.338446 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337151    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337154    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337156    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337160    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337168    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337172    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337175    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337178    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337180    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337183    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337186    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337188    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337191    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337193    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337196    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337198    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337201    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337204    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337206    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337896    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:38.338915 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337902    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337905    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337908    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337911    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337914    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337917    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337919    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337922    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337925    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337928    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337930    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337933    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337936    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337938    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337941    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337945    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337948    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337951    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337957    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:38.339416 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337961    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337964    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337967    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337970    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337973    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337976    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337979    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337981    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337984    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337987    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337990    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337993    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337996    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.337999    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338001    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338004    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338007    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338010    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338012    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338015    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:38.339883 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338017    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338020    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338023    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338025    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338028    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338030    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338033    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338036    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338040    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338044    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338047    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338050    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338054    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338057    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338060    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338062    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338065    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338068    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338070    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338073    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:38.340721 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338075    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338078    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338080    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338083    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338086    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338089    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338092    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338094    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338097    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338100    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338102    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338105    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338107    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338110    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338113    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338115    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338118    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338121    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338123    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:38.341471 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338126    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338128    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338132    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338153    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338156    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338159    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338163    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338166    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338168    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338172    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338174    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338177    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338179    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338182    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338185    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338187    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338190    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338193    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338195    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338199    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:38.341993 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338597    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338603    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338606    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338610    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338613    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338615    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338618    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338621    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338624    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338627    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338630    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338632    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338635    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338638    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338641    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338644    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338646    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338649    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338652    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338654    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:38.342504 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338657    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338659    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338662    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338665    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338667    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338669    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338672    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338674    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338678    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338680    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338683    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338686    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338688    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338693    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338695    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338698    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338701    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338703    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338705    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338708    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:38.342984 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338710    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338713    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338716    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338719    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338722    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338724    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338726    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338731    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338734    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338737    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338740    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338743    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338746    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338748    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338751    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338753    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338756    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338758    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338763    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:38.343535 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338766    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338771    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338774    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338776    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338779    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338781    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338785    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338788    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338791    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338794    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338796    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338799    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338801    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338804    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338807    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338810    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338812    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338815    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338817    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338819    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:38.344003 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338822    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338825    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338827    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338830    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338833    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338836    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338839    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338841    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338844    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338846    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338849    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338851    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338855    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338860    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338863    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338865    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338868    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338870    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338874    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.338877    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:38.344556 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.338946    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.338988    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.338995    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339000    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339004    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339007    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339012    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339016    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339019    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339022    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339026    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339029    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339032    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339036    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339039    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339042    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339045    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339048    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339054    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339057    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339060    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339063    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339066    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339070    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 00:02:38.345086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339073    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339078    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339081    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339084    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339088    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339090    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339094    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339097    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339101    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339104    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339106    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339110    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339112    2580 flags.go:64] FLAG: --enable-server="true"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339115    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339119    2580 flags.go:64] FLAG: --event-burst="100"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339122    2580 flags.go:64] FLAG: --event-qps="50"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339125    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339128    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339130    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339146    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339149    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339152    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339155    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339158    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339161    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 00:02:38.345714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339164    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339167    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339170    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339173    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339176    2580 flags.go:64] FLAG: --feature-gates=""
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339180    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339183    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339186    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339190    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339193    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339196    2580 flags.go:64] FLAG: --help="false"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339200    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339203    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339206    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339209    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339213    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339216    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339219    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339222    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339225    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339228    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339231    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339234    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339237    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 08 00:02:38.346354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339239    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339242    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339245    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339248    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339251    2580 flags.go:64] FLAG: --lock-file=""
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339254    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339257    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339260    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339265    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339268    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339271    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339274    2580 flags.go:64] FLAG: --logging-format="text"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339277    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339280    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339283    2580 flags.go:64] FLAG: --manifest-url=""
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339286    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339292    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339295    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339299    2580 flags.go:64] FLAG: --max-pods="110"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339302    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339305    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339309    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339312    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339315    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339318    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 00:02:38.346944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339321    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339328    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339331    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339334    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339337    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339340    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339346    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339348    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339352    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339354    2580 flags.go:64] FLAG: --port="10250"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339357    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339360    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0619c920d1d996453"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339364    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339367    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339370    2580 flags.go:64] FLAG: --register-node="true"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339373    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339376    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339379    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339382    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339386    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339390    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339393    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339396    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339399    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339403    2580 flags.go:64] FLAG: --runonce="false"
Sep 08 00:02:38.347583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339406    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339409    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339412    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339415    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339418    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339421    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339425    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339428    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339431    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339434    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339438    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339441    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339444    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339447    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339450    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339455    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339458    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339461    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339465    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339467    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339470    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339473    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339476    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339479    2580 flags.go:64] FLAG: --v="2"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339483    2580 flags.go:64] FLAG: --version="false"
Sep 08 00:02:38.348224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339487    2580 flags.go:64] FLAG: --vmodule=""
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339491    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.339495    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339613    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339617    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339620    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339625    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339627    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339630    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339633    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339638    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339640    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339643    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339645    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339648    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339651    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339653    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339656    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339658    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339661    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:38.348823 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339664    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339666    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339669    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339672    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339675    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339677    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339680    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339682    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339685    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339687    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339690    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339693    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339695    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339698    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339705    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339709    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339713    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339717    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339721    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339724    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:38.349345 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339727    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339729    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339735    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339739    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339741    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339745    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339749    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339752    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339755    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339758    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339761    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339764    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339768    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339771    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339774    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339777    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339780    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339783    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339785    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:38.349832 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339788    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339791    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339794    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339796    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339799    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339802    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339804    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339807    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339854    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339912    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339917    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339923    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339928    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339933    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339937    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339943    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339947    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339951    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339956    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339961    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:38.350312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339965    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339970    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339980    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.339984    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340692    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340711    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340718    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340723    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340728    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340733    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340740    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340744    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340748    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340753    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340757    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340762    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340773    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340777    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340781    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340786    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:38.350798 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340790    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340795    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.340800    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.341372    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.348527    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.348544    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.349185    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.349194    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349253    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349258    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349261    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349266    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349270    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349273    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:38.351312 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349276    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349279    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349281    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349284    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349288    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349290    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349293    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349296    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349299    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349302    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349305    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349308    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349310    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349313    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349316    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349319    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349321    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349324    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349327    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349330    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:38.351669 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349332    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349335    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349337    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349341    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349344    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349347    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349350    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349353    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349356    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349359    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349362    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349364    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349367    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349370    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349372    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349376    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349379    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349383    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349385    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349388    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:38.352167 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349391    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349393    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349396    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349399    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349401    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349404    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349406    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349409    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349412    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349414    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349417    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349419    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349422    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349424    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349427    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349430    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349433    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349436    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349439    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349441    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:38.352654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349444    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349446    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349448    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349451    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349453    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349456    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349458    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349461    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349463    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349466    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349469    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349471    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349474    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349476    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349478    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349481    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349484    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349486    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349488    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349491    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:38.353154 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349493    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349498    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349501    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349504    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349508    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349511    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349513    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349517    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349520    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349522    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349525    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349528    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349531    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.349536    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:02:38.353654 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349666    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349670    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349674    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349677    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349680    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349683    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349685    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349688    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349690    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349693    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349696    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349699    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349701    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349704    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349708    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349712    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349715    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349718    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349720    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:38.354011 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349723    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349726    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349732    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349735    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349737    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349740    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349743    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349746    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349748    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349752    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349754    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349757    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349759    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349762    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349764    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349767    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349769    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349772    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349775    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349777    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:38.354480 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349780    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349782    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349785    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349788    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349790    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349793    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349795    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349798    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349800    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349803    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349806    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349808    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349811    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349813    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349816    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349819    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349822    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349824    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349827    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349830    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:38.354962 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349833    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349836    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349838    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349841    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349844    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349847    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349849    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349852    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349854    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349857    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349859    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349862    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349864    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349867    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349869    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349872    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349875    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349877    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349880    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349883    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:38.355454 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349885    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349888    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349890    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349893    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349895    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349898    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349900    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349903    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349910    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349914    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349918    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349921    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349924    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349927    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349929    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349932    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349935    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349937    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349940    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:38.355931 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:38.349942    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:38.356403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.349947    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:02:38.356403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.350060    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 00:02:38.356403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.353171    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 00:02:38.356403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.354050    2580 server.go:1019] "Starting client certificate rotation"
Sep 08 00:02:38.356403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.354161    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 00:02:38.356403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.354826    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 00:02:38.356403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.356377    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 00:02:38.357541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.357525    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 00:02:38.367073 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.367057    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 08 00:02:38.371215 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.371200    2580 log.go:25] "Validated CRI v1 image API"
Sep 08 00:02:38.372789 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.372774    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 00:02:38.376269 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.376231    2580 fs.go:135] Filesystem UUIDs: map[02d2032c-2192-47a4-afdd-04ae2d8a3c28:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b2c92587-a2df-4ccc-a725-0769998803d2:/dev/nvme0n1p3]
Sep 08 00:02:38.376376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.376271    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 00:02:38.380685 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.380665    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 00:02:38.382093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.381983    2580 manager.go:216] Machine: {Timestamp:2026-09-08 00:02:38.380741399 +0000 UTC m=+0.281377752 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100169 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a402f436ccd475bb5478431b97d98 SystemUUID:ec2a402f-436c-cd47-5bb5-478431b97d98 BootID:66a01513-a978-4a8c-9270-619417c744ca Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:d9:cd:28:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:d9:cd:28:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:7c:04:36:6d:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 00:02:38.382093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.382087    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 00:02:38.382249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.382208    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 00:02:38.384437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.384415    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 00:02:38.384568 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.384440    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 00:02:38.385491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.385480    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 00:02:38.385525 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.385493    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 00:02:38.385525 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.385501    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 00:02:38.386082 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.386072    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 00:02:38.386838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.386828    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 00:02:38.389438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389428    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 00:02:38.389549 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389539    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 00:02:38.389586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389567    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 00:02:38.389586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389576    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 00:02:38.389642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389590    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 00:02:38.389642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389599    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 08 00:02:38.389642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389610    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 00:02:38.389994 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.389973    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 00:02:38.390042 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.390000    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 00:02:38.391920 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.391899    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 00:02:38.394076 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.394063    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 00:02:38.394131 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.394093    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 00:02:38.395766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395753    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 00:02:38.395815 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395775    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 00:02:38.395815 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395785    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 00:02:38.395873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395821    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 00:02:38.395873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395852    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 00:02:38.395873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395861    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 00:02:38.395955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395882    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 00:02:38.395955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395889    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 00:02:38.395955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395896    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 00:02:38.395955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395902    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 00:02:38.395955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395918    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 00:02:38.395955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.395924    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 00:02:38.396547 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.396534    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 00:02:38.396581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.396551    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 00:02:38.398278 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.398249    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 00:02:38.398921 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.398899    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 00:02:38.398977 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.398900    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 00:02:38.400376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.400363    2580 server.go:1268] "Started kubelet"
Sep 08 00:02:38.401464 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.401427    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 00:02:38.401564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.401514    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 00:02:38.401663 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.401587    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 00:02:38.402293 ip-10-0-136-92 systemd[1]: Started Kubernetes Kubelet.
Sep 08 00:02:38.402498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.402475    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xn78d"
Sep 08 00:02:38.402789 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.402763    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 00:02:38.403545 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.403526    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 00:02:38.407106 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.407077    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 00:02:38.407905 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.407804    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 00:02:38.408083 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.408066    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 00:02:38.409058 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.409041    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 00:02:38.409058 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.409057    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 00:02:38.409227 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.409193    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 00:02:38.409274 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.409232    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 00:02:38.409274 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.409237    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 00:02:38.409742 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.409719    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:38.409817 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.406070    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-92.ec2.internal.18d32f8cb6856cb2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-92.ec2.internal,UID:ip-10-0-136-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-92.ec2.internal,},FirstTimestamp:2026-09-08 00:02:38.400343218 +0000 UTC m=+0.300979625,LastTimestamp:2026-09-08 00:02:38.400343218 +0000 UTC m=+0.300979625,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-92.ec2.internal,}"
Sep 08 00:02:38.410681 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410653    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xn78d"
Sep 08 00:02:38.410763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410682    2580 factory.go:153] Registering CRI-O factory
Sep 08 00:02:38.410763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410698    2580 factory.go:223] Registration of the crio container factory successfully
Sep 08 00:02:38.410763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410754    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 00:02:38.410763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410763    2580 factory.go:55] Registering systemd factory
Sep 08 00:02:38.410956 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410771    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 08 00:02:38.410956 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410788    2580 factory.go:103] Registering Raw factory
Sep 08 00:02:38.410956 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.410802    2580 manager.go:1196] Started watching for new ooms in manager
Sep 08 00:02:38.411204 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.411189    2580 manager.go:349] Starting recovery of all containers
Sep 08 00:02:38.418017 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.417995    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:38.420524 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.420503    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-92.ec2.internal\" not found" node="ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.422455 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.422439    2580 manager.go:354] Recovery completed
Sep 08 00:02:38.426819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.426805    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:38.428711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.428694    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:38.428795 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.428725    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:38.428795 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.428736    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:38.429832 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.429452    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 00:02:38.429832 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.429563    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 00:02:38.429832 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.429582    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 00:02:38.429832 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.429636    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:38.431302 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.430685    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:38.431302 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.430711    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:38.431302 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.430736    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:38.431808 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.431793    2580 policy_none.go:49] "None policy: Start"
Sep 08 00:02:38.431867 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.431810    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 00:02:38.431867 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.431821    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 00:02:38.432812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.432799    2580 policy_none.go:47] "Start"
Sep 08 00:02:38.468767 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.468749    2580 manager.go:337] "Starting Device Plugin manager"
Sep 08 00:02:38.468906 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.468794    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 00:02:38.468906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.468809    2580 server.go:87] "Starting device plugin registration server"
Sep 08 00:02:38.469050 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.469038    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 00:02:38.469087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.469053    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 00:02:38.469211 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.469196    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 00:02:38.469318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.469277    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 00:02:38.469318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.469286    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 00:02:38.469753 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.469733    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 00:02:38.469837 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.469787    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:38.504013 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.503981    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 00:02:38.505198 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.505176    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 00:02:38.505292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.505232    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 00:02:38.505292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.505261    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 00:02:38.505398 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.505306    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 00:02:38.507251 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.507232    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:38.569355 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.569323    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:38.570391 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.570363    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:38.570530 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.570399    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:38.570530 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.570416    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:38.570530 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.570446    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.578199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.578178    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.578298 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.578207    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-92.ec2.internal\": node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:38.593388 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.593299    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:38.605670 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.605646    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal"]
Sep 08 00:02:38.605766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.605728    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:38.606738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.606719    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:38.606839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.606755    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:38.606839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.606769    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:38.610259 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.610243    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:38.610347 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.610267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c79130753104af7d7bd480450efe4b28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal\" (UID: \"c79130753104af7d7bd480450efe4b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.610347 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.610298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c79130753104af7d7bd480450efe4b28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal\" (UID: \"c79130753104af7d7bd480450efe4b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.610445 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.610431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.610478 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.610459    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:38.611010 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.610995    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:38.611010 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.611002    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:38.611099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.611023    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:38.611099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.611027    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:38.611099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.611042    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:38.611099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.611043    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:38.612517 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.612499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.612611 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.612525    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:38.613259 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.613242    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:38.613326 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.613268    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:38.613326 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.613277    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:38.639733 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.639715    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-92.ec2.internal\" not found" node="ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.644128 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.644112    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-92.ec2.internal\" not found" node="ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.693844 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.693824    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:38.710641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.710616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06d7a19175fa2c2b715d0ca801338376-config\") pod \"kube-apiserver-proxy-ip-10-0-136-92.ec2.internal\" (UID: \"06d7a19175fa2c2b715d0ca801338376\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.710717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.710653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c79130753104af7d7bd480450efe4b28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal\" (UID: \"c79130753104af7d7bd480450efe4b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.710717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.710670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c79130753104af7d7bd480450efe4b28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal\" (UID: \"c79130753104af7d7bd480450efe4b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.710787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.710723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c79130753104af7d7bd480450efe4b28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal\" (UID: \"c79130753104af7d7bd480450efe4b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.710787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.710735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c79130753104af7d7bd480450efe4b28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal\" (UID: \"c79130753104af7d7bd480450efe4b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.794821 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.794789    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:38.811083 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.811060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06d7a19175fa2c2b715d0ca801338376-config\") pod \"kube-apiserver-proxy-ip-10-0-136-92.ec2.internal\" (UID: \"06d7a19175fa2c2b715d0ca801338376\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.811212 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.811098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06d7a19175fa2c2b715d0ca801338376-config\") pod \"kube-apiserver-proxy-ip-10-0-136-92.ec2.internal\" (UID: \"06d7a19175fa2c2b715d0ca801338376\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.895573 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.895499    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:38.942025 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.941989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.946824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:38.946807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:38.996575 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:38.996539    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:39.097084 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:39.097036    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:39.197642 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:39.197559    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:40.713412 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:40.713388    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:40.768886 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:40.768857    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 00:02:40.769331 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:40.768993    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 00:02:40.769331 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:40.769021    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 00:02:40.814428 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:40.814390    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:40.829563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:40.829524    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 23:57:39 +0000 UTC" deadline="2028-05-21 21:00:52.935333962 +0000 UTC"
Sep 08 00:02:40.829563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:40.829555    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14924h58m12.105782214s"
Sep 08 00:02:40.914957 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:40.914793    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:41.006169 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:41.006131    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d7a19175fa2c2b715d0ca801338376.slice/crio-239eecfa827c906aa57a3ab9ee2ad61323f77904483375d25353ea99e7f73730 WatchSource:0}: Error finding container 239eecfa827c906aa57a3ab9ee2ad61323f77904483375d25353ea99e7f73730: Status 404 returned error can't find the container with id 239eecfa827c906aa57a3ab9ee2ad61323f77904483375d25353ea99e7f73730
Sep 08 00:02:41.009385 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:41.009339    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79130753104af7d7bd480450efe4b28.slice/crio-14967c4da8d699cc3de762083784fba8f559642eb856fab3cb8f6bfda55181bb WatchSource:0}: Error finding container 14967c4da8d699cc3de762083784fba8f559642eb856fab3cb8f6bfda55181bb: Status 404 returned error can't find the container with id 14967c4da8d699cc3de762083784fba8f559642eb856fab3cb8f6bfda55181bb
Sep 08 00:02:41.012436 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.012419    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:02:41.015176 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:41.015155    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:41.115844 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:41.115810    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:41.216326 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:41.216249    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:41.228996 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.228970    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:41.317385 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:41.317355    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-92.ec2.internal\" not found"
Sep 08 00:02:41.361044 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.360983    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:41.424674 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.424642    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:41.433554 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.433530    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 00:02:41.434482 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.434466    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal"
Sep 08 00:02:41.439024 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.439007    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 00:02:41.805610 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.805569    2580 apiserver.go:52] "Watching apiserver"
Sep 08 00:02:41.811645 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.811610    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 00:02:41.812046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.812022    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-rqzxd","openshift-multus/network-metrics-daemon-gtfmd","openshift-network-diagnostics/network-check-target-5sj74","openshift-network-operator/iptables-alerter-nvqwp","kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal","openshift-multus/multus-additional-cni-plugins-5bjml","openshift-multus/multus-crjbp","openshift-ovn-kubernetes/ovnkube-node-spxh8","kube-system/global-pull-secret-syncer-x9bsd","kube-system/konnectivity-agent-dwbtz","openshift-cluster-node-tuning-operator/tuned-8x2fh","openshift-dns/node-resolver-msrxm"]
Sep 08 00:02:41.815095 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.814705    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.816671 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.816498    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 00:02:41.816808 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.816790    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 00:02:41.816939 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.816918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.817136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.817116    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 00:02:41.817211 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.816788    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-klw5t\""
Sep 08 00:02:41.818722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.818420    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 00:02:41.818722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.818585    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 00:02:41.818722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.818616    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dfkcx\""
Sep 08 00:02:41.820020 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.819543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.821565 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.821543    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 00:02:41.821655 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.821621    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 00:02:41.822089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.821775    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 00:02:41.822089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.821852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 00:02:41.822089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.821855    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 00:02:41.822089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.821979    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 00:02:41.822089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.821986    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qggnf\""
Sep 08 00:02:41.822089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.822030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.823524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.823506    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 00:02:41.823793 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.823772    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 00:02:41.823877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.823830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r87wj\""
Sep 08 00:02:41.824012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.823995    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:02:41.824090 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.824001    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 00:02:41.824268 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.824249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.827157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.827135    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 00:02:41.829594 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.827479    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b8qc7\""
Sep 08 00:02:41.829594 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.827569    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 00:02:41.829594 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.827598    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 00:02:41.829774 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.829735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.831529 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.831487    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 00:02:41.831632 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.831594    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w4hw9\""
Sep 08 00:02:41.831779 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.831759    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 00:02:41.831881 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.831865    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 00:02:41.831967 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.831949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 00:02:41.832029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.831994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.832079 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.832058    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 00:02:41.833899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.833880    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 00:02:41.834096 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834077    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pgtq5\""
Sep 08 00:02:41.834356 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834326    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:41.834444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-run-netns\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834444 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:41.834413    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:41.834444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-cni-netd\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-device-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.834579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-sys-fs\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.834579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-log-socket\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bbc5dd-9366-437d-a1b6-385411bc74d2-host-slash\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.834769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.834769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjlg\" (UniqueName: \"kubernetes.io/projected/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-kube-api-access-pjjlg\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.834769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bb4842c-673e-422e-abdc-d20c6a001ed3-hosts-file\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.834769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-systemd\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-var-lib-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-ovn\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovnkube-config\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-slash\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-socket-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-host\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.834997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-kubelet\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.834998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgxl\" (UniqueName: \"kubernetes.io/projected/22902951-f92a-48f0-8e99-3e8d25e43f7c-kube-api-access-qdgxl\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bbc5dd-9366-437d-a1b6-385411bc74d2-iptables-alerter-script\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-cnibin\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-etc-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-node-log\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-system-cni-dir\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-systemd-units\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovn-node-metrics-cert\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovnkube-script-lib\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwdf5\" (UniqueName: \"kubernetes.io/projected/53bbc5dd-9366-437d-a1b6-385411bc74d2-kube-api-access-nwdf5\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835445    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-registration-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-cni-bin\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb8kl\" (UniqueName: \"kubernetes.io/projected/c0b01843-2b47-4d7e-918b-7344af21ff55-kube-api-access-zb8kl\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-serviceca\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-env-overrides\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bxq\" (UniqueName: \"kubernetes.io/projected/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-kube-api-access-76bxq\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bb4842c-673e-422e-abdc-d20c6a001ed3-tmp-dir\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.835906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.835699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lfg2\" (UniqueName: \"kubernetes.io/projected/6bb4842c-673e-422e-abdc-d20c6a001ed3-kube-api-access-9lfg2\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.837288 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.837266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:41.837391 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:41.837371    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:41.839407 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.839385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:41.841249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.841095    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 00:02:41.841249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.841104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 00:02:41.841412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.841251    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-76fwz\""
Sep 08 00:02:41.842043 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.841731    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.843564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.843445    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:02:41.843686 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.843671    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 00:02:41.843757 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.843653    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xf544\""
Sep 08 00:02:41.844116 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.844019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:41.844116 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:41.844083    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:41.853800 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.853780    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zphbt"
Sep 08 00:02:41.860400 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.860379    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zphbt"
Sep 08 00:02:41.925246 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.925220    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 00:02:41.925761 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.925719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal" event={"ID":"c79130753104af7d7bd480450efe4b28","Type":"ContainerStarted","Data":"14967c4da8d699cc3de762083784fba8f559642eb856fab3cb8f6bfda55181bb"}
Sep 08 00:02:41.926863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.926838    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal" event={"ID":"06d7a19175fa2c2b715d0ca801338376","Type":"ContainerStarted","Data":"239eecfa827c906aa57a3ab9ee2ad61323f77904483375d25353ea99e7f73730"}
Sep 08 00:02:41.935860 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.935833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-sys-fs\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.935960 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.935870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64d572a2-446d-4e67-9e21-8ad84a878f86-dbus\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:41.935960 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.935903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-host\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.935960 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.935944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-sys-fs\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.936093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.935948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-cni-bin\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.936093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.936093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjlg\" (UniqueName: \"kubernetes.io/projected/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-kube-api-access-pjjlg\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.936236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-systemd\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-var-lib-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-kubernetes\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.936236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysctl-conf\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.936236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-hostroot\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.936236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-systemd\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-var-lib-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-kubelet\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-kubelet\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgxl\" (UniqueName: \"kubernetes.io/projected/22902951-f92a-48f0-8e99-3e8d25e43f7c-kube-api-access-qdgxl\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bbc5dd-9366-437d-a1b6-385411bc74d2-iptables-alerter-script\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-cni-binary-copy\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-cnibin\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-etc-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-node-log\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-cnibin\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.936924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-etc-openvswitch\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-cni-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-systemd-units\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-node-log\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.936999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64d572a2-446d-4e67-9e21-8ad84a878f86-kubelet-config\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88d9dd4e-bfa0-434c-8331-90368393abb6-agent-certs\") pod \"konnectivity-agent-dwbtz\" (UID: \"88d9dd4e-bfa0-434c-8331-90368393abb6\") " pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-systemd-units\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-tuned\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bbc5dd-9366-437d-a1b6-385411bc74d2-iptables-alerter-script\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bb65302-9199-4dc2-8753-15e221c27ac8-tmp\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-cnibin\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-conf-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-daemon-config\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-cni-bin\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-sys\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-socket-dir-parent\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.937287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-cni-bin\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-multus-certs\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-serviceca\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-cni-multus\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76bxq\" (UniqueName: \"kubernetes.io/projected/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-kube-api-access-76bxq\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-etc-kubernetes\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-device-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-log-socket\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937685    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bbc5dd-9366-437d-a1b6-385411bc74d2-host-slash\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-modprobe-d\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-systemd\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-netns\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.938037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-serviceca\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bbc5dd-9366-437d-a1b6-385411bc74d2-host-slash\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bb4842c-673e-422e-abdc-d20c6a001ed3-hosts-file\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-ovn\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-log-socket\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bb4842c-673e-422e-abdc-d20c6a001ed3-hosts-file\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-device-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-run-ovn\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovnkube-config\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.937970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-var-lib-kubelet\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44kgd\" (UniqueName: \"kubernetes.io/projected/0bb65302-9199-4dc2-8753-15e221c27ac8-kube-api-access-44kgd\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-slash\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-socket-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-host\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysctl-d\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.938794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-slash\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-host\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88d9dd4e-bfa0-434c-8331-90368393abb6-konnectivity-ca\") pod \"konnectivity-agent-dwbtz\" (UID: \"88d9dd4e-bfa0-434c-8331-90368393abb6\") " pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-system-cni-dir\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-socket-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovn-node-metrics-cert\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovnkube-script-lib\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b01843-2b47-4d7e-918b-7344af21ff55-system-cni-dir\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwdf5\" (UniqueName: \"kubernetes.io/projected/53bbc5dd-9366-437d-a1b6-385411bc74d2-kube-api-access-nwdf5\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-system-cni-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-registration-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb8kl\" (UniqueName: \"kubernetes.io/projected/c0b01843-2b47-4d7e-918b-7344af21ff55-kube-api-access-zb8kl\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-env-overrides\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.939497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-registration-dir\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovnkube-config\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-run\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-lib-modules\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh2gc\" (UniqueName: \"kubernetes.io/projected/c2596833-1719-44c4-88a9-6dd45d24c408-kube-api-access-xh2gc\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-kubelet\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkh5q\" (UniqueName: \"kubernetes.io/projected/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-kube-api-access-wkh5q\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bb4842c-673e-422e-abdc-d20c6a001ed3-tmp-dir\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b01843-2b47-4d7e-918b-7344af21ff55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lfg2\" (UniqueName: \"kubernetes.io/projected/6bb4842c-673e-422e-abdc-d20c6a001ed3-kube-api-access-9lfg2\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-run-netns\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovnkube-script-lib\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-run-netns\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-cni-netd\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysconfig\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-k8s-cni-cncf-io\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:41.940014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938974    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bb4842c-673e-422e-abdc-d20c6a001ed3-tmp-dir\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:41.940620 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/22902951-f92a-48f0-8e99-3e8d25e43f7c-host-cni-netd\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940620 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.938994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/22902951-f92a-48f0-8e99-3e8d25e43f7c-env-overrides\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.940620 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.939115    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 00:02:41.943191 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.943165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/22902951-f92a-48f0-8e99-3e8d25e43f7c-ovn-node-metrics-cert\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.943988 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.943965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjlg\" (UniqueName: \"kubernetes.io/projected/3ae90b78-ddb0-4f9b-a843-eadebeaca31b-kube-api-access-pjjlg\") pod \"node-ca-rqzxd\" (UID: \"3ae90b78-ddb0-4f9b-a843-eadebeaca31b\") " pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:41.944182 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.944165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgxl\" (UniqueName: \"kubernetes.io/projected/22902951-f92a-48f0-8e99-3e8d25e43f7c-kube-api-access-qdgxl\") pod \"ovnkube-node-spxh8\" (UID: \"22902951-f92a-48f0-8e99-3e8d25e43f7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:41.944251 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.944232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bxq\" (UniqueName: \"kubernetes.io/projected/c7ad24fe-4a4c-4833-abd8-2d3fc634260a-kube-api-access-76bxq\") pod \"aws-ebs-csi-driver-node-5pt2s\" (UID: \"c7ad24fe-4a4c-4833-abd8-2d3fc634260a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:41.951393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.951373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwdf5\" (UniqueName: \"kubernetes.io/projected/53bbc5dd-9366-437d-a1b6-385411bc74d2-kube-api-access-nwdf5\") pod \"iptables-alerter-nvqwp\" (UID: \"53bbc5dd-9366-437d-a1b6-385411bc74d2\") " pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:41.951510 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.951473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb8kl\" (UniqueName: \"kubernetes.io/projected/c0b01843-2b47-4d7e-918b-7344af21ff55-kube-api-access-zb8kl\") pod \"multus-additional-cni-plugins-5bjml\" (UID: \"c0b01843-2b47-4d7e-918b-7344af21ff55\") " pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:41.952527 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:41.952508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lfg2\" (UniqueName: \"kubernetes.io/projected/6bb4842c-673e-422e-abdc-d20c6a001ed3-kube-api-access-9lfg2\") pod \"node-resolver-msrxm\" (UID: \"6bb4842c-673e-422e-abdc-d20c6a001ed3\") " pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:42.039895 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.039845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bb65302-9199-4dc2-8753-15e221c27ac8-tmp\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.039895 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.039894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-cnibin\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.039914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-conf-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.039935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-daemon-config\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.039958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-sys\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.039980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-socket-dir-parent\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-multus-certs\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-cnibin\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-cni-multus\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040077    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-sys\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-etc-kubernetes\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-modprobe-d\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-systemd\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-netns\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-socket-dir-parent\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-var-lib-kubelet\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-multus-certs\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-var-lib-kubelet\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-conf-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-netns\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-modprobe-d\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44kgd\" (UniqueName: \"kubernetes.io/projected/0bb65302-9199-4dc2-8753-15e221c27ac8-kube-api-access-44kgd\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-systemd\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-cni-multus\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-etc-kubernetes\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysctl-d\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88d9dd4e-bfa0-434c-8331-90368393abb6-konnectivity-ca\") pod \"konnectivity-agent-dwbtz\" (UID: \"88d9dd4e-bfa0-434c-8331-90368393abb6\") " pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysctl-d\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.040701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-system-cni-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-run\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-system-cni-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-lib-modules\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh2gc\" (UniqueName: \"kubernetes.io/projected/c2596833-1719-44c4-88a9-6dd45d24c408-kube-api-access-xh2gc\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.040642    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-lib-modules\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-kubelet\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-kubelet\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-run\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.040743    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret podName:64d572a2-446d-4e67-9e21-8ad84a878f86 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:42.540694933 +0000 UTC m=+3.026123534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret") pod "global-pull-secret-syncer-x9bsd" (UID: "64d572a2-446d-4e67-9e21-8ad84a878f86") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkh5q\" (UniqueName: \"kubernetes.io/projected/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-kube-api-access-wkh5q\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysconfig\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-k8s-cni-cncf-io\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64d572a2-446d-4e67-9e21-8ad84a878f86-dbus\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysconfig\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-host\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-cni-bin\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.041602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-host\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-run-k8s-cni-cncf-io\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.040978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-kubernetes\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysctl-conf\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-host-var-lib-cni-bin\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-hostroot\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-cni-binary-copy\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-kubernetes\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-cni-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-hostroot\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-daemon-config\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64d572a2-446d-4e67-9e21-8ad84a878f86-kubelet-config\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64d572a2-446d-4e67-9e21-8ad84a878f86-kubelet-config\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.041209    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64d572a2-446d-4e67-9e21-8ad84a878f86-dbus\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-sysctl-conf\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.042442 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88d9dd4e-bfa0-434c-8331-90368393abb6-konnectivity-ca\") pod \"konnectivity-agent-dwbtz\" (UID: \"88d9dd4e-bfa0-434c-8331-90368393abb6\") " pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:42.043253 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.041256    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs podName:c2596833-1719-44c4-88a9-6dd45d24c408 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:42.541239831 +0000 UTC m=+3.026668436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs") pod "network-metrics-daemon-gtfmd" (UID: "c2596833-1719-44c4-88a9-6dd45d24c408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:42.043253 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-multus-cni-dir\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.043253 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-cni-binary-copy\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.043253 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88d9dd4e-bfa0-434c-8331-90368393abb6-agent-certs\") pod \"konnectivity-agent-dwbtz\" (UID: \"88d9dd4e-bfa0-434c-8331-90368393abb6\") " pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:42.043253 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.041698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-tuned\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.043601 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.043576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bb65302-9199-4dc2-8753-15e221c27ac8-tmp\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.044085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.044063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bb65302-9199-4dc2-8753-15e221c27ac8-etc-tuned\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.044388 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.044340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88d9dd4e-bfa0-434c-8331-90368393abb6-agent-certs\") pod \"konnectivity-agent-dwbtz\" (UID: \"88d9dd4e-bfa0-434c-8331-90368393abb6\") " pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:42.045963 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.045940    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:42.046079 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.045971    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:42.046079 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.045986    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9d4mm for pod openshift-network-diagnostics/network-check-target-5sj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:42.046079 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.046054    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm podName:71b33e22-646f-465f-bf83-9fcbd22c0b8a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:42.546033008 +0000 UTC m=+3.031461594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9d4mm" (UniqueName: "kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm") pod "network-check-target-5sj74" (UID: "71b33e22-646f-465f-bf83-9fcbd22c0b8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:42.048518 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.048482    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh2gc\" (UniqueName: \"kubernetes.io/projected/c2596833-1719-44c4-88a9-6dd45d24c408-kube-api-access-xh2gc\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:42.049560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.049538    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44kgd\" (UniqueName: \"kubernetes.io/projected/0bb65302-9199-4dc2-8753-15e221c27ac8-kube-api-access-44kgd\") pod \"tuned-8x2fh\" (UID: \"0bb65302-9199-4dc2-8753-15e221c27ac8\") " pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.049674 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.049585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkh5q\" (UniqueName: \"kubernetes.io/projected/69d65d9b-7203-4ce5-aa6f-9b5807a96f29-kube-api-access-wkh5q\") pod \"multus-crjbp\" (UID: \"69d65d9b-7203-4ce5-aa6f-9b5807a96f29\") " pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.128363 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.128260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rqzxd"
Sep 08 00:02:42.137714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.137691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-msrxm"
Sep 08 00:02:42.148574 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.148553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:02:42.154321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.154300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvqwp"
Sep 08 00:02:42.160038 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.160019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s"
Sep 08 00:02:42.167676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.167655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bjml"
Sep 08 00:02:42.176335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.176315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crjbp"
Sep 08 00:02:42.182991 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.182970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:02:42.187732 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.187710    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8x2fh"
Sep 08 00:02:42.189057 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.189041    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:42.232303 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.232272    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:42.545688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.545607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:42.545688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.545684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:42.545900 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.545795    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:42.545900 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.545856    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret podName:64d572a2-446d-4e67-9e21-8ad84a878f86 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:43.545837933 +0000 UTC m=+4.031266536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret") pod "global-pull-secret-syncer-x9bsd" (UID: "64d572a2-446d-4e67-9e21-8ad84a878f86") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:42.545900 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.545795    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:42.546050 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.545952    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs podName:c2596833-1719-44c4-88a9-6dd45d24c408 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:43.545930002 +0000 UTC m=+4.031358591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs") pod "network-metrics-daemon-gtfmd" (UID: "c2596833-1719-44c4-88a9-6dd45d24c408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:42.646428 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.646394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:42.646609 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.646577    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:42.646609 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.646598    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:42.646609 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.646610    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9d4mm for pod openshift-network-diagnostics/network-check-target-5sj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:42.646741 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.646669    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm podName:71b33e22-646f-465f-bf83-9fcbd22c0b8a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:43.646650448 +0000 UTC m=+4.132079040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d4mm" (UniqueName: "kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm") pod "network-check-target-5sj74" (UID: "71b33e22-646f-465f-bf83-9fcbd22c0b8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:42.863538 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.863433    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 23:57:41 +0000 UTC" deadline="2028-03-04 13:28:31.065563721 +0000 UTC"
Sep 08 00:02:42.863538 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.863494    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13045h25m48.202072199s"
Sep 08 00:02:42.880136 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.880107    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b01843_2b47_4d7e_918b_7344af21ff55.slice/crio-712c3c37a47ecca38fd7a22a9c3c785555c5de9f1c49abca12d6a9e7c8aabe7f WatchSource:0}: Error finding container 712c3c37a47ecca38fd7a22a9c3c785555c5de9f1c49abca12d6a9e7c8aabe7f: Status 404 returned error can't find the container with id 712c3c37a47ecca38fd7a22a9c3c785555c5de9f1c49abca12d6a9e7c8aabe7f
Sep 08 00:02:42.881759 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.881702    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae90b78_ddb0_4f9b_a843_eadebeaca31b.slice/crio-e355c14ed1019dfc125f84370e17b7f723540a86308a919c65efac0b33eb5322 WatchSource:0}: Error finding container e355c14ed1019dfc125f84370e17b7f723540a86308a919c65efac0b33eb5322: Status 404 returned error can't find the container with id e355c14ed1019dfc125f84370e17b7f723540a86308a919c65efac0b33eb5322
Sep 08 00:02:42.884891 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.884868    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb65302_9199_4dc2_8753_15e221c27ac8.slice/crio-2bda1297db5682d0b167eb66c23d1e7cdbfae775f5a20971ec73eb6a2c930dc7 WatchSource:0}: Error finding container 2bda1297db5682d0b167eb66c23d1e7cdbfae775f5a20971ec73eb6a2c930dc7: Status 404 returned error can't find the container with id 2bda1297db5682d0b167eb66c23d1e7cdbfae775f5a20971ec73eb6a2c930dc7
Sep 08 00:02:42.885825 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.885805    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d65d9b_7203_4ce5_aa6f_9b5807a96f29.slice/crio-39d3512588c97d055c1c119ec1e71a8c98b3e1f3b09b84a49c621410edbef9e8 WatchSource:0}: Error finding container 39d3512588c97d055c1c119ec1e71a8c98b3e1f3b09b84a49c621410edbef9e8: Status 404 returned error can't find the container with id 39d3512588c97d055c1c119ec1e71a8c98b3e1f3b09b84a49c621410edbef9e8
Sep 08 00:02:42.886737 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.886587    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb4842c_673e_422e_abdc_d20c6a001ed3.slice/crio-ee401751ffc2e082808b48dcdb2a118476e0e6a5099521b7eeec422dd383d1fc WatchSource:0}: Error finding container ee401751ffc2e082808b48dcdb2a118476e0e6a5099521b7eeec422dd383d1fc: Status 404 returned error can't find the container with id ee401751ffc2e082808b48dcdb2a118476e0e6a5099521b7eeec422dd383d1fc
Sep 08 00:02:42.887924 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.887891    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bbc5dd_9366_437d_a1b6_385411bc74d2.slice/crio-0498ed65fbd2e01c29ffdaa3e0fd47fd6db993daba909d33290131dfc17602be WatchSource:0}: Error finding container 0498ed65fbd2e01c29ffdaa3e0fd47fd6db993daba909d33290131dfc17602be: Status 404 returned error can't find the container with id 0498ed65fbd2e01c29ffdaa3e0fd47fd6db993daba909d33290131dfc17602be
Sep 08 00:02:42.889366 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.889225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ad24fe_4a4c_4833_abd8_2d3fc634260a.slice/crio-4c4844658138f67be378ac832a81d13747d283c40b021dae6416b50ac7a39e60 WatchSource:0}: Error finding container 4c4844658138f67be378ac832a81d13747d283c40b021dae6416b50ac7a39e60: Status 404 returned error can't find the container with id 4c4844658138f67be378ac832a81d13747d283c40b021dae6416b50ac7a39e60
Sep 08 00:02:42.889708 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.889658    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22902951_f92a_48f0_8e99_3e8d25e43f7c.slice/crio-ea28f3cf107b081cbe964c78f5dfd175e7e978d96b9a62d301d4d02b4f2dfdc3 WatchSource:0}: Error finding container ea28f3cf107b081cbe964c78f5dfd175e7e978d96b9a62d301d4d02b4f2dfdc3: Status 404 returned error can't find the container with id ea28f3cf107b081cbe964c78f5dfd175e7e978d96b9a62d301d4d02b4f2dfdc3
Sep 08 00:02:42.891466 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:02:42.891444    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d9dd4e_bfa0_434c_8331_90368393abb6.slice/crio-10d24c2a085552423c1b53a684a0788428d5cf4608835f56bdaeaaf4985efb4c WatchSource:0}: Error finding container 10d24c2a085552423c1b53a684a0788428d5cf4608835f56bdaeaaf4985efb4c: Status 404 returned error can't find the container with id 10d24c2a085552423c1b53a684a0788428d5cf4608835f56bdaeaaf4985efb4c
Sep 08 00:02:42.921273 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.921250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:42.921418 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:42.921391    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:42.929777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.929750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8x2fh" event={"ID":"0bb65302-9199-4dc2-8753-15e221c27ac8","Type":"ContainerStarted","Data":"2bda1297db5682d0b167eb66c23d1e7cdbfae775f5a20971ec73eb6a2c930dc7"}
Sep 08 00:02:42.931024 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.930993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crjbp" event={"ID":"69d65d9b-7203-4ce5-aa6f-9b5807a96f29","Type":"ContainerStarted","Data":"39d3512588c97d055c1c119ec1e71a8c98b3e1f3b09b84a49c621410edbef9e8"}
Sep 08 00:02:42.932005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.931985    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rqzxd" event={"ID":"3ae90b78-ddb0-4f9b-a843-eadebeaca31b","Type":"ContainerStarted","Data":"e355c14ed1019dfc125f84370e17b7f723540a86308a919c65efac0b33eb5322"}
Sep 08 00:02:42.933085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.933067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerStarted","Data":"712c3c37a47ecca38fd7a22a9c3c785555c5de9f1c49abca12d6a9e7c8aabe7f"}
Sep 08 00:02:42.936244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.936214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwbtz" event={"ID":"88d9dd4e-bfa0-434c-8331-90368393abb6","Type":"ContainerStarted","Data":"10d24c2a085552423c1b53a684a0788428d5cf4608835f56bdaeaaf4985efb4c"}
Sep 08 00:02:42.942241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.942207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"ea28f3cf107b081cbe964c78f5dfd175e7e978d96b9a62d301d4d02b4f2dfdc3"}
Sep 08 00:02:42.943515 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.943486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s" event={"ID":"c7ad24fe-4a4c-4833-abd8-2d3fc634260a","Type":"ContainerStarted","Data":"4c4844658138f67be378ac832a81d13747d283c40b021dae6416b50ac7a39e60"}
Sep 08 00:02:42.944880 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.944853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvqwp" event={"ID":"53bbc5dd-9366-437d-a1b6-385411bc74d2","Type":"ContainerStarted","Data":"0498ed65fbd2e01c29ffdaa3e0fd47fd6db993daba909d33290131dfc17602be"}
Sep 08 00:02:42.946046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:42.946026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-msrxm" event={"ID":"6bb4842c-673e-422e-abdc-d20c6a001ed3","Type":"ContainerStarted","Data":"ee401751ffc2e082808b48dcdb2a118476e0e6a5099521b7eeec422dd383d1fc"}
Sep 08 00:02:43.554964 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.554119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:43.554964 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.554205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:43.554964 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.554365    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:43.554964 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.554431    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs podName:c2596833-1719-44c4-88a9-6dd45d24c408 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:45.554410801 +0000 UTC m=+6.039839387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs") pod "network-metrics-daemon-gtfmd" (UID: "c2596833-1719-44c4-88a9-6dd45d24c408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:43.554964 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.554826    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:43.554964 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.554880    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret podName:64d572a2-446d-4e67-9e21-8ad84a878f86 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:45.554864856 +0000 UTC m=+6.040293441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret") pod "global-pull-secret-syncer-x9bsd" (UID: "64d572a2-446d-4e67-9e21-8ad84a878f86") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:43.655631 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.655354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:43.655631 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.655557    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:43.655631 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.655580    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:43.655631 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.655592    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9d4mm for pod openshift-network-diagnostics/network-check-target-5sj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:43.655969 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.655654    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm podName:71b33e22-646f-465f-bf83-9fcbd22c0b8a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:45.655636867 +0000 UTC m=+6.141065452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d4mm" (UniqueName: "kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm") pod "network-check-target-5sj74" (UID: "71b33e22-646f-465f-bf83-9fcbd22c0b8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:43.864069 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.863853    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 23:57:41 +0000 UTC" deadline="2028-05-27 06:47:25.581413122 +0000 UTC"
Sep 08 00:02:43.864069 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.863895    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15054h44m41.717523354s"
Sep 08 00:02:43.922199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.922157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:43.922391 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.922293    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:43.923009 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.922772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:43.923009 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:43.922872    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:43.959234 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.959198    2580 generic.go:356] "Generic (PLEG): container finished" podID="c79130753104af7d7bd480450efe4b28" containerID="327bf9b6347c71d1f9bfeaa141ab814b1093356d063def9eaa842b56f264766a" exitCode=0
Sep 08 00:02:43.959537 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.959499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal" event={"ID":"c79130753104af7d7bd480450efe4b28","Type":"ContainerDied","Data":"327bf9b6347c71d1f9bfeaa141ab814b1093356d063def9eaa842b56f264766a"}
Sep 08 00:02:43.965956 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.965517    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal" event={"ID":"06d7a19175fa2c2b715d0ca801338376","Type":"ContainerStarted","Data":"5fffdb86fbcaeebe292c3706a92115df0bdfbe0e5c01908359567c14d5faac79"}
Sep 08 00:02:43.982162 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:43.982102    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-92.ec2.internal" podStartSLOduration=2.982081707 podStartE2EDuration="2.982081707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:43.981555178 +0000 UTC m=+4.466983805" watchObservedRunningTime="2026-09-08 00:02:43.982081707 +0000 UTC m=+4.467510316"
Sep 08 00:02:44.922008 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:44.921138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:44.922008 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:44.921586    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:44.981546 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:44.981381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal" event={"ID":"c79130753104af7d7bd480450efe4b28","Type":"ContainerStarted","Data":"9f3dd2c1e1eff2e65412892e37a60cbb9fbfb54d5ff0fa1ada1db201cb43dd4b"}
Sep 08 00:02:45.000256 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:44.999452    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-92.ec2.internal" podStartSLOduration=3.999411366 podStartE2EDuration="3.999411366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:44.999070522 +0000 UTC m=+5.484499131" watchObservedRunningTime="2026-09-08 00:02:44.999411366 +0000 UTC m=+5.484839990"
Sep 08 00:02:45.572406 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:45.572362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:45.572592 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.572550    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:45.572656 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.572623    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret podName:64d572a2-446d-4e67-9e21-8ad84a878f86 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:49.572601842 +0000 UTC m=+10.058030429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret") pod "global-pull-secret-syncer-x9bsd" (UID: "64d572a2-446d-4e67-9e21-8ad84a878f86") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:45.572986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:45.572962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:45.573119 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.573103    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:45.573177 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.573155    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs podName:c2596833-1719-44c4-88a9-6dd45d24c408 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:49.573139251 +0000 UTC m=+10.058567860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs") pod "network-metrics-daemon-gtfmd" (UID: "c2596833-1719-44c4-88a9-6dd45d24c408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:45.673732 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:45.673695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:45.673928 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.673897    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:45.673928 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.673917    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:45.673928 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.673929    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9d4mm for pod openshift-network-diagnostics/network-check-target-5sj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:45.674084 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.673989    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm podName:71b33e22-646f-465f-bf83-9fcbd22c0b8a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:49.673966911 +0000 UTC m=+10.159395498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d4mm" (UniqueName: "kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm") pod "network-check-target-5sj74" (UID: "71b33e22-646f-465f-bf83-9fcbd22c0b8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:45.921377 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:45.921146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:45.921377 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:45.921162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:45.921377 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.921291    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:45.921626 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:45.921435    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:46.921520 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:46.921485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:46.922060 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:46.921637    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:47.921316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:47.920851    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:47.921316 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:47.920976    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:47.921584 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:47.921332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:47.921584 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:47.921477    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:48.921387 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:48.921270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:48.921580 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:48.921421    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:49.606439 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:49.606399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:49.606995 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:49.606478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:49.606995 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.606606    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:49.606995 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.606673    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs podName:c2596833-1719-44c4-88a9-6dd45d24c408 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:57.606652685 +0000 UTC m=+18.092081277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs") pod "network-metrics-daemon-gtfmd" (UID: "c2596833-1719-44c4-88a9-6dd45d24c408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:49.607185 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.607061    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:49.607185 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.607110    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret podName:64d572a2-446d-4e67-9e21-8ad84a878f86 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:57.60709508 +0000 UTC m=+18.092523678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret") pod "global-pull-secret-syncer-x9bsd" (UID: "64d572a2-446d-4e67-9e21-8ad84a878f86") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:49.707570 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:49.707531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:49.709051 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.708974    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:49.709051 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.709007    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:49.709051 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.709023    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9d4mm for pod openshift-network-diagnostics/network-check-target-5sj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:49.709264 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.709096    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm podName:71b33e22-646f-465f-bf83-9fcbd22c0b8a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:57.7090769 +0000 UTC m=+18.194505488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d4mm" (UniqueName: "kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm") pod "network-check-target-5sj74" (UID: "71b33e22-646f-465f-bf83-9fcbd22c0b8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:49.922164 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:49.922029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:49.922164 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.922137    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:49.923429 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:49.923312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:49.923550 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:49.923443    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:50.921547 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:50.921446    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:50.921997 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:50.921597    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:51.921199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:51.921169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:51.921400 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:51.921169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:51.921400 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:51.921290    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:51.921516 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:51.921412    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:52.921292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:52.921260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:52.921663 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:52.921393    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:53.921103 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:53.921069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:53.921282 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:53.921188    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:53.921282 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:53.921243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:53.921657 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:53.921355    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:54.920980 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:54.920944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:54.921168 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:54.921101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:55.921573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:55.921531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:55.921983 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:55.921531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:55.921983 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:55.921654    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:55.921983 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:55.921747    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:56.921180 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:56.921138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:56.921456 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:56.921268    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:57.665360 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:57.665307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:57.665806 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:57.665489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:57.665806 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.665491    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:57.665806 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.665574    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:57.665806 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.665625    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs podName:c2596833-1719-44c4-88a9-6dd45d24c408 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.665602402 +0000 UTC m=+34.151030991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs") pod "network-metrics-daemon-gtfmd" (UID: "c2596833-1719-44c4-88a9-6dd45d24c408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:57.665806 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.665648    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret podName:64d572a2-446d-4e67-9e21-8ad84a878f86 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.665637814 +0000 UTC m=+34.151066401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret") pod "global-pull-secret-syncer-x9bsd" (UID: "64d572a2-446d-4e67-9e21-8ad84a878f86") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:57.766890 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:57.766850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:57.767092 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.767067    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:57.767145 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.767101    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:57.767145 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.767116    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9d4mm for pod openshift-network-diagnostics/network-check-target-5sj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:57.767247 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.767174    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm podName:71b33e22-646f-465f-bf83-9fcbd22c0b8a nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.767159257 +0000 UTC m=+34.252587842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d4mm" (UniqueName: "kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm") pod "network-check-target-5sj74" (UID: "71b33e22-646f-465f-bf83-9fcbd22c0b8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:57.921708 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:57.921623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:57.921874 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.921757    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:57.921874 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:57.921806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:57.922000 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:57.921914    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:02:58.921721 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:58.921680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:02:58.922174 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:58.921847    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:02:59.921812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:59.921776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:02:59.922249 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:59.921884    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:02:59.922249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:02:59.921940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:02:59.922249 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:02:59.922040    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:03:00.921297 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:00.920992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:00.921460 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:00.921408    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:03:01.014029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.013908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crjbp" event={"ID":"69d65d9b-7203-4ce5-aa6f-9b5807a96f29","Type":"ContainerStarted","Data":"39a75aefbdfebbf5c99244cf1f3f66c8c9ffe62a68c8cc4fc0477152cd5b6b57"}
Sep 08 00:03:01.015790 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.015761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rqzxd" event={"ID":"3ae90b78-ddb0-4f9b-a843-eadebeaca31b","Type":"ContainerStarted","Data":"d27b1f0c3d229effe659cab69b8f0e2f19d7f43de922d54000c3fd6a237367e7"}
Sep 08 00:03:01.017689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.017660    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b01843-2b47-4d7e-918b-7344af21ff55" containerID="001702c84be9e525b5f39dddff16b52d11b20f9d11a08c937ed739976bb9a9f6" exitCode=0
Sep 08 00:03:01.017831 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.017695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerDied","Data":"001702c84be9e525b5f39dddff16b52d11b20f9d11a08c937ed739976bb9a9f6"}
Sep 08 00:03:01.019711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.019686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwbtz" event={"ID":"88d9dd4e-bfa0-434c-8331-90368393abb6","Type":"ContainerStarted","Data":"2491fdebc4e9b3b1c67b5f3f2b4cb4292d578c8c82808f31e8bebfc786387e6f"}
Sep 08 00:03:01.023277 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.023254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"f7fc3b5da6aed7c1841911018a66db707a999360a848ac6fb9dd823065176fa4"}
Sep 08 00:03:01.023382 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.023315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"7aeb0dc1fce1875e9fc001f90560f3e976761fbe43a8ca049152bb7c98b24616"}
Sep 08 00:03:01.023382 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.023371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"527a06a85e4ffda222963d7330d1affada94569b6478e31316457018e0ba65d2"}
Sep 08 00:03:01.023485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.023412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"612e6b8645405a0950d86c7533a977b88bea325859ac3b23ebd7367e2dbce559"}
Sep 08 00:03:01.023485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.023454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"4c8ed5cdac02492f2ae946dd7514b3973b9deb92ba38987292b791aa256b8898"}
Sep 08 00:03:01.023591 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.023487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"a4ee32915885660771224360a738aaffc291377844724f93fc9b878730870878"}
Sep 08 00:03:01.025069 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.025040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s" event={"ID":"c7ad24fe-4a4c-4833-abd8-2d3fc634260a","Type":"ContainerStarted","Data":"db5e94ce92b45be28429586594929660a76ba3e18da884c06c760ecf893d8695"}
Sep 08 00:03:01.026834 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.026810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-msrxm" event={"ID":"6bb4842c-673e-422e-abdc-d20c6a001ed3","Type":"ContainerStarted","Data":"dae5e1e1393d190d6d7f947c313318c9060c7b199664ddbe096ffc22314d3fa0"}
Sep 08 00:03:01.028416 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.028361    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-crjbp" podStartSLOduration=3.738161633 podStartE2EDuration="21.028330857s" totalImagesPullingTime="17.290169224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:01.027105294 +0000 UTC m=+21.512533903" watchObservedRunningTime="2026-09-08 00:03:01.028330857 +0000 UTC m=+21.513759466"
Sep 08 00:03:01.028691 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.028666    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8x2fh" event={"ID":"0bb65302-9199-4dc2-8753-15e221c27ac8","Type":"ContainerStarted","Data":"54c6e7bfaa68ea7addd510e9750ba3731437451666780f9b1005849bc1e2def7"}
Sep 08 00:03:01.038808 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.038757    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rqzxd" podStartSLOduration=4.803976908 podStartE2EDuration="22.038740655s" totalImagesPullingTime="17.234763747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:01.038661347 +0000 UTC m=+21.524089957" watchObservedRunningTime="2026-09-08 00:03:01.038740655 +0000 UTC m=+21.524169288"
Sep 08 00:03:01.066918 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.066874    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-msrxm" podStartSLOduration=4.840468617 podStartE2EDuration="22.066860275s" totalImagesPullingTime="17.226391658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:01.066374929 +0000 UTC m=+21.551803536" watchObservedRunningTime="2026-09-08 00:03:01.066860275 +0000 UTC m=+21.552288882"
Sep 08 00:03:01.082839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.082580    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dwbtz" podStartSLOduration=11.132508542 podStartE2EDuration="21.082560181s" totalImagesPullingTime="9.950051639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:01.081898816 +0000 UTC m=+21.567327420" watchObservedRunningTime="2026-09-08 00:03:01.082560181 +0000 UTC m=+21.567988789"
Sep 08 00:03:01.096717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.096668    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8x2fh" podStartSLOduration=3.871542695 podStartE2EDuration="21.096653784s" totalImagesPullingTime="17.225111089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:01.096182759 +0000 UTC m=+21.581611367" watchObservedRunningTime="2026-09-08 00:03:01.096653784 +0000 UTC m=+21.582082393"
Sep 08 00:03:01.413204 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.413177    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 00:03:01.614583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.614501    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:03:01.902029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.901925    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T00:03:01.413195046Z","UUID":"1323cf30-8ca1-4fcd-877c-a08f69e74ef0","Handler":null,"Name":"","Endpoint":""}
Sep 08 00:03:01.904194 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.904170    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 00:03:01.904337 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.904206    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 00:03:01.924827 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.924805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:01.924827 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:01.924829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:01.925015 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:01.924913    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:03:01.925015 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:01.925006    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:03:02.033791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:02.033753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s" event={"ID":"c7ad24fe-4a4c-4833-abd8-2d3fc634260a","Type":"ContainerStarted","Data":"00f67f8fc069031e8f1bee9374fbdcc8bffd962fcefc445580d237b9ccaba881"}
Sep 08 00:03:02.035408 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:02.035379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvqwp" event={"ID":"53bbc5dd-9366-437d-a1b6-385411bc74d2","Type":"ContainerStarted","Data":"135ff1ece2b3b9f70c4c2e994afcb4ed34510abf4188a6de890a43dc42684327"}
Sep 08 00:03:02.049746 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:02.049705    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nvqwp" podStartSLOduration=4.831731532 podStartE2EDuration="22.049690965s" totalImagesPullingTime="17.217959433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:02.049295338 +0000 UTC m=+22.534723959" watchObservedRunningTime="2026-09-08 00:03:02.049690965 +0000 UTC m=+22.535119576"
Sep 08 00:03:02.921158 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:02.921130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:02.921319 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:02.921261    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:03:03.041888 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:03.041846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"b7aaad3a9139b40ca8faff7ae4c51eda46a41f320217f612bb64b2b3c6726bc7"}
Sep 08 00:03:03.921135 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:03.921103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:03.921314 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:03.921107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:03.921314 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:03.921223    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:03:03.921314 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:03.921302    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:03:04.047523 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:04.047478    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s" event={"ID":"c7ad24fe-4a4c-4833-abd8-2d3fc634260a","Type":"ContainerStarted","Data":"9566d816b6ad9f72df84b690f2d5e59305b7792cdeae9f815de16d823a84c6ad"}
Sep 08 00:03:04.062786 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:04.062740    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pt2s" podStartSLOduration=3.75297928 podStartE2EDuration="24.062719383s" totalImagesPullingTime="20.309740103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:04.062111351 +0000 UTC m=+24.547539960" watchObservedRunningTime="2026-09-08 00:03:04.062719383 +0000 UTC m=+24.548147995"
Sep 08 00:03:04.920708 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:04.920667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:04.920885 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:04.920819    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:03:05.551728 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:05.551464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:03:05.552058 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:05.551948    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:03:05.924284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:05.924263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:05.924452 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:05.924264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:05.924452 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:05.924374    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:03:05.924536 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:05.924479    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:03:06.053788 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:06.053713    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b01843-2b47-4d7e-918b-7344af21ff55" containerID="6b4e3648cfe46e6f32db10cef1cf8203f1077e422b6ecd537229f380e20a02fc" exitCode=0
Sep 08 00:03:06.053924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:06.053791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerDied","Data":"6b4e3648cfe46e6f32db10cef1cf8203f1077e422b6ecd537229f380e20a02fc"}
Sep 08 00:03:06.057853 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:06.057829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" event={"ID":"22902951-f92a-48f0-8e99-3e8d25e43f7c","Type":"ContainerStarted","Data":"c8d42ac892180bd5d4e3d4e792aac4969e7304e37a4a1f1b0d947ea845062a2a"}
Sep 08 00:03:06.061227 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:06.059059    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dwbtz"
Sep 08 00:03:06.090126 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:06.090068    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8" podStartSLOduration=8.812900462 podStartE2EDuration="26.090052932s" totalImagesPullingTime="17.27715247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:06.089678738 +0000 UTC m=+26.575107356" watchObservedRunningTime="2026-09-08 00:03:06.090052932 +0000 UTC m=+26.575481539"
Sep 08 00:03:06.921307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:06.921116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:06.922025 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:06.921473    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:03:07.060764 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.060736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:03:07.060892 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.060817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:03:07.061282 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.061257    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:03:07.085908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.085873    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:03:07.086278 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.086259    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:03:07.620296 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.620246    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtfmd"]
Sep 08 00:03:07.620537 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.620413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:07.620601 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:07.620532    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:03:07.620903 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.620882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9bsd"]
Sep 08 00:03:07.620998 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.620986    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:07.621098 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:07.621080    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:03:07.624665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.623044    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5sj74"]
Sep 08 00:03:07.624665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:07.623184    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:07.624665 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:07.623307    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:03:08.064587 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:08.064553    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b01843-2b47-4d7e-918b-7344af21ff55" containerID="f877eba7636b132ea13a3af721cbb404bd1123a637a09e72f1c0e6f4006d8682" exitCode=0
Sep 08 00:03:08.065022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:08.064641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerDied","Data":"f877eba7636b132ea13a3af721cbb404bd1123a637a09e72f1c0e6f4006d8682"}
Sep 08 00:03:08.920715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:08.920679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:08.920715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:08.920702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:08.920900 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:08.920710    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:08.920900 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:08.920800    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:03:08.920900 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:08.920851    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:03:08.921025 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:08.920916    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:03:09.068893 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:09.068862    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b01843-2b47-4d7e-918b-7344af21ff55" containerID="ef0826209edb41fc320ed754149925b8e9e6fd96fb321c0125abd53e6bb0f3e1" exitCode=0
Sep 08 00:03:09.069256 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:09.068940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerDied","Data":"ef0826209edb41fc320ed754149925b8e9e6fd96fb321c0125abd53e6bb0f3e1"}
Sep 08 00:03:10.921130 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:10.920929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:10.921596 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:10.920929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:10.921596 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:10.921222    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9bsd" podUID="64d572a2-446d-4e67-9e21-8ad84a878f86"
Sep 08 00:03:10.921596 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:10.920927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:10.921596 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:10.921265    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sj74" podUID="71b33e22-646f-465f-bf83-9fcbd22c0b8a"
Sep 08 00:03:10.921596 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:10.921433    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtfmd" podUID="c2596833-1719-44c4-88a9-6dd45d24c408"
Sep 08 00:03:12.823859 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.823823    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-92.ec2.internal" event="NodeReady"
Sep 08 00:03:12.824321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.823979    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 00:03:12.868053 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.867781    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4xh6w"]
Sep 08 00:03:12.889036 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.889005    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d8b8d78d5-rpht6"]
Sep 08 00:03:12.889208 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.889157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:12.891450 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.891331    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 00:03:12.891450 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.891369    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xbmqx\""
Sep 08 00:03:12.891710 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.891331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 00:03:12.904904 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.904872    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pmqlw"]
Sep 08 00:03:12.905036 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.905009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.907066 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.907034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 00:03:12.907185 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.907068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 00:03:12.907333 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.907316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hwm5h\""
Sep 08 00:03:12.907443 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.907316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 00:03:12.911608 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.911586    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 00:03:12.921456 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.921435    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmqlw"]
Sep 08 00:03:12.921577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.921532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:12.921636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.921625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:12.921825 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.921691    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4xh6w"]
Sep 08 00:03:12.921825 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.921729    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8b8d78d5-rpht6"]
Sep 08 00:03:12.921978 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.921841    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:12.922036 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.921983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:12.923722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.923700    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.923838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.923746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.923838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.923769    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9vvpw\""
Sep 08 00:03:12.923838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.923794    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.924002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.923700    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.924002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.923915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 00:03:12.924106 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.924017    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 00:03:12.924247 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.924228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7g2f\""
Sep 08 00:03:12.924378 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.924274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 00:03:12.924562 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.924544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sgbhs\""
Sep 08 00:03:12.975011 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.974980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-trusted-ca\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975165 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975165 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:12.975165 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg4zk\" (UniqueName: \"kubernetes.io/projected/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-kube-api-access-zg4zk\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:12.975165 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-registry-certificates\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-installation-pull-secrets\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhq8\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-kube-api-access-5bhq8\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918f6954-da10-4830-b068-b5a8f7b9f968-ca-trust-extracted\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-image-registry-private-configuration\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-bound-sa-token\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:12.975602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-config-volume\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:12.975602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:12.975423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-tmp-dir\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.076328 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-installation-pull-secrets\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076328 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhq8\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-kube-api-access-5bhq8\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918f6954-da10-4830-b068-b5a8f7b9f968-ca-trust-extracted\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-image-registry-private-configuration\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-bound-sa-token\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-config-volume\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.076586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-tmp-dir\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.076586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6-cert\") pod \"ingress-canary-pmqlw\" (UID: \"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6\") " pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:13.076586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-trusted-ca\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8k65\" (UniqueName: \"kubernetes.io/projected/2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6-kube-api-access-g8k65\") pod \"ingress-canary-pmqlw\" (UID: \"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6\") " pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:13.076942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.076942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg4zk\" (UniqueName: \"kubernetes.io/projected/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-kube-api-access-zg4zk\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.076942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-registry-certificates\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.076942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.076832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918f6954-da10-4830-b068-b5a8f7b9f968-ca-trust-extracted\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.077240 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.077002    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:13.077240 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.077018    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8b8d78d5-rpht6: secret "image-registry-tls" not found
Sep 08 00:03:13.077240 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.077092    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls podName:918f6954-da10-4830-b068-b5a8f7b9f968 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.577069382 +0000 UTC m=+34.062497988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls") pod "image-registry-7d8b8d78d5-rpht6" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968") : secret "image-registry-tls" not found
Sep 08 00:03:13.077428 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.077416    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:13.077428 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.077420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-registry-certificates\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.077536 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.077441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-tmp-dir\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.077536 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.077463    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls podName:8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.57744855 +0000 UTC m=+34.062877153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls") pod "dns-default-4xh6w" (UID: "8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:13.077715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.077676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-trusted-ca\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.077965 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.077943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-config-volume\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.081402 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.081382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-installation-pull-secrets\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.081499 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.081422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-image-registry-private-configuration\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.085797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.085776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg4zk\" (UniqueName: \"kubernetes.io/projected/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-kube-api-access-zg4zk\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.085898 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.085797    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhq8\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-kube-api-access-5bhq8\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.085898 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.085837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-bound-sa-token\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.178137 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.178099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8k65\" (UniqueName: \"kubernetes.io/projected/2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6-kube-api-access-g8k65\") pod \"ingress-canary-pmqlw\" (UID: \"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6\") " pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:13.178292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.178228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6-cert\") pod \"ingress-canary-pmqlw\" (UID: \"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6\") " pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:13.180538 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.180521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6-cert\") pod \"ingress-canary-pmqlw\" (UID: \"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6\") " pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:13.184588 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.184567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8k65\" (UniqueName: \"kubernetes.io/projected/2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6-kube-api-access-g8k65\") pod \"ingress-canary-pmqlw\" (UID: \"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6\") " pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:13.233678 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.233647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmqlw"
Sep 08 00:03:13.582369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.582273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:13.582369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.582321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:13.582618 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.582436    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:13.582618 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.582460    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8b8d78d5-rpht6: secret "image-registry-tls" not found
Sep 08 00:03:13.582618 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.582505    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:13.582618 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.582536    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls podName:918f6954-da10-4830-b068-b5a8f7b9f968 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.582520645 +0000 UTC m=+35.067949250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls") pod "image-registry-7d8b8d78d5-rpht6" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968") : secret "image-registry-tls" not found
Sep 08 00:03:13.582618 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.582558    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls podName:8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.582544396 +0000 UTC m=+35.067972982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls") pod "dns-default-4xh6w" (UID: "8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:13.683095 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.683059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:13.683265 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.683127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:13.683265 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.683211    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 00:03:13.683520 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:13.683279    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs podName:c2596833-1719-44c4-88a9-6dd45d24c408 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:45.683263488 +0000 UTC m=+66.168692074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs") pod "network-metrics-daemon-gtfmd" (UID: "c2596833-1719-44c4-88a9-6dd45d24c408") : secret "metrics-daemon-secret" not found
Sep 08 00:03:13.685779 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.685754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64d572a2-446d-4e67-9e21-8ad84a878f86-original-pull-secret\") pod \"global-pull-secret-syncer-x9bsd\" (UID: \"64d572a2-446d-4e67-9e21-8ad84a878f86\") " pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:13.783476 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.783437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:13.786091 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.786068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d4mm\" (UniqueName: \"kubernetes.io/projected/71b33e22-646f-465f-bf83-9fcbd22c0b8a-kube-api-access-9d4mm\") pod \"network-check-target-5sj74\" (UID: \"71b33e22-646f-465f-bf83-9fcbd22c0b8a\") " pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:13.840452 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.840372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:13.854596 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:13.854567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9bsd"
Sep 08 00:03:14.590666 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:14.590615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:14.590864 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:14.590680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:14.590864 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:14.590782    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:14.590864 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:14.590802    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8b8d78d5-rpht6: secret "image-registry-tls" not found
Sep 08 00:03:14.590864 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:14.590807    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:14.591078 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:14.590872    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls podName:918f6954-da10-4830-b068-b5a8f7b9f968 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.590855289 +0000 UTC m=+37.076283874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls") pod "image-registry-7d8b8d78d5-rpht6" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968") : secret "image-registry-tls" not found
Sep 08 00:03:14.591078 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:14.590886    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls podName:8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.590880058 +0000 UTC m=+37.076308643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls") pod "dns-default-4xh6w" (UID: "8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:15.061399 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:15.061246    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5sj74"]
Sep 08 00:03:15.065810 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:15.065339    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9bsd"]
Sep 08 00:03:15.066282 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:15.066257    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmqlw"]
Sep 08 00:03:15.067397 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:15.067368    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b33e22_646f_465f_bf83_9fcbd22c0b8a.slice/crio-6fa5dfcadad6ae760068af2f2b7da9e525766cdd4c89c558e09a48c8fb06988c WatchSource:0}: Error finding container 6fa5dfcadad6ae760068af2f2b7da9e525766cdd4c89c558e09a48c8fb06988c: Status 404 returned error can't find the container with id 6fa5dfcadad6ae760068af2f2b7da9e525766cdd4c89c558e09a48c8fb06988c
Sep 08 00:03:15.070215 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:15.070193    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d572a2_446d_4e67_9e21_8ad84a878f86.slice/crio-90a764d2e915567ca90f1975d9c4f4a164b96b043e08a696193376493ca9b04f WatchSource:0}: Error finding container 90a764d2e915567ca90f1975d9c4f4a164b96b043e08a696193376493ca9b04f: Status 404 returned error can't find the container with id 90a764d2e915567ca90f1975d9c4f4a164b96b043e08a696193376493ca9b04f
Sep 08 00:03:15.071321 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:15.071298    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3d3e1e_5b4d_4160_acf6_a962e17c4fa6.slice/crio-6b9265fca284a83fa197c194a8c132f9e496fd06f9a51806c52505ceeb92bc94 WatchSource:0}: Error finding container 6b9265fca284a83fa197c194a8c132f9e496fd06f9a51806c52505ceeb92bc94: Status 404 returned error can't find the container with id 6b9265fca284a83fa197c194a8c132f9e496fd06f9a51806c52505ceeb92bc94
Sep 08 00:03:15.084145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:15.084109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9bsd" event={"ID":"64d572a2-446d-4e67-9e21-8ad84a878f86","Type":"ContainerStarted","Data":"90a764d2e915567ca90f1975d9c4f4a164b96b043e08a696193376493ca9b04f"}
Sep 08 00:03:15.085308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:15.085283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5sj74" event={"ID":"71b33e22-646f-465f-bf83-9fcbd22c0b8a","Type":"ContainerStarted","Data":"6fa5dfcadad6ae760068af2f2b7da9e525766cdd4c89c558e09a48c8fb06988c"}
Sep 08 00:03:15.086511 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:15.086470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmqlw" event={"ID":"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6","Type":"ContainerStarted","Data":"6b9265fca284a83fa197c194a8c132f9e496fd06f9a51806c52505ceeb92bc94"}
Sep 08 00:03:16.093690 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:16.093649    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b01843-2b47-4d7e-918b-7344af21ff55" containerID="96598b638596bc5b96fcf7d2eedd4f5a36d18dee89ff17ca8cd5d4bc2cc14116" exitCode=0
Sep 08 00:03:16.094132 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:16.093726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerDied","Data":"96598b638596bc5b96fcf7d2eedd4f5a36d18dee89ff17ca8cd5d4bc2cc14116"}
Sep 08 00:03:16.209890 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:16.209854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:16.286755 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:16.286709    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:16.607951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:16.607598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:16.607951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:16.607656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:16.607951 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:16.607803    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:16.607951 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:16.607827    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8b8d78d5-rpht6: secret "image-registry-tls" not found
Sep 08 00:03:16.607951 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:16.607868    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:16.607951 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:16.607899    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls podName:918f6954-da10-4830-b068-b5a8f7b9f968 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.607876714 +0000 UTC m=+41.093305320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls") pod "image-registry-7d8b8d78d5-rpht6" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968") : secret "image-registry-tls" not found
Sep 08 00:03:16.607951 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:16.607922    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls podName:8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.60790612 +0000 UTC m=+41.093334707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls") pod "dns-default-4xh6w" (UID: "8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:17.101499 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:17.101468    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b01843-2b47-4d7e-918b-7344af21ff55" containerID="2239af556e09a12b6c863e595c1d65e847c29dd523ed474d7431a20480db74e1" exitCode=0
Sep 08 00:03:17.101884 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:17.101508    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerDied","Data":"2239af556e09a12b6c863e595c1d65e847c29dd523ed474d7431a20480db74e1"}
Sep 08 00:03:18.005675 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:18.005634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:18.105306 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:18.105274    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:18.372159 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:18.372127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:18.419716 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:18.419680    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:20.639616 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:20.639574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:20.639616 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:20.639620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:20.640023 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:20.639731    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:20.640023 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:20.639740    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:20.640023 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:20.639761    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8b8d78d5-rpht6: secret "image-registry-tls" not found
Sep 08 00:03:20.640023 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:20.639787    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls podName:8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.639773413 +0000 UTC m=+49.125202000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls") pod "dns-default-4xh6w" (UID: "8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:20.640023 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:20.639811    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls podName:918f6954-da10-4830-b068-b5a8f7b9f968 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.639795985 +0000 UTC m=+49.125224576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls") pod "image-registry-7d8b8d78d5-rpht6" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968") : secret "image-registry-tls" not found
Sep 08 00:03:21.116127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:21.116096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bjml" event={"ID":"c0b01843-2b47-4d7e-918b-7344af21ff55","Type":"ContainerStarted","Data":"1ec00c888472bccab85b2a37cc8099a8fbadafb4cb6d37a44abc4fb3547613bc"}
Sep 08 00:03:21.117780 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:21.117754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5sj74" event={"ID":"71b33e22-646f-465f-bf83-9fcbd22c0b8a","Type":"ContainerStarted","Data":"8daa6cbf9cf3cded11d141e661d47de1892b91d4ba56d1de1f392d97518c754a"}
Sep 08 00:03:21.117871 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:21.117807    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:21.135284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:21.135218    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5bjml" podStartSLOduration=11.631350217 podStartE2EDuration="41.135195358s" totalImagesPullingTime="29.503845141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:21.134137346 +0000 UTC m=+41.619565979" watchObservedRunningTime="2026-09-08 00:03:21.135195358 +0000 UTC m=+41.620624033"
Sep 08 00:03:21.146291 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:21.146210    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5sj74" podStartSLOduration=35.244640274 podStartE2EDuration="41.146195921s" totalImagesPullingTime="5.901555647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:21.146125226 +0000 UTC m=+41.631553836" watchObservedRunningTime="2026-09-08 00:03:21.146195921 +0000 UTC m=+41.631624526"
Sep 08 00:03:21.257156 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:21.257062    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:21.311113 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:21.311068    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:22.126258 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.126217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9bsd" event={"ID":"64d572a2-446d-4e67-9e21-8ad84a878f86","Type":"ContainerStarted","Data":"5891485a516e38a925469878ca5ac7685a4bf007b4fded04b4e0bbdb7330c66e"}
Sep 08 00:03:22.127797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.127771    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmqlw" event={"ID":"2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6","Type":"ContainerStarted","Data":"3114a14439b10ca7e7d7ae7fdd3fc0701d09fbe092c8efacb47002e1427f1f09"}
Sep 08 00:03:22.159013 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.158955    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pmqlw" podStartSLOduration=4.260843924 podStartE2EDuration="10.158924714s" totalImagesPullingTime="5.89808079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:22.158695393 +0000 UTC m=+42.644124003" watchObservedRunningTime="2026-09-08 00:03:22.158924714 +0000 UTC m=+42.644353326"
Sep 08 00:03:22.159405 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.159370    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x9bsd" podStartSLOduration=36.250374467 podStartE2EDuration="42.159360441s" totalImagesPullingTime="5.908985974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:22.146419382 +0000 UTC m=+42.631848013" watchObservedRunningTime="2026-09-08 00:03:22.159360441 +0000 UTC m=+42.644789051"
Sep 08 00:03:22.714993 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.714952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:22.767618 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.767584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:22.895087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.895054    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:22.899321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.899292    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v65pk"]
Sep 08 00:03:22.921100 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.921072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v65pk"]
Sep 08 00:03:22.921249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.921185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:22.923097 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.923073    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 00:03:22.923223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.923126    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 00:03:22.923223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.923168    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 00:03:22.923223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.923134    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8cwdj\""
Sep 08 00:03:22.923457 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.923441    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 00:03:22.953766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:22.953737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:23.056551 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.056458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/461bc645-9bf5-4a57-a82d-6dc560611057-crio-socket\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.056551 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.056500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pmb\" (UniqueName: \"kubernetes.io/projected/461bc645-9bf5-4a57-a82d-6dc560611057-kube-api-access-k5pmb\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.056551 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.056535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.056760 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.056567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/461bc645-9bf5-4a57-a82d-6dc560611057-data-volume\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.056760 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.056623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.157426 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.157394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.157524    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.157601    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:23.657580674 +0000 UTC m=+44.143009264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.157619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/461bc645-9bf5-4a57-a82d-6dc560611057-crio-socket\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.157640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pmb\" (UniqueName: \"kubernetes.io/projected/461bc645-9bf5-4a57-a82d-6dc560611057-kube-api-access-k5pmb\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.157661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.157706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/461bc645-9bf5-4a57-a82d-6dc560611057-data-volume\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.157738    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.157773    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:23.657760997 +0000 UTC m=+44.143189582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:23.157841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.157822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/461bc645-9bf5-4a57-a82d-6dc560611057-crio-socket\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.158160 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.157986    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/461bc645-9bf5-4a57-a82d-6dc560611057-data-volume\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.168749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.168729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pmb\" (UniqueName: \"kubernetes.io/projected/461bc645-9bf5-4a57-a82d-6dc560611057-kube-api-access-k5pmb\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.169858 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.169838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:23.268975 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.268948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:23.427922 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.427899    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:23.527307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.527283    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:23.628902 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.628867    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:23.661727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.661704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.661809 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:23.661773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:23.661855 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.661825    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:23.661896 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.661857    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:23.661896 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.661887    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:24.661873008 +0000 UTC m=+45.147301593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:23.661978 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:23.661902    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:24.66189568 +0000 UTC m=+45.147324265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:24.460710 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:24.460676    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-msrxm_6bb4842c-673e-422e-abdc-d20c6a001ed3/dns-node-resolver/0.log"
Sep 08 00:03:24.517326 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:24.517296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:24.570501 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:24.570465    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:24.668627 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:24.668587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:24.668811 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:24.668643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:24.668811 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:24.668733    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:24.668811 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:24.668734    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:24.668811 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:24.668796    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:26.668777585 +0000 UTC m=+47.154206195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:24.669019 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:24.668843    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:26.668827654 +0000 UTC m=+47.154256239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:25.028753 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.028719    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-j7s8k"]
Sep 08 00:03:25.057839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.057801    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:25.062458 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.062437    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-j7s8k"]
Sep 08 00:03:25.062548 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.062537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.064450 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.064429    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 00:03:25.064927 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.064909    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 00:03:25.065018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.064981    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 00:03:25.065018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.064990    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6cphh\""
Sep 08 00:03:25.065018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.065007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 00:03:25.156999 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.156964    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:25.173085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.173063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb682460-6bc7-4ee1-82f2-9474b8d706d4-signing-key\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.173188 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.173092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb682460-6bc7-4ee1-82f2-9474b8d706d4-signing-cabundle\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.173188 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.173110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7pdx\" (UniqueName: \"kubernetes.io/projected/bb682460-6bc7-4ee1-82f2-9474b8d706d4-kube-api-access-f7pdx\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.273850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.273819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb682460-6bc7-4ee1-82f2-9474b8d706d4-signing-key\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.273850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.273850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb682460-6bc7-4ee1-82f2-9474b8d706d4-signing-cabundle\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.274050 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.273870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7pdx\" (UniqueName: \"kubernetes.io/projected/bb682460-6bc7-4ee1-82f2-9474b8d706d4-kube-api-access-f7pdx\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.274610 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.274586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb682460-6bc7-4ee1-82f2-9474b8d706d4-signing-cabundle\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.276319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.276301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb682460-6bc7-4ee1-82f2-9474b8d706d4-signing-key\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.280572 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.280528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7pdx\" (UniqueName: \"kubernetes.io/projected/bb682460-6bc7-4ee1-82f2-9474b8d706d4-kube-api-access-f7pdx\") pod \"service-ca-75d99c484-j7s8k\" (UID: \"bb682460-6bc7-4ee1-82f2-9474b8d706d4\") " pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.371703 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.371678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-j7s8k"
Sep 08 00:03:25.652426 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.652393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-j7s8k"]
Sep 08 00:03:25.656400 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:25.656372    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb682460_6bc7_4ee1_82f2_9474b8d706d4.slice/crio-b961e5c5285695f88aa4683f09a040719f5c49bd994865234e4f54f36a309d31 WatchSource:0}: Error finding container b961e5c5285695f88aa4683f09a040719f5c49bd994865234e4f54f36a309d31: Status 404 returned error can't find the container with id b961e5c5285695f88aa4683f09a040719f5c49bd994865234e4f54f36a309d31
Sep 08 00:03:25.859850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:25.859822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rqzxd_3ae90b78-ddb0-4f9b-a843-eadebeaca31b/node-ca/0.log"
Sep 08 00:03:26.138040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:26.137959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-j7s8k" event={"ID":"bb682460-6bc7-4ee1-82f2-9474b8d706d4","Type":"ContainerStarted","Data":"b961e5c5285695f88aa4683f09a040719f5c49bd994865234e4f54f36a309d31"}
Sep 08 00:03:26.460701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:26.460668    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmqlw_2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6/serve-healthcheck-canary/0.log"
Sep 08 00:03:26.582743 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:26.582709    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:26.685078 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:26.685042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:26.685541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:26.685089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:26.685541 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:26.685189    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:26.685541 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:26.685195    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:26.685541 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:26.685255    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:30.685239908 +0000 UTC m=+51.170668514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:26.685541 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:26.685272    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:30.685266144 +0000 UTC m=+51.170694730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:27.818694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:27.818665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:28.145995 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:28.145956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-j7s8k" event={"ID":"bb682460-6bc7-4ee1-82f2-9474b8d706d4","Type":"ContainerStarted","Data":"cd49c1c7c587fc35ca18d443f779c8d5753bec4059f411d9695af4ff00127e14"}
Sep 08 00:03:28.159027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:28.158969    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-j7s8k" podStartSLOduration=0.802481252 podStartE2EDuration="3.158949757s" totalImagesPullingTime="2.356468505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:28.157948735 +0000 UTC m=+48.643377344" watchObservedRunningTime="2026-09-08 00:03:28.158949757 +0000 UTC m=+48.644378366"
Sep 08 00:03:28.570503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:28.570451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:28.701781 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:28.701738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:28.702005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:28.701796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:28.702005 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:28.701922    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:28.702005 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:28.701949    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8b8d78d5-rpht6: secret "image-registry-tls" not found
Sep 08 00:03:28.702005 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:28.701989    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:28.702218 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:28.702024    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls podName:918f6954-da10-4830-b068-b5a8f7b9f968 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.702001071 +0000 UTC m=+65.187429694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls") pod "image-registry-7d8b8d78d5-rpht6" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968") : secret "image-registry-tls" not found
Sep 08 00:03:28.702218 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:28.702059    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls podName:8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.702040742 +0000 UTC m=+65.187469354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls") pod "dns-default-4xh6w" (UID: "8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:29.206149 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:29.206111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:29.307620 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:29.307570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:29.408980 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:29.408943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:29.570958 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:29.570871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:29.672662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:29.672627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:29.774372 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:29.774325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:30.158598 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:30.158565    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:30.718413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:30.718380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:30.718807 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:30.718439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:30.718807 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:30.718526    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:30.718807 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:30.718616    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls podName:461bc645-9bf5-4a57-a82d-6dc560611057 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:38.718596224 +0000 UTC m=+59.204024814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v65pk" (UID: "461bc645-9bf5-4a57-a82d-6dc560611057") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:30.719055 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:30.719033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/461bc645-9bf5-4a57-a82d-6dc560611057-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:30.764641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:30.764589    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:31.190314 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:31.190281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:31.559078 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:31.558999    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:31.964398 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:31.964335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:32.363480 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:32.363388    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:32.516753 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:32.516718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:32.760598 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:32.760563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:32.957721 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:32.957686    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:33.057558 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:33.057481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:33.253642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:33.253609    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:33.561580 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:33.561547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:33.756900 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:33.756861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:33.857305 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:33.857227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:33.958268 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:33.958241    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:34.757871 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:34.757826    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:35.157543 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:35.157509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:35.258615 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:35.258584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:35.359524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:35.359494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:35.459671 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:35.459605    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:35.559949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:35.559915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:35.963198 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:35.963169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:36.556085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:36.556050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:36.756828 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:36.756792    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:36.954876 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:36.954845    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:37.356707 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:37.356634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:38.155960 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.155927    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:38.360184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.360150    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:38.460458 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.460384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:38.509150 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.509115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:38.562640 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.562600    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:38.783004 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.782917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:38.785214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.785190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/461bc645-9bf5-4a57-a82d-6dc560611057-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v65pk\" (UID: \"461bc645-9bf5-4a57-a82d-6dc560611057\") " pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:38.830468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.830410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v65pk"
Sep 08 00:03:38.959298 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:38.959263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:39.079728 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:39.079663    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spxh8"
Sep 08 00:03:39.097191 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:39.097160    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v65pk"]
Sep 08 00:03:39.100536 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:39.100508    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461bc645_9bf5_4a57_a82d_6dc560611057.slice/crio-d23eb81c8f1b6f6cdb7cb023954c16acfe362bd3441c73e351d8c9c28b555fff WatchSource:0}: Error finding container d23eb81c8f1b6f6cdb7cb023954c16acfe362bd3441c73e351d8c9c28b555fff: Status 404 returned error can't find the container with id d23eb81c8f1b6f6cdb7cb023954c16acfe362bd3441c73e351d8c9c28b555fff
Sep 08 00:03:39.179647 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:39.179610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v65pk" event={"ID":"461bc645-9bf5-4a57-a82d-6dc560611057","Type":"ContainerStarted","Data":"e00acdd82b38b67898f341d9d06cc512f3efab95ad94e94327fe027347e5d5cf"}
Sep 08 00:03:39.179800 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:39.179683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v65pk" event={"ID":"461bc645-9bf5-4a57-a82d-6dc560611057","Type":"ContainerStarted","Data":"d23eb81c8f1b6f6cdb7cb023954c16acfe362bd3441c73e351d8c9c28b555fff"}
Sep 08 00:03:39.559069 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:39.559035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:40.017679 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:40.017644    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:40.066522 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:40.066491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:40.184313 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:40.184285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v65pk" event={"ID":"461bc645-9bf5-4a57-a82d-6dc560611057","Type":"ContainerStarted","Data":"826d3048aee02da7d16741fe3d8273361f4c0c6a66acab656d29ae905ac955a5"}
Sep 08 00:03:42.192062 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:42.192021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v65pk" event={"ID":"461bc645-9bf5-4a57-a82d-6dc560611057","Type":"ContainerStarted","Data":"bb85c4ce2f4a2bb44e29fee332c7f618aeb9ec66916e93c9936456681dfbed82"}
Sep 08 00:03:42.209632 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:42.209583    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v65pk" podStartSLOduration=17.677278281 podStartE2EDuration="20.209563828s" totalImagesPullingTime="2.532285547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:03:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:42.208437667 +0000 UTC m=+62.693866276" watchObservedRunningTime="2026-09-08 00:03:42.209563828 +0000 UTC m=+62.694992436"
Sep 08 00:03:44.724861 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:44.724815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:44.724861 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:44.724868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:44.727290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:44.727259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2-metrics-tls\") pod \"dns-default-4xh6w\" (UID: \"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2\") " pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:44.727413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:44.727384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"image-registry-7d8b8d78d5-rpht6\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") " pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:45.001636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.001550    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xbmqx\""
Sep 08 00:03:45.010021 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.009999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:45.017381 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.017340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hwm5h\""
Sep 08 00:03:45.026730 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.026709    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:45.285077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.284967    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4xh6w"]
Sep 08 00:03:45.288393 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:45.288338    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2e7745_c0d5_48f2_b5ab_d3c8794d63e2.slice/crio-e9f7f772aa13b2a93fe56bcf66c3021e3d62e26bfab70fe06e92cc76c861c9fa WatchSource:0}: Error finding container e9f7f772aa13b2a93fe56bcf66c3021e3d62e26bfab70fe06e92cc76c861c9fa: Status 404 returned error can't find the container with id e9f7f772aa13b2a93fe56bcf66c3021e3d62e26bfab70fe06e92cc76c861c9fa
Sep 08 00:03:45.308749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.308728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8b8d78d5-rpht6"]
Sep 08 00:03:45.311921 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:45.311896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918f6954_da10_4830_b068_b5a8f7b9f968.slice/crio-cd6fb7b2250d661435bff8c48a0a97518f0560f85d46f2a09f44d4942e347af4 WatchSource:0}: Error finding container cd6fb7b2250d661435bff8c48a0a97518f0560f85d46f2a09f44d4942e347af4: Status 404 returned error can't find the container with id cd6fb7b2250d661435bff8c48a0a97518f0560f85d46f2a09f44d4942e347af4
Sep 08 00:03:45.731751 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.731715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:45.734114 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.734084    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2596833-1719-44c4-88a9-6dd45d24c408-metrics-certs\") pod \"network-metrics-daemon-gtfmd\" (UID: \"c2596833-1719-44c4-88a9-6dd45d24c408\") " pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:45.949090 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.949060    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7g2f\""
Sep 08 00:03:45.958400 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:45.958372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtfmd"
Sep 08 00:03:46.206810 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:46.206773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4xh6w" event={"ID":"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2","Type":"ContainerStarted","Data":"e9f7f772aa13b2a93fe56bcf66c3021e3d62e26bfab70fe06e92cc76c861c9fa"}
Sep 08 00:03:46.208859 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:46.208826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6" event={"ID":"918f6954-da10-4830-b068-b5a8f7b9f968","Type":"ContainerStarted","Data":"7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41"}
Sep 08 00:03:46.208976 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:46.208880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6" event={"ID":"918f6954-da10-4830-b068-b5a8f7b9f968","Type":"ContainerStarted","Data":"cd6fb7b2250d661435bff8c48a0a97518f0560f85d46f2a09f44d4942e347af4"}
Sep 08 00:03:46.209028 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:46.208978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:03:46.227157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:46.226964    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6" podStartSLOduration=52.226946032 podStartE2EDuration="52.226946032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:46.226694764 +0000 UTC m=+66.712123392" watchObservedRunningTime="2026-09-08 00:03:46.226946032 +0000 UTC m=+66.712374631"
Sep 08 00:03:46.236938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:46.236911    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtfmd"]
Sep 08 00:03:46.241773 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:46.241747    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2596833_1719_44c4_88a9_6dd45d24c408.slice/crio-d4beb5f075414cbdcddfec5b4a231a8c580e80948ae05a76bbe4fbfbbb5ac381 WatchSource:0}: Error finding container d4beb5f075414cbdcddfec5b4a231a8c580e80948ae05a76bbe4fbfbbb5ac381: Status 404 returned error can't find the container with id d4beb5f075414cbdcddfec5b4a231a8c580e80948ae05a76bbe4fbfbbb5ac381
Sep 08 00:03:47.213140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.213084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtfmd" event={"ID":"c2596833-1719-44c4-88a9-6dd45d24c408","Type":"ContainerStarted","Data":"d4beb5f075414cbdcddfec5b4a231a8c580e80948ae05a76bbe4fbfbbb5ac381"}
Sep 08 00:03:47.215319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.215282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4xh6w" event={"ID":"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2","Type":"ContainerStarted","Data":"3c15d1a541c17378325688eae7294e76063a3bbfee2313f28db290e0c2ba75f0"}
Sep 08 00:03:47.598425 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.598390    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8b8d78d5-rpht6"]
Sep 08 00:03:47.611102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.610812    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"]
Sep 08 00:03:47.626579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.626543    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"]
Sep 08 00:03:47.626740 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.626679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.628741 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.628715    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 00:03:47.628971 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.628951    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 00:03:47.629468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.629446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 00:03:47.629574 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.629450    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 00:03:47.646667 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.646643    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"]
Sep 08 00:03:47.646755 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.646693    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"]
Sep 08 00:03:47.646800 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.646764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.651915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.651677    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nxvk8\""
Sep 08 00:03:47.651915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.651828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 00:03:47.714833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.714783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:47.746512 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.746475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtqh\" (UniqueName: \"kubernetes.io/projected/a14a3124-ebda-4f8c-b7d8-e4b008a56961-kube-api-access-vmtqh\") pod \"managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6\" (UID: \"a14a3124-ebda-4f8c-b7d8-e4b008a56961\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.746689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.746517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr52z\" (UniqueName: \"kubernetes.io/projected/cc5fab1c-4104-495b-8da6-cdadcb18a930-kube-api-access-gr52z\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.746689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.746608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a14a3124-ebda-4f8c-b7d8-e4b008a56961-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6\" (UID: \"a14a3124-ebda-4f8c-b7d8-e4b008a56961\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.746689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.746643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc5fab1c-4104-495b-8da6-cdadcb18a930-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.746689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.746665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc5fab1c-4104-495b-8da6-cdadcb18a930-tmp\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.847365 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.847320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a14a3124-ebda-4f8c-b7d8-e4b008a56961-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6\" (UID: \"a14a3124-ebda-4f8c-b7d8-e4b008a56961\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.847516 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.847465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc5fab1c-4104-495b-8da6-cdadcb18a930-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.847557 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.847520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc5fab1c-4104-495b-8da6-cdadcb18a930-tmp\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.847600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.847585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtqh\" (UniqueName: \"kubernetes.io/projected/a14a3124-ebda-4f8c-b7d8-e4b008a56961-kube-api-access-vmtqh\") pod \"managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6\" (UID: \"a14a3124-ebda-4f8c-b7d8-e4b008a56961\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.847664 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.847643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr52z\" (UniqueName: \"kubernetes.io/projected/cc5fab1c-4104-495b-8da6-cdadcb18a930-kube-api-access-gr52z\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.848005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.847984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc5fab1c-4104-495b-8da6-cdadcb18a930-tmp\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.850101 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.850049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a14a3124-ebda-4f8c-b7d8-e4b008a56961-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6\" (UID: \"a14a3124-ebda-4f8c-b7d8-e4b008a56961\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.850192 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.850176    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc5fab1c-4104-495b-8da6-cdadcb18a930-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.857319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.857293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtqh\" (UniqueName: \"kubernetes.io/projected/a14a3124-ebda-4f8c-b7d8-e4b008a56961-kube-api-access-vmtqh\") pod \"managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6\" (UID: \"a14a3124-ebda-4f8c-b7d8-e4b008a56961\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.857530 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.857510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr52z\" (UniqueName: \"kubernetes.io/projected/cc5fab1c-4104-495b-8da6-cdadcb18a930-kube-api-access-gr52z\") pod \"klusterlet-addon-workmgr-59f9fb96f9-7vs2c\" (UID: \"cc5fab1c-4104-495b-8da6-cdadcb18a930\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.874940 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.874913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:47.937709 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.937686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:47.968312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.968290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"
Sep 08 00:03:47.977058 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:47.977022    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:48.073039 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.072992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:48.214798 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.214768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"]
Sep 08 00:03:48.219948 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.219920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4xh6w" event={"ID":"8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2","Type":"ContainerStarted","Data":"2604e9ea564c28ae7d581568ab7e43f4fcf4860f2cd6432ab07c8386cd914054"}
Sep 08 00:03:48.220165 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.220148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:48.251149 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.251098    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4xh6w" podStartSLOduration=34.442715296 podStartE2EDuration="36.251078186s" totalImagesPullingTime="1.80836289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:48.25057997 +0000 UTC m=+68.736008580" watchObservedRunningTime="2026-09-08 00:03:48.251078186 +0000 UTC m=+68.736506795"
Sep 08 00:03:48.261730 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.261705    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6"]
Sep 08 00:03:48.268210 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:48.268182    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5fab1c_4104_495b_8da6_cdadcb18a930.slice/crio-bb7422ebef95b732b25317f32c84a09ae78d6b34505ab37b65083a076f0a9371 WatchSource:0}: Error finding container bb7422ebef95b732b25317f32c84a09ae78d6b34505ab37b65083a076f0a9371: Status 404 returned error can't find the container with id bb7422ebef95b732b25317f32c84a09ae78d6b34505ab37b65083a076f0a9371
Sep 08 00:03:48.269177 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:48.269152    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda14a3124_ebda_4f8c_b7d8_e4b008a56961.slice/crio-918299fb9102555a3b0877060f8fc46f6d3ca011b821c38616fcbd3a4d6361f3 WatchSource:0}: Error finding container 918299fb9102555a3b0877060f8fc46f6d3ca011b821c38616fcbd3a4d6361f3: Status 404 returned error can't find the container with id 918299fb9102555a3b0877060f8fc46f6d3ca011b821c38616fcbd3a4d6361f3
Sep 08 00:03:48.676657 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.676623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:48.727117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:48.727026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:49.022555 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:49.022445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:49.209027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:49.208990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:49.225446 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:49.225411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtfmd" event={"ID":"c2596833-1719-44c4-88a9-6dd45d24c408","Type":"ContainerStarted","Data":"f2d6d56e95e18dd2021181656722ae6c8cd7fd4c0c7f0899398c72dd43b87085"}
Sep 08 00:03:49.225850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:49.225486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtfmd" event={"ID":"c2596833-1719-44c4-88a9-6dd45d24c408","Type":"ContainerStarted","Data":"a9ac33697cff0eca3171570f45d06ba595def2375d7c9895d0acba8a94451dc4"}
Sep 08 00:03:49.226783 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:49.226753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c" event={"ID":"cc5fab1c-4104-495b-8da6-cdadcb18a930","Type":"ContainerStarted","Data":"bb7422ebef95b732b25317f32c84a09ae78d6b34505ab37b65083a076f0a9371"}
Sep 08 00:03:49.227907 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:49.227880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6" event={"ID":"a14a3124-ebda-4f8c-b7d8-e4b008a56961","Type":"ContainerStarted","Data":"918299fb9102555a3b0877060f8fc46f6d3ca011b821c38616fcbd3a4d6361f3"}
Sep 08 00:03:49.239335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:49.239291    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gtfmd" podStartSLOduration=67.180912604 podStartE2EDuration="1m9.239277008s" totalImagesPullingTime="2.058364404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:49.238160034 +0000 UTC m=+69.723588641" watchObservedRunningTime="2026-09-08 00:03:49.239277008 +0000 UTC m=+69.724705615"
Sep 08 00:03:50.031178 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:50.031137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:50.411438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:50.411401    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:50.466550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:50.466513    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:51.361221 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.361154    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:51.459216 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.459180    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:51.513375 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.513316    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"]
Sep 08 00:03:51.529383 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.529328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:51.597108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.597076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"]
Sep 08 00:03:51.597303 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.597214    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:51.599094 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.599074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tvp68\""
Sep 08 00:03:51.599233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.599136    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 00:03:51.673922 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.673883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/959556a9-09ec-4526-9253-4482e0f54c2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-6bh9x\" (UID: \"959556a9-09ec-4526-9253-4482e0f54c2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:51.726874 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.726837    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:51.774757 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.774723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/959556a9-09ec-4526-9253-4482e0f54c2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-6bh9x\" (UID: \"959556a9-09ec-4526-9253-4482e0f54c2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:51.774944 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:51.774882    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 00:03:51.774994 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:51.774949    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/959556a9-09ec-4526-9253-4482e0f54c2f-tls-certificates podName:959556a9-09ec-4526-9253-4482e0f54c2f nodeName:}" failed. No retries permitted until 2026-09-08 00:03:52.27493257 +0000 UTC m=+72.760361156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/959556a9-09ec-4526-9253-4482e0f54c2f-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-6bh9x" (UID: "959556a9-09ec-4526-9253-4482e0f54c2f") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 00:03:51.827898 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.827846    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:51.880249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:51.880199    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:52.064503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.064428    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-hrpsk"]
Sep 08 00:03:52.078497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.078473    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-hrpsk"]
Sep 08 00:03:52.078636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.078561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-hrpsk"
Sep 08 00:03:52.080312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.080286    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 00:03:52.080462 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.080299    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 00:03:52.080462 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.080375    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kx22c\""
Sep 08 00:03:52.081405 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.081383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:52.130277 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.130248    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5sj74"
Sep 08 00:03:52.178971 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.178934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf44b\" (UniqueName: \"kubernetes.io/projected/48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb-kube-api-access-zf44b\") pod \"downloads-85d98c998f-hrpsk\" (UID: \"48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb\") " pod="openshift-console/downloads-85d98c998f-hrpsk"
Sep 08 00:03:52.279454 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.279420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf44b\" (UniqueName: \"kubernetes.io/projected/48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb-kube-api-access-zf44b\") pod \"downloads-85d98c998f-hrpsk\" (UID: \"48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb\") " pod="openshift-console/downloads-85d98c998f-hrpsk"
Sep 08 00:03:52.279691 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.279472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/959556a9-09ec-4526-9253-4482e0f54c2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-6bh9x\" (UID: \"959556a9-09ec-4526-9253-4482e0f54c2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:52.282517 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.282471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/959556a9-09ec-4526-9253-4482e0f54c2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-6bh9x\" (UID: \"959556a9-09ec-4526-9253-4482e0f54c2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:52.289759 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.289736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf44b\" (UniqueName: \"kubernetes.io/projected/48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb-kube-api-access-zf44b\") pod \"downloads-85d98c998f-hrpsk\" (UID: \"48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb\") " pod="openshift-console/downloads-85d98c998f-hrpsk"
Sep 08 00:03:52.388010 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.387916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-hrpsk"
Sep 08 00:03:52.507061 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.507024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:52.674751 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.674719    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-hrpsk"]
Sep 08 00:03:52.677464 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:52.677427    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a3b35e_0bbb_41a1_8ce0_e9a3fbac34bb.slice/crio-31a7c809ba565ad9d7459d74ba90d406256ec9d835a2d69ab67c8cc6a70f9a9d WatchSource:0}: Error finding container 31a7c809ba565ad9d7459d74ba90d406256ec9d835a2d69ab67c8cc6a70f9a9d: Status 404 returned error can't find the container with id 31a7c809ba565ad9d7459d74ba90d406256ec9d835a2d69ab67c8cc6a70f9a9d
Sep 08 00:03:52.761093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.761053    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:52.798417 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.798388    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"]
Sep 08 00:03:52.801802 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:52.801777    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959556a9_09ec_4526_9253_4482e0f54c2f.slice/crio-a4c988ee0427ed02232389f1c1ba1852e61c14825a6b3e9bfc3440850f4faf7f WatchSource:0}: Error finding container a4c988ee0427ed02232389f1c1ba1852e61c14825a6b3e9bfc3440850f4faf7f: Status 404 returned error can't find the container with id a4c988ee0427ed02232389f1c1ba1852e61c14825a6b3e9bfc3440850f4faf7f
Sep 08 00:03:52.861672 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:52.861631    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:53.246353 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:53.246316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x" event={"ID":"959556a9-09ec-4526-9253-4482e0f54c2f","Type":"ContainerStarted","Data":"a4c988ee0427ed02232389f1c1ba1852e61c14825a6b3e9bfc3440850f4faf7f"}
Sep 08 00:03:53.247850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:53.247824    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-hrpsk" event={"ID":"48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb","Type":"ContainerStarted","Data":"31a7c809ba565ad9d7459d74ba90d406256ec9d835a2d69ab67c8cc6a70f9a9d"}
Sep 08 00:03:53.805507 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:53.805462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:53.856937 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:53.856865    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:54.291690 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:54.291649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:55.257837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:55.257745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c" event={"ID":"cc5fab1c-4104-495b-8da6-cdadcb18a930","Type":"ContainerStarted","Data":"3f7fb3a3ff7c6eeff8db8192362c7e836f21cfee892066730e78fbf6f38dff88"}
Sep 08 00:03:55.258253 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:55.257986    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:55.259689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:55.259667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c"
Sep 08 00:03:55.272909 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:55.272853    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9fb96f9-7vs2c" podStartSLOduration=1.597943538 podStartE2EDuration="8.272834305s" totalImagesPullingTime="6.674890767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:55.271440908 +0000 UTC m=+75.756869517" watchObservedRunningTime="2026-09-08 00:03:55.272834305 +0000 UTC m=+75.758262912"
Sep 08 00:03:55.376829 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:55.376783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:55.477105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:55.477066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:56.263065 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.263016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x" event={"ID":"959556a9-09ec-4526-9253-4482e0f54c2f","Type":"ContainerStarted","Data":"780583a90bf11cdf3262011f177abaa2d6c97d5a02664f092d56c0172f12627e"}
Sep 08 00:03:56.263556 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.263381    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:56.268444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.268416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x"
Sep 08 00:03:56.287424 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.287276    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-6bh9x" podStartSLOduration=2.51783223 podStartE2EDuration="5.287251688s" totalImagesPullingTime="2.769419458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:56.275377588 +0000 UTC m=+76.760806196" watchObservedRunningTime="2026-09-08 00:03:56.287251688 +0000 UTC m=+76.772680298"
Sep 08 00:03:56.541903 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.541814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:56.566864 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.566822    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"]
Sep 08 00:03:56.569207 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.569185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.571147 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.571121    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 00:03:56.571437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.571416    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 00:03:56.571437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.571432    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 00:03:56.571691 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.571674    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 00:03:56.572275 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.572253    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 00:03:56.572564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.572546    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gqrzn\""
Sep 08 00:03:56.577982 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.577155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"]
Sep 08 00:03:56.615830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.615794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmtbm\" (UniqueName: \"kubernetes.io/projected/adc30c12-c088-42ed-bf61-994ead1cceb6-kube-api-access-cmtbm\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.616018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.615863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.616018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.615941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc30c12-c088-42ed-bf61-994ead1cceb6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.616018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.615971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.640509 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.640470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:56.716550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.716507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.716762 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.716567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmtbm\" (UniqueName: \"kubernetes.io/projected/adc30c12-c088-42ed-bf61-994ead1cceb6-kube-api-access-cmtbm\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.716762 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.716627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.716762 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.716681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc30c12-c088-42ed-bf61-994ead1cceb6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.716762 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:56.716750    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 00:03:56.717006 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:03:56.716826    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-tls podName:adc30c12-c088-42ed-bf61-994ead1cceb6 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:57.216804319 +0000 UTC m=+77.702232908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-9b7n8" (UID: "adc30c12-c088-42ed-bf61-994ead1cceb6") : secret "prometheus-operator-tls" not found
Sep 08 00:03:56.717468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.717445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc30c12-c088-42ed-bf61-994ead1cceb6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.719682 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.719652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.724740 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.724721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmtbm\" (UniqueName: \"kubernetes.io/projected/adc30c12-c088-42ed-bf61-994ead1cceb6-kube-api-access-cmtbm\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:56.808761 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:56.808660    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:57.221099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:57.221064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:57.223873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:57.223846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/adc30c12-c088-42ed-bf61-994ead1cceb6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9b7n8\" (UID: \"adc30c12-c088-42ed-bf61-994ead1cceb6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:57.480591 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:57.480514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"
Sep 08 00:03:57.757738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:57.757565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9b7n8"]
Sep 08 00:03:57.761893 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:03:57.761859    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc30c12_c088_42ed_bf61_994ead1cceb6.slice/crio-923efc203853670163d19c0bb15db3da99add107a12b4f1c515b3c9945a8a372 WatchSource:0}: Error finding container 923efc203853670163d19c0bb15db3da99add107a12b4f1c515b3c9945a8a372: Status 404 returned error can't find the container with id 923efc203853670163d19c0bb15db3da99add107a12b4f1c515b3c9945a8a372
Sep 08 00:03:57.767584 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:57.767554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:57.817668 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:57.817596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:57.877241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:57.877176    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:03:58.231400 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:58.230624    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4xh6w"
Sep 08 00:03:58.277744 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:03:58.277664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8" event={"ID":"adc30c12-c088-42ed-bf61-994ead1cceb6","Type":"ContainerStarted","Data":"923efc203853670163d19c0bb15db3da99add107a12b4f1c515b3c9945a8a372"}
Sep 08 00:04:00.287967 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:00.287926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8" event={"ID":"adc30c12-c088-42ed-bf61-994ead1cceb6","Type":"ContainerStarted","Data":"814980cc52b848aa7ec9659b47e703b13504ee7867ee0a53b38ce32c5db9d872"}
Sep 08 00:04:00.288394 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:00.287999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8" event={"ID":"adc30c12-c088-42ed-bf61-994ead1cceb6","Type":"ContainerStarted","Data":"9110197e06c6a8c080dd5722b0746bb07977f97ebd9e07a1b5af4774ea699a4d"}
Sep 08 00:04:00.289865 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:00.289836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6" event={"ID":"a14a3124-ebda-4f8c-b7d8-e4b008a56961","Type":"ContainerStarted","Data":"ac01da7d387c442c22c084279168388e1a5d02153bcf2c2d8598383a1fc38d8e"}
Sep 08 00:04:00.303072 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:00.302998    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-9b7n8" podStartSLOduration=2.00039905 podStartE2EDuration="4.302972491s" totalImagesPullingTime="2.302573441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:00.302280287 +0000 UTC m=+80.787708896" watchObservedRunningTime="2026-09-08 00:04:00.302972491 +0000 UTC m=+80.788401095"
Sep 08 00:04:00.450945 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:00.450896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:00.740863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:00.740769    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:00.810362 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:00.810312    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:01.937362 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:01.937023    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdfc7b5d-tm5l6" podStartSLOduration=3.163483268 podStartE2EDuration="14.937005567s" totalImagesPullingTime="11.773522299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:00.344642054 +0000 UTC m=+80.830070664" watchObservedRunningTime="2026-09-08 00:04:01.937005567 +0000 UTC m=+82.422434174"
Sep 08 00:04:01.937935 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:01.937620    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zx498"]
Sep 08 00:04:01.941029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:01.940292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:01.942715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:01.942567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7xzz2\""
Sep 08 00:04:01.942715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:01.942607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 00:04:01.942715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:01.942567    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 00:04:01.942929 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:01.942888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-root\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-wtmp\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-textfile\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-accelerators-collector-config\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307db5ad-0c11-4023-b7d8-bfc3c943f201-metrics-client-ca\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj59d\" (UniqueName: \"kubernetes.io/projected/307db5ad-0c11-4023-b7d8-bfc3c943f201-kube-api-access-dj59d\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-sys\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-tls\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.062600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.062535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.162966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj59d\" (UniqueName: \"kubernetes.io/projected/307db5ad-0c11-4023-b7d8-bfc3c943f201-kube-api-access-dj59d\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-sys\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-tls\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-root\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-wtmp\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-textfile\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-accelerators-collector-config\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307db5ad-0c11-4023-b7d8-bfc3c943f201-metrics-client-ca\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.163847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.163458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-sys\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.165241 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:04:02.163873    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 00:04:02.165241 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:04:02.163933    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-tls podName:307db5ad-0c11-4023-b7d8-bfc3c943f201 nodeName:}" failed. No retries permitted until 2026-09-08 00:04:02.663912656 +0000 UTC m=+83.149341257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-tls") pod "node-exporter-zx498" (UID: "307db5ad-0c11-4023-b7d8-bfc3c943f201") : secret "node-exporter-tls" not found
Sep 08 00:04:02.165241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.164214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-wtmp\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.165241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.164259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/307db5ad-0c11-4023-b7d8-bfc3c943f201-root\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.165241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.164586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-textfile\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.165241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.164966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-accelerators-collector-config\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.165241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.165074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307db5ad-0c11-4023-b7d8-bfc3c943f201-metrics-client-ca\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.168293 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.168243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.177196 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.177138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj59d\" (UniqueName: \"kubernetes.io/projected/307db5ad-0c11-4023-b7d8-bfc3c943f201-kube-api-access-dj59d\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.377089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.376831    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:02.475899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.475861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:02.562308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.562269    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:02.663689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.663634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:02.667825 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.667794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-tls\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.670529 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.670505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/307db5ad-0c11-4023-b7d8-bfc3c943f201-node-exporter-tls\") pod \"node-exporter-zx498\" (UID: \"307db5ad-0c11-4023-b7d8-bfc3c943f201\") " pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.852448 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.852397    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zx498"
Sep 08 00:04:02.900986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.900952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:02.977148 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.977059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:02.980506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.980480    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:04:02.983814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.983793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.985927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.985949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.985938    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.986047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cf2xr\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.985932    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.986274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.986294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.986402    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.986485    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 00:04:02.987233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.986997    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 00:04:02.996766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:02.996740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:04:03.071492 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-config-out\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.071492 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.071738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7zc5\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-kube-api-access-g7zc5\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.071738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.071738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-web-config\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.071738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.071738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.071738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.072047 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.072047 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.072047 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.072047 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.072047 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.071862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.097706 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.097667    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:03.145664 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.145633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:03.172521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-web-config\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172901 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172901 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172901 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.172901 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.173102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-config-out\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.173102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.173102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.172973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7zc5\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-kube-api-access-g7zc5\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.173102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.173020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.173655 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.173541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.173655 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.173551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.174769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.174741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.175682 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.175653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-web-config\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.175787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.175711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.176947 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.176133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.176947 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.177148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.178076 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.177562    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.178076 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.178061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.178198 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.178066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.178408 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.178383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-config-out\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.178917 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.178892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.181308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.181286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7zc5\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-kube-api-access-g7zc5\") pod \"alertmanager-main-0\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.296697 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.296615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:04:03.890618 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.890583    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"]
Sep 08 00:04:03.895226 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.895203    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.897812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.897506    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 00:04:03.897812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.897568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-74d8b\""
Sep 08 00:04:03.897812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.897578    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 00:04:03.897812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.897639    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 00:04:03.897812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.897583    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 00:04:03.897812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.897506    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 00:04:03.898177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.897911    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-aklhrrc9gth79\""
Sep 08 00:04:03.904244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.903900    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"]
Sep 08 00:04:03.979752 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.979707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.979752 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.979762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-grpc-tls\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.980281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.979841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-tls\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.980281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.979882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpzqm\" (UniqueName: \"kubernetes.io/projected/1f0c913f-f20d-4744-8d71-2124578fdf8a-kube-api-access-jpzqm\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.980281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.979944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.980281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.980017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.980281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.980036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:03.980281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:03.980062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0c913f-f20d-4744-8d71-2124578fdf8a-metrics-client-ca\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081098 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-grpc-tls\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-tls\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpzqm\" (UniqueName: \"kubernetes.io/projected/1f0c913f-f20d-4744-8d71-2124578fdf8a-kube-api-access-jpzqm\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081599 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0c913f-f20d-4744-8d71-2124578fdf8a-metrics-client-ca\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.081599 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.081381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.082235 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.082180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0c913f-f20d-4744-8d71-2124578fdf8a-metrics-client-ca\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.084727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.084402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-grpc-tls\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.084727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.084651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.084727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.084681    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.084958 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.084825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.084958 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.084935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.085182 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.085160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f0c913f-f20d-4744-8d71-2124578fdf8a-secret-thanos-querier-tls\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.089292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.089270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpzqm\" (UniqueName: \"kubernetes.io/projected/1f0c913f-f20d-4744-8d71-2124578fdf8a-kube-api-access-jpzqm\") pod \"thanos-querier-6777c6bf8b-lzg2l\" (UID: \"1f0c913f-f20d-4744-8d71-2124578fdf8a\") " pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.207331 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.207290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:04.860055 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.859997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:04.961146 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:04.961103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:05.149548 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:05.149515    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:05.250301 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:05.250264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:06.570012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:06.569973    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:06.672009 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:06.671959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:06.722884 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:06.722840    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:06.873640 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:06.873550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:08.126894 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.126820    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:08.226661 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.226631    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:04:08.390581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.390484    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5864968fc5-9shh8"]
Sep 08 00:04:08.392747 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.392718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:08.394554 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.394036    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.396524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.396463    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 00:04:08.396660 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.396537    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k2h98\""
Sep 08 00:04:08.396739 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.396719    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 00:04:08.397022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.396948    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 00:04:08.397120 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.397023    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 00:04:08.397120 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.396961    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 00:04:08.402857 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.402830    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 00:04:08.407017 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.406991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5864968fc5-9shh8"]
Sep 08 00:04:08.449870 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.449834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:08.521863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.521824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-oauth-serving-cert\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.522077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.521873    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-service-ca\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.522077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.521956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-oauth-config\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.522077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.521987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-serving-cert\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.522077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.522048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-config\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.522284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.522105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-trusted-ca-bundle\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.522284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.522136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfnp2\" (UniqueName: \"kubernetes.io/projected/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-kube-api-access-xfnp2\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.622924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.622871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-trusted-ca-bundle\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.622924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.622928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfnp2\" (UniqueName: \"kubernetes.io/projected/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-kube-api-access-xfnp2\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.623172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.622993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-oauth-serving-cert\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.623172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.623019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-service-ca\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.623172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.623046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-oauth-config\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.623172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.623074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-serving-cert\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.623172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.623128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-config\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.625526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.623969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-oauth-serving-cert\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.625526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.624554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-config\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.625526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.625053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-service-ca\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.626334 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.626290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-serving-cert\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.627106 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.627067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-trusted-ca-bundle\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.628583 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.628537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-oauth-config\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.630531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.630509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfnp2\" (UniqueName: \"kubernetes.io/projected/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-kube-api-access-xfnp2\") pod \"console-5864968fc5-9shh8\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") " pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:08.709770 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:08.709726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:09.768585 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:09.768544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:09.957905 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:04:09.957834    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307db5ad_0c11_4023_b7d8_bfc3c943f201.slice/crio-e2440de771b64fbdbb38633279ca215329d445ebb0261f3d7bef51e7931fbd02 WatchSource:0}: Error finding container e2440de771b64fbdbb38633279ca215329d445ebb0261f3d7bef51e7931fbd02: Status 404 returned error can't find the container with id e2440de771b64fbdbb38633279ca215329d445ebb0261f3d7bef51e7931fbd02
Sep 08 00:04:10.210741 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.210711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:04:10.212902 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:04:10.212867    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d211499_b0a5_4da4_9461_1685323735e9.slice/crio-1adbee5617cdcad9d76c34a006e7120712dd96e092c06112b313a789e5eeb8a1 WatchSource:0}: Error finding container 1adbee5617cdcad9d76c34a006e7120712dd96e092c06112b313a789e5eeb8a1: Status 404 returned error can't find the container with id 1adbee5617cdcad9d76c34a006e7120712dd96e092c06112b313a789e5eeb8a1
Sep 08 00:04:10.238022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.237994    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5864968fc5-9shh8"]
Sep 08 00:04:10.240789 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:04:10.240754    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f8ed3a_0f67_400b_95d6_fe42de5543fd.slice/crio-ebded47a328eebdc540a85810fc6a9a05a2feb476fccb4feb661426a8333e34d WatchSource:0}: Error finding container ebded47a328eebdc540a85810fc6a9a05a2feb476fccb4feb661426a8333e34d: Status 404 returned error can't find the container with id ebded47a328eebdc540a85810fc6a9a05a2feb476fccb4feb661426a8333e34d
Sep 08 00:04:10.242117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.242085    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"]
Sep 08 00:04:10.245183 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:04:10.245154    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0c913f_f20d_4744_8d71_2124578fdf8a.slice/crio-cc76315d8777d5e23687dfd6a58df601ae03c5cd8395088b2f3ca624fc8672e0 WatchSource:0}: Error finding container cc76315d8777d5e23687dfd6a58df601ae03c5cd8395088b2f3ca624fc8672e0: Status 404 returned error can't find the container with id cc76315d8777d5e23687dfd6a58df601ae03c5cd8395088b2f3ca624fc8672e0
Sep 08 00:04:10.332775 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.332685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-hrpsk" event={"ID":"48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb","Type":"ContainerStarted","Data":"e695479c89068ba9d469b53496acae7ae493d162493105efd93d2fab2f15336f"}
Sep 08 00:04:10.332949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.332871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-hrpsk"
Sep 08 00:04:10.334711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.334632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" event={"ID":"1f0c913f-f20d-4744-8d71-2124578fdf8a","Type":"ContainerStarted","Data":"cc76315d8777d5e23687dfd6a58df601ae03c5cd8395088b2f3ca624fc8672e0"}
Sep 08 00:04:10.337050 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.337021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerStarted","Data":"1adbee5617cdcad9d76c34a006e7120712dd96e092c06112b313a789e5eeb8a1"}
Sep 08 00:04:10.338612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.338577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5864968fc5-9shh8" event={"ID":"f6f8ed3a-0f67-400b-95d6-fe42de5543fd","Type":"ContainerStarted","Data":"ebded47a328eebdc540a85810fc6a9a05a2feb476fccb4feb661426a8333e34d"}
Sep 08 00:04:10.340067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.340041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zx498" event={"ID":"307db5ad-0c11-4023-b7d8-bfc3c943f201","Type":"ContainerStarted","Data":"e2440de771b64fbdbb38633279ca215329d445ebb0261f3d7bef51e7931fbd02"}
Sep 08 00:04:10.348051 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.348006    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-hrpsk" podStartSLOduration=0.991518008 podStartE2EDuration="18.347989783s" totalImagesPullingTime="17.356471775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:10.346484312 +0000 UTC m=+90.831912920" watchObservedRunningTime="2026-09-08 00:04:10.347989783 +0000 UTC m=+90.833418391"
Sep 08 00:04:10.349494 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.349469    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-hrpsk"
Sep 08 00:04:10.900423 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.900322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:10.949860 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:10.949776    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:11.577690 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:11.577621    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:11.627665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:11.627591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:13.239365 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:13.239130    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6" podUID="918f6954-da10-4830-b068-b5a8f7b9f968" containerName="registry" containerID="cri-o://7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41" gracePeriod=30
Sep 08 00:04:14.256947 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.256907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:14.304887 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.304853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:14.820939 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.820910    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:04:14.988121 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.987881    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bhq8\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-kube-api-access-5bhq8\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.988121 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.987959    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-trusted-ca\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.988121 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.987992    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.988121 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.988024    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918f6954-da10-4830-b068-b5a8f7b9f968-ca-trust-extracted\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.988121 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.988071    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-bound-sa-token\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.988502 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.988145    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-image-registry-private-configuration\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.988557 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.988526    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:14.988619 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.988595    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-registry-certificates\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.988676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.988627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-installation-pull-secrets\") pod \"918f6954-da10-4830-b068-b5a8f7b9f968\" (UID: \"918f6954-da10-4830-b068-b5a8f7b9f968\") "
Sep 08 00:04:14.989185 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.988905    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-trusted-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:14.990706 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.990339    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:14.991911 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.991879    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:04:14.992155 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.992130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-kube-api-access-5bhq8" (OuterVolumeSpecName: "kube-api-access-5bhq8") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "kube-api-access-5bhq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:14.992639 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.992600    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:14.994068 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.994028    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:14.995271 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:14.995228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:04:15.003736 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.003671    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/918f6954-da10-4830-b068-b5a8f7b9f968-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "918f6954-da10-4830-b068-b5a8f7b9f968" (UID: "918f6954-da10-4830-b068-b5a8f7b9f968"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:04:15.089951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.089837    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-bound-sa-token\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:15.089951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.089868    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-image-registry-private-configuration\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:15.089951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.089884    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918f6954-da10-4830-b068-b5a8f7b9f968-registry-certificates\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:15.089951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.089898    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918f6954-da10-4830-b068-b5a8f7b9f968-installation-pull-secrets\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:15.089951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.089911    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bhq8\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-kube-api-access-5bhq8\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:15.089951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.089923    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918f6954-da10-4830-b068-b5a8f7b9f968-registry-tls\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:15.089951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.089935    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918f6954-da10-4830-b068-b5a8f7b9f968-ca-trust-extracted\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:04:15.368313 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.368279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" event={"ID":"1f0c913f-f20d-4744-8d71-2124578fdf8a","Type":"ContainerStarted","Data":"fa33a1eb9d8236c925905578871628bfa4a591e485dc8ec1e9b1482e96c12425"}
Sep 08 00:04:15.368713 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.368376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" event={"ID":"1f0c913f-f20d-4744-8d71-2124578fdf8a","Type":"ContainerStarted","Data":"d2eaf860af512b581dea24db92d28d84217f5119f398cff7af5117fc27efa4a8"}
Sep 08 00:04:15.368713 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.368405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" event={"ID":"1f0c913f-f20d-4744-8d71-2124578fdf8a","Type":"ContainerStarted","Data":"06ce39349e7050810f4ea1987d2b2b2e9cf947d36a9e09f407d07cd3640c8701"}
Sep 08 00:04:15.370224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.370194    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d211499-b0a5-4da4-9461-1685323735e9" containerID="e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7" exitCode=0
Sep 08 00:04:15.370315 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.370227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7"}
Sep 08 00:04:15.375322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.371863    2580 generic.go:356] "Generic (PLEG): container finished" podID="918f6954-da10-4830-b068-b5a8f7b9f968" containerID="7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41" exitCode=0
Sep 08 00:04:15.375322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.371935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6" event={"ID":"918f6954-da10-4830-b068-b5a8f7b9f968","Type":"ContainerDied","Data":"7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41"}
Sep 08 00:04:15.375322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.371975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6" event={"ID":"918f6954-da10-4830-b068-b5a8f7b9f968","Type":"ContainerDied","Data":"cd6fb7b2250d661435bff8c48a0a97518f0560f85d46f2a09f44d4942e347af4"}
Sep 08 00:04:15.375322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.372005    2580 scope.go:117] "RemoveContainer" containerID="7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41"
Sep 08 00:04:15.375322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.372137    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8b8d78d5-rpht6"
Sep 08 00:04:15.375322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.374541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5864968fc5-9shh8" event={"ID":"f6f8ed3a-0f67-400b-95d6-fe42de5543fd","Type":"ContainerStarted","Data":"7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df"}
Sep 08 00:04:15.380985 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.380526    2580 generic.go:356] "Generic (PLEG): container finished" podID="307db5ad-0c11-4023-b7d8-bfc3c943f201" containerID="16b22fd73a2660a26734b56755c65f81187cd5371394e7193fb0099f7f1672c5" exitCode=0
Sep 08 00:04:15.380985 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.380601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zx498" event={"ID":"307db5ad-0c11-4023-b7d8-bfc3c943f201","Type":"ContainerDied","Data":"16b22fd73a2660a26734b56755c65f81187cd5371394e7193fb0099f7f1672c5"}
Sep 08 00:04:15.386614 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.386583    2580 scope.go:117] "RemoveContainer" containerID="7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41"
Sep 08 00:04:15.386956 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:04:15.386918    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41\": container with ID starting with 7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41 not found: ID does not exist" containerID="7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41"
Sep 08 00:04:15.387016 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.386967    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41"} err="failed to get container status \"7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41\": rpc error: code = NotFound desc = could not find container \"7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41\": container with ID starting with 7a12838b4007d8827462804790fd7af263b5bfa74e75c882c585b1af5d59da41 not found: ID does not exist"
Sep 08 00:04:15.422554 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.422535    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8b8d78d5-rpht6"]
Sep 08 00:04:15.425902 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.425881    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d8b8d78d5-rpht6"]
Sep 08 00:04:15.439033 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.438990    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5864968fc5-9shh8" podStartSLOduration=2.847548507 podStartE2EDuration="7.438976008s" totalImagesPullingTime="4.591427501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:15.437924143 +0000 UTC m=+95.923352750" watchObservedRunningTime="2026-09-08 00:04:15.438976008 +0000 UTC m=+95.924404615"
Sep 08 00:04:15.926539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:15.926506    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="918f6954-da10-4830-b068-b5a8f7b9f968" path="/var/lib/kubelet/pods/918f6954-da10-4830-b068-b5a8f7b9f968/volumes"
Sep 08 00:04:16.390027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:16.389802    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zx498" event={"ID":"307db5ad-0c11-4023-b7d8-bfc3c943f201","Type":"ContainerStarted","Data":"378ae4a79d038f44a3d5b2572f96d3129546f30fdceaa57cb75741705e2001c9"}
Sep 08 00:04:16.390027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:16.389882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zx498" event={"ID":"307db5ad-0c11-4023-b7d8-bfc3c943f201","Type":"ContainerStarted","Data":"48d6161d4b4ca6aeb79bbf72f8737865089f80b7cbb33f7084f6a2906f28305e"}
Sep 08 00:04:16.410861 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:16.410214    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zx498" podStartSLOduration=10.449245317 podStartE2EDuration="15.410190123s" totalImagesPullingTime="4.863706132s" totalInitContainerRuntime="97.238674ms" isStatefulPod=true podCreationTimestamp="2026-09-08 00:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:16.408665584 +0000 UTC m=+96.894094193" watchObservedRunningTime="2026-09-08 00:04:16.410190123 +0000 UTC m=+96.895618733"
Sep 08 00:04:17.136221 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:17.136182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:17.182676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:17.182636    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:17.377362 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:17.377323    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:17.479727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:17.479688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:18.403298 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.403264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerStarted","Data":"0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3"}
Sep 08 00:04:18.403412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.403375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerStarted","Data":"4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779"}
Sep 08 00:04:18.403486 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.403425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerStarted","Data":"eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784"}
Sep 08 00:04:18.710502 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.710441    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:18.711010 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.710513    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:18.716060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.716029    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:18.782017 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.781983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:18.874747 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:18.874667    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:19.175236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.175204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:19.276162 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.276111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:19.416167 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.416131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerStarted","Data":"d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62"}
Sep 08 00:04:19.416374 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.416219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerStarted","Data":"71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1"}
Sep 08 00:04:19.416374 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.416279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerStarted","Data":"2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36"}
Sep 08 00:04:19.420145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.420114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" event={"ID":"1f0c913f-f20d-4744-8d71-2124578fdf8a","Type":"ContainerStarted","Data":"63364d636c3beedd3c438b3b67c8417953dc23227efc86f4cc3b67060abc1769"}
Sep 08 00:04:19.420257 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.420212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" event={"ID":"1f0c913f-f20d-4744-8d71-2124578fdf8a","Type":"ContainerStarted","Data":"a527f649222fa4ed65b482847901477745fc37b990818d1f9bc151714ba2a96e"}
Sep 08 00:04:19.420326 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.420263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" event={"ID":"1f0c913f-f20d-4744-8d71-2124578fdf8a","Type":"ContainerStarted","Data":"36c149bce2a9c66905f35dce6cb005364c7d0977182de931f499e66635679801"}
Sep 08 00:04:19.424466 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.424436    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:04:19.464287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.464184    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l" podStartSLOduration=8.879627020000001 podStartE2EDuration="16.464166672s" totalImagesPullingTime="7.584539652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:04:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:19.46306076 +0000 UTC m=+99.948489369" watchObservedRunningTime="2026-09-08 00:04:19.464166672 +0000 UTC m=+99.949595281"
Sep 08 00:04:19.465309 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:19.465266    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.681697493 podStartE2EDuration="17.465257494s" totalImagesPullingTime="6.769735939s" totalInitContainerRuntime="13.824062ms" isStatefulPod=false podCreationTimestamp="2026-09-08 00:04:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:19.443005546 +0000 UTC m=+99.928434155" watchObservedRunningTime="2026-09-08 00:04:19.465257494 +0000 UTC m=+99.950686101"
Sep 08 00:04:20.425026 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:20.424987    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:20.430512 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:20.430485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6777c6bf8b-lzg2l"
Sep 08 00:04:20.430968 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:20.430946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:20.535498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:20.535458    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:20.972494 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:20.972452    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:21.072942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:21.072899    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:21.799153 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:21.799117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:21.900890 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:21.900859    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:23.365218 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:23.365178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:23.478837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:23.478801    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:23.570475 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:23.570432    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:30.606366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:30.606315    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:30.706855 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:30.706814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:30.754723 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:30.754687    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:38.405978 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:38.405944    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:04:38.506779 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:04:38.506711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:05:21.108900 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:21.108864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:05:21.509633 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:21.509596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:05:21.719242 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:21.719210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:05:22.147692 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.147651    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:05:22.148080 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.148011    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="alertmanager" containerID="cri-o://eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784" gracePeriod=120
Sep 08 00:05:22.148080 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.148050    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-metric" containerID="cri-o://71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1" gracePeriod=120
Sep 08 00:05:22.148176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.148115    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy" containerID="cri-o://2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36" gracePeriod=120
Sep 08 00:05:22.148176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.148112    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-web" containerID="cri-o://0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3" gracePeriod=120
Sep 08 00:05:22.148264 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.148100    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="prom-label-proxy" containerID="cri-o://d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62" gracePeriod=120
Sep 08 00:05:22.148264 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.148200    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="config-reloader" containerID="cri-o://4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779" gracePeriod=120
Sep 08 00:05:22.672406 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672376    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d211499-b0a5-4da4-9461-1685323735e9" containerID="d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62" exitCode=0
Sep 08 00:05:22.672406 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672400    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d211499-b0a5-4da4-9461-1685323735e9" containerID="71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1" exitCode=0
Sep 08 00:05:22.672406 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672407    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d211499-b0a5-4da4-9461-1685323735e9" containerID="2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36" exitCode=0
Sep 08 00:05:22.672406 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672414    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d211499-b0a5-4da4-9461-1685323735e9" containerID="4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779" exitCode=0
Sep 08 00:05:22.672406 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672419    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d211499-b0a5-4da4-9461-1685323735e9" containerID="eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784" exitCode=0
Sep 08 00:05:22.672776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62"}
Sep 08 00:05:22.672776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1"}
Sep 08 00:05:22.672776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36"}
Sep 08 00:05:22.672776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672592    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779"}
Sep 08 00:05:22.672776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:22.672624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784"}
Sep 08 00:05:23.380276 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.380255    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.517048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.516973    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-web-config\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517007    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7zc5\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-kube-api-access-g7zc5\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-cluster-tls-config\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-main-tls\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517110    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-trusted-ca-bundle\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517141    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517178    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-metrics-client-ca\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-config-volume\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517264    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517289    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-tls-assets\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517336    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-config-out\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517396    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-main-db\") pod \"7d211499-b0a5-4da4-9461-1685323735e9\" (UID: \"7d211499-b0a5-4da4-9461-1685323735e9\") "
Sep 08 00:05:23.517749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517564    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:05:23.517901 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517866    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:05:23.517978 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.517953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:05:23.520233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.520017    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:05:23.520233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.520040    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-kube-api-access-g7zc5" (OuterVolumeSpecName: "kube-api-access-g7zc5") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "kube-api-access-g7zc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:05:23.520489 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.520411    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:05:23.520662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.520631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:05:23.520771 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.520737    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-config-volume" (OuterVolumeSpecName: "config-volume") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:05:23.521089 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.521061    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:05:23.521938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.521919    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:05:23.522322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.522296    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-config-out" (OuterVolumeSpecName: "config-out") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:05:23.524060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.524040    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:05:23.530062 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.530035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-web-config" (OuterVolumeSpecName: "web-config") pod "7d211499-b0a5-4da4-9461-1685323735e9" (UID: "7d211499-b0a5-4da4-9461-1685323735e9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:05:23.618581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618543    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-main-tls\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618574    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618584    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618594    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d211499-b0a5-4da4-9461-1685323735e9-metrics-client-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618603    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618612    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618620    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618629    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-tls-assets\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618636    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-config-out\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618644    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d211499-b0a5-4da4-9461-1685323735e9-alertmanager-main-db\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618651    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-web-config\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618659    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7zc5\" (UniqueName: \"kubernetes.io/projected/7d211499-b0a5-4da4-9461-1685323735e9-kube-api-access-g7zc5\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.618833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.618666    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d211499-b0a5-4da4-9461-1685323735e9-cluster-tls-config\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:05:23.679496 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.679468    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d211499-b0a5-4da4-9461-1685323735e9" containerID="0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3" exitCode=0
Sep 08 00:05:23.679635 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.679516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3"}
Sep 08 00:05:23.679635 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.679544    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.679635 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.679570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d211499-b0a5-4da4-9461-1685323735e9","Type":"ContainerDied","Data":"1adbee5617cdcad9d76c34a006e7120712dd96e092c06112b313a789e5eeb8a1"}
Sep 08 00:05:23.679635 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.679601    2580 scope.go:117] "RemoveContainer" containerID="d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62"
Sep 08 00:05:23.692249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.692230    2580 scope.go:117] "RemoveContainer" containerID="71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1"
Sep 08 00:05:23.699142 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.699121    2580 scope.go:117] "RemoveContainer" containerID="2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36"
Sep 08 00:05:23.703687 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.703662    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:05:23.707503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.707476    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:05:23.709485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.709464    2580 scope.go:117] "RemoveContainer" containerID="0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3"
Sep 08 00:05:23.716118 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.716100    2580 scope.go:117] "RemoveContainer" containerID="4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779"
Sep 08 00:05:23.722701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.722679    2580 scope.go:117] "RemoveContainer" containerID="eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784"
Sep 08 00:05:23.729507 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.729483    2580 scope.go:117] "RemoveContainer" containerID="e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7"
Sep 08 00:05:23.732007 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.731985    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:05:23.732267 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732255    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="alertmanager"
Sep 08 00:05:23.732316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732268    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="alertmanager"
Sep 08 00:05:23.732316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732279    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="config-reloader"
Sep 08 00:05:23.732316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732285    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="config-reloader"
Sep 08 00:05:23.732316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732298    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy"
Sep 08 00:05:23.732316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732303    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy"
Sep 08 00:05:23.732316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732313    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-metric"
Sep 08 00:05:23.732316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732318    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-metric"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732324    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="prom-label-proxy"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732329    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="prom-label-proxy"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732336    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="init-config-reloader"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732357    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="init-config-reloader"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732366    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-web"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732375    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-web"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732386    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="918f6954-da10-4830-b068-b5a8f7b9f968" containerName="registry"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732391    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="918f6954-da10-4830-b068-b5a8f7b9f968" containerName="registry"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732431    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="918f6954-da10-4830-b068-b5a8f7b9f968" containerName="registry"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732439    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="alertmanager"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732444    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732451    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="prom-label-proxy"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732459    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-web"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732467    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="config-reloader"
Sep 08 00:05:23.732550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.732474    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d211499-b0a5-4da4-9461-1685323735e9" containerName="kube-rbac-proxy-metric"
Sep 08 00:05:23.736130 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.736111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.736767 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.736741    2580 scope.go:117] "RemoveContainer" containerID="d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62"
Sep 08 00:05:23.737043 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:05:23.737022    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62\": container with ID starting with d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62 not found: ID does not exist" containerID="d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62"
Sep 08 00:05:23.737093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737052    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62"} err="failed to get container status \"d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62\": rpc error: code = NotFound desc = could not find container \"d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62\": container with ID starting with d9b8d55273de53de99f8358c7cecd6b24050939b10014dc75c11a8c1b6f36e62 not found: ID does not exist"
Sep 08 00:05:23.737093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737071    2580 scope.go:117] "RemoveContainer" containerID="71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1"
Sep 08 00:05:23.737394 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:05:23.737377    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1\": container with ID starting with 71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1 not found: ID does not exist" containerID="71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1"
Sep 08 00:05:23.737435 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737401    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1"} err="failed to get container status \"71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1\": rpc error: code = NotFound desc = could not find container \"71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1\": container with ID starting with 71d1ce8000b468235833ee08b326af5cf31eaa5873202629e0c85d22225fa0d1 not found: ID does not exist"
Sep 08 00:05:23.737435 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737417    2580 scope.go:117] "RemoveContainer" containerID="2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36"
Sep 08 00:05:23.737685 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:05:23.737667    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36\": container with ID starting with 2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36 not found: ID does not exist" containerID="2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36"
Sep 08 00:05:23.737758 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737689    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36"} err="failed to get container status \"2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36\": rpc error: code = NotFound desc = could not find container \"2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36\": container with ID starting with 2d3a21c172f45d61f83ff7704e1c168e19c9620fc56f1ba78dcd8640259deb36 not found: ID does not exist"
Sep 08 00:05:23.737758 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737703    2580 scope.go:117] "RemoveContainer" containerID="0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3"
Sep 08 00:05:23.737857 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737826    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 00:05:23.737998 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:05:23.737969    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3\": container with ID starting with 0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3 not found: ID does not exist" containerID="0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3"
Sep 08 00:05:23.738066 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738032    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3"} err="failed to get container status \"0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3\": rpc error: code = NotFound desc = could not find container \"0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3\": container with ID starting with 0017f2d54e078e61b6b1552962be91ed97c71394e99a9e8a12acd0e4bbc0bfb3 not found: ID does not exist"
Sep 08 00:05:23.738066 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738054    2580 scope.go:117] "RemoveContainer" containerID="4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779"
Sep 08 00:05:23.738175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738098    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 00:05:23.738175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.737998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 00:05:23.738175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738114    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cf2xr\""
Sep 08 00:05:23.738175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 00:05:23.738175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 00:05:23.738423 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738180    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 00:05:23.738423 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 00:05:23.738519 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:05:23.738492    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779\": container with ID starting with 4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779 not found: ID does not exist" containerID="4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779"
Sep 08 00:05:23.738573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738522    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779"} err="failed to get container status \"4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779\": rpc error: code = NotFound desc = could not find container \"4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779\": container with ID starting with 4ac7f512e0b40d5a232f93bdbe448ee3620e26e348e6da8997e42383f2b1a779 not found: ID does not exist"
Sep 08 00:05:23.738573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738541    2580 scope.go:117] "RemoveContainer" containerID="eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784"
Sep 08 00:05:23.738663 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 00:05:23.738832 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:05:23.738802    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784\": container with ID starting with eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784 not found: ID does not exist" containerID="eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784"
Sep 08 00:05:23.738928 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738831    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784"} err="failed to get container status \"eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784\": rpc error: code = NotFound desc = could not find container \"eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784\": container with ID starting with eadb39237ed33067938d2aaa6c86ee7ae04797aa521e4407801b8ded0e980784 not found: ID does not exist"
Sep 08 00:05:23.738928 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.738851    2580 scope.go:117] "RemoveContainer" containerID="e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7"
Sep 08 00:05:23.739109 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:05:23.739086    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7\": container with ID starting with e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7 not found: ID does not exist" containerID="e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7"
Sep 08 00:05:23.739189 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.739114    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7"} err="failed to get container status \"e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7\": rpc error: code = NotFound desc = could not find container \"e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7\": container with ID starting with e55e8537cdc42d6f8380b4ef3ba1783b11c3f58d18476fe554ef3911d70ad0d7 not found: ID does not exist"
Sep 08 00:05:23.742446 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.742421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 00:05:23.748113 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.748094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:05:23.820747 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.820747 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.820747 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.820747 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qnl\" (UniqueName: \"kubernetes.io/projected/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-kube-api-access-49qnl\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-web-config\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.820988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.821006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.821025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-config-out\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.821290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.821054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.921651 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.921797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.921797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.921797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qnl\" (UniqueName: \"kubernetes.io/projected/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-kube-api-access-49qnl\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.921797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.921797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.921797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922100 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.921814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-web-config\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.922135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.922173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.922209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-config-out\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.922236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.922248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.922297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.922563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.922525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.923537 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.923505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.924737 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.924713    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.924861 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.924746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.925198 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.925122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.925284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.925193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.925284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.925202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.925413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.925286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.926107 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.926088    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.927058 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.927035    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-config-out\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.927318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.927297    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-web-config\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:23.928086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.928061    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d211499-b0a5-4da4-9461-1685323735e9" path="/var/lib/kubelet/pods/7d211499-b0a5-4da4-9461-1685323735e9/volumes"
Sep 08 00:05:23.928746 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:23.928727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qnl\" (UniqueName: \"kubernetes.io/projected/4c56d85f-07a9-46bd-a7ca-a03ddf1a4317-kube-api-access-49qnl\") pod \"alertmanager-main-0\" (UID: \"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:24.048147 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:24.048099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:05:24.320262 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:24.320215    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:05:24.324821 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:05:24.324785    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c56d85f_07a9_46bd_a7ca_a03ddf1a4317.slice/crio-ea37b2d800beda51d1e2ebcc3744efdd63647848262992523b5b4270bc26d90b WatchSource:0}: Error finding container ea37b2d800beda51d1e2ebcc3744efdd63647848262992523b5b4270bc26d90b: Status 404 returned error can't find the container with id ea37b2d800beda51d1e2ebcc3744efdd63647848262992523b5b4270bc26d90b
Sep 08 00:05:24.685158 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:24.685117    2580 generic.go:356] "Generic (PLEG): container finished" podID="4c56d85f-07a9-46bd-a7ca-a03ddf1a4317" containerID="f40fac0ae5ba75894a0fe3fd30ba845f00de5327162d9d67a2fe9ea866ae5db8" exitCode=0
Sep 08 00:05:24.685649 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:24.685212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerDied","Data":"f40fac0ae5ba75894a0fe3fd30ba845f00de5327162d9d67a2fe9ea866ae5db8"}
Sep 08 00:05:24.685649 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:24.685294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerStarted","Data":"ea37b2d800beda51d1e2ebcc3744efdd63647848262992523b5b4270bc26d90b"}
Sep 08 00:05:25.694436 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:25.694395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerStarted","Data":"f985aed8d3e3b47a0fbbd5725480a61cb1f47a1c10b09bfd4d2682af71a9a61b"}
Sep 08 00:05:25.694777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:25.694510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerStarted","Data":"7883452e993c7dff2623da915f63264d29c9e42293a3ec33fbb030b478bb90dc"}
Sep 08 00:05:25.694777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:25.694554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerStarted","Data":"fe243508018ef141835177c6736111e736a4e5e2fccb9802733656e65989f345"}
Sep 08 00:05:25.694777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:25.694589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerStarted","Data":"e41aa23493a8223f07e6d2a1e830cac9a014ad18168e5a402884609fd5a87431"}
Sep 08 00:05:25.694777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:25.694623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerStarted","Data":"7a7494796941d256664bb912758b20773d5f692cabd115274a5df9935cb9e416"}
Sep 08 00:05:25.694777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:25.694659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c56d85f-07a9-46bd-a7ca-a03ddf1a4317","Type":"ContainerStarted","Data":"61ee3d6b57cac2bf1a21fe8e3adc9ff999600c6cd335150b9fbe8400ac95d5f8"}
Sep 08 00:05:25.716779 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:25.716734    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.696207127 podStartE2EDuration="2.71671958s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.512453ms" isStatefulPod=false podCreationTimestamp="2026-09-08 00:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:05:25.715769071 +0000 UTC m=+166.201197679" watchObservedRunningTime="2026-09-08 00:05:25.71671958 +0000 UTC m=+166.202148188"
Sep 08 00:05:26.162262 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.162221    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6884dff746-42vxq"]
Sep 08 00:05:26.164741 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.164712    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.167104 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.167076    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 00:05:26.167237 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.167100    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 00:05:26.167361 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.167329    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 00:05:26.167627 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.167609    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 00:05:26.167726 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.167708    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 00:05:26.168048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.168023    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r8ntt\""
Sep 08 00:05:26.172600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.172582    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 00:05:26.177669 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.177643    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6884dff746-42vxq"]
Sep 08 00:05:26.240577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-serving-certs-ca-bundle\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.240746 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-telemeter-client-tls\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.240746 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-metrics-client-ca\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.240746 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.240847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-federate-client-tls\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.240847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240806    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.240906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-secret-telemeter-client\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.240906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.240895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sqrw\" (UniqueName: \"kubernetes.io/projected/ab6405e7-87b3-41e7-9362-6cf0686623e2-kube-api-access-8sqrw\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342062 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-federate-client-tls\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342234 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342234 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-secret-telemeter-client\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342234 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqrw\" (UniqueName: \"kubernetes.io/projected/ab6405e7-87b3-41e7-9362-6cf0686623e2-kube-api-access-8sqrw\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342234 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-serving-certs-ca-bundle\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342483 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-telemeter-client-tls\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342483 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-metrics-client-ca\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.342483 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.343024 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.342995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-serving-certs-ca-bundle\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.343152 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.343043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-metrics-client-ca\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.343371 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.343330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6405e7-87b3-41e7-9362-6cf0686623e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.344770 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.344742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-federate-client-tls\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.344961 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.344937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-telemeter-client-tls\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.345085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.345070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.345294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.345277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ab6405e7-87b3-41e7-9362-6cf0686623e2-secret-telemeter-client\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.350290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.350267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sqrw\" (UniqueName: \"kubernetes.io/projected/ab6405e7-87b3-41e7-9362-6cf0686623e2-kube-api-access-8sqrw\") pod \"telemeter-client-6884dff746-42vxq\" (UID: \"ab6405e7-87b3-41e7-9362-6cf0686623e2\") " pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.476886 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.476798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6884dff746-42vxq"
Sep 08 00:05:26.768454 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:26.768355    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6884dff746-42vxq"]
Sep 08 00:05:26.772680 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:05:26.772620    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6405e7_87b3_41e7_9362_6cf0686623e2.slice/crio-2035788b81113f2d2e8e3a9f04338fa9833677ef0a2d00fc4f3432dc5bf2c167 WatchSource:0}: Error finding container 2035788b81113f2d2e8e3a9f04338fa9833677ef0a2d00fc4f3432dc5bf2c167: Status 404 returned error can't find the container with id 2035788b81113f2d2e8e3a9f04338fa9833677ef0a2d00fc4f3432dc5bf2c167
Sep 08 00:05:27.708834 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:27.708794    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6884dff746-42vxq" event={"ID":"ab6405e7-87b3-41e7-9362-6cf0686623e2","Type":"ContainerStarted","Data":"2035788b81113f2d2e8e3a9f04338fa9833677ef0a2d00fc4f3432dc5bf2c167"}
Sep 08 00:05:28.716134 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:28.716099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6884dff746-42vxq" event={"ID":"ab6405e7-87b3-41e7-9362-6cf0686623e2","Type":"ContainerStarted","Data":"6930e8faaa587c93f69966f078b9f92082fa7a28d0840e0132856586e1601da2"}
Sep 08 00:05:28.716600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:28.716156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6884dff746-42vxq" event={"ID":"ab6405e7-87b3-41e7-9362-6cf0686623e2","Type":"ContainerStarted","Data":"cdf12adf45e5c7a2fa77b688a7db8c91f6c5ccbae62e56ae4fcccaefb00c3576"}
Sep 08 00:05:28.716600 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:28.716175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6884dff746-42vxq" event={"ID":"ab6405e7-87b3-41e7-9362-6cf0686623e2","Type":"ContainerStarted","Data":"ec5e88780ecccd547cddfd5bab00ac3bd4fbec5fb25f460267ca2e8824d99f8c"}
Sep 08 00:05:28.734284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:28.734221    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6884dff746-42vxq" podStartSLOduration=0.996072847 podStartE2EDuration="2.734205505s" totalImagesPullingTime="1.738132658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:05:28.733408051 +0000 UTC m=+169.218836670" watchObservedRunningTime="2026-09-08 00:05:28.734205505 +0000 UTC m=+169.219634113"
Sep 08 00:05:28.864653 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:28.864551    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:05:39.763964 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:39.763891    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5864968fc5-9shh8"]
Sep 08 00:05:39.863858 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:39.863825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:05:39.912701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:05:39.912675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:04.783609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:04.783558    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5864968fc5-9shh8" podUID="f6f8ed3a-0f67-400b-95d6-fe42de5543fd" containerName="console" containerID="cri-o://7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df" gracePeriod=15
Sep 08 00:06:05.028215 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.028189    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:06:05.067251 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067182    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-service-ca\") pod \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") "
Sep 08 00:06:05.067251 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067225    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-serving-cert\") pod \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") "
Sep 08 00:06:05.067251 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-config\") pod \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") "
Sep 08 00:06:05.067503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067273    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-oauth-serving-cert\") pod \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") "
Sep 08 00:06:05.067503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-oauth-config\") pod \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") "
Sep 08 00:06:05.067503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067366    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-trusted-ca-bundle\") pod \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") "
Sep 08 00:06:05.067503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfnp2\" (UniqueName: \"kubernetes.io/projected/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-kube-api-access-xfnp2\") pod \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\" (UID: \"f6f8ed3a-0f67-400b-95d6-fe42de5543fd\") "
Sep 08 00:06:05.067777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067638    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6f8ed3a-0f67-400b-95d6-fe42de5543fd" (UID: "f6f8ed3a-0f67-400b-95d6-fe42de5543fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:06:05.067777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067648    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-config" (OuterVolumeSpecName: "console-config") pod "f6f8ed3a-0f67-400b-95d6-fe42de5543fd" (UID: "f6f8ed3a-0f67-400b-95d6-fe42de5543fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:06:05.067900 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6f8ed3a-0f67-400b-95d6-fe42de5543fd" (UID: "f6f8ed3a-0f67-400b-95d6-fe42de5543fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:06:05.067946 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.067874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6f8ed3a-0f67-400b-95d6-fe42de5543fd" (UID: "f6f8ed3a-0f67-400b-95d6-fe42de5543fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:06:05.069727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.069703    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6f8ed3a-0f67-400b-95d6-fe42de5543fd" (UID: "f6f8ed3a-0f67-400b-95d6-fe42de5543fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:06:05.069822 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.069760    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6f8ed3a-0f67-400b-95d6-fe42de5543fd" (UID: "f6f8ed3a-0f67-400b-95d6-fe42de5543fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:06:05.069822 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.069770    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-kube-api-access-xfnp2" (OuterVolumeSpecName: "kube-api-access-xfnp2") pod "f6f8ed3a-0f67-400b-95d6-fe42de5543fd" (UID: "f6f8ed3a-0f67-400b-95d6-fe42de5543fd"). InnerVolumeSpecName "kube-api-access-xfnp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:06:05.168111 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.168083    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:06:05.168111 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.168108    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-serving-cert\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:06:05.168111 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.168117    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-config\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:06:05.168324 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.168127    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-oauth-serving-cert\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:06:05.168324 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.168141    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-console-oauth-config\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:06:05.168324 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.168152    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-trusted-ca-bundle\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:06:05.168324 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.168160    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfnp2\" (UniqueName: \"kubernetes.io/projected/f6f8ed3a-0f67-400b-95d6-fe42de5543fd-kube-api-access-xfnp2\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:06:05.857982 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.857942    2580 generic.go:356] "Generic (PLEG): container finished" podID="f6f8ed3a-0f67-400b-95d6-fe42de5543fd" containerID="7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df" exitCode=0
Sep 08 00:06:05.858527 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.857987    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5864968fc5-9shh8"
Sep 08 00:06:05.858527 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.858032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5864968fc5-9shh8" event={"ID":"f6f8ed3a-0f67-400b-95d6-fe42de5543fd","Type":"ContainerDied","Data":"7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df"}
Sep 08 00:06:05.858527 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.858126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5864968fc5-9shh8" event={"ID":"f6f8ed3a-0f67-400b-95d6-fe42de5543fd","Type":"ContainerDied","Data":"ebded47a328eebdc540a85810fc6a9a05a2feb476fccb4feb661426a8333e34d"}
Sep 08 00:06:05.858527 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.858162    2580 scope.go:117] "RemoveContainer" containerID="7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df"
Sep 08 00:06:05.867141 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.867125    2580 scope.go:117] "RemoveContainer" containerID="7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df"
Sep 08 00:06:05.867424 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:06:05.867409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df\": container with ID starting with 7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df not found: ID does not exist" containerID="7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df"
Sep 08 00:06:05.867471 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.867432    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df"} err="failed to get container status \"7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df\": rpc error: code = NotFound desc = could not find container \"7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df\": container with ID starting with 7a53012f18266a09681183fe3f662837162d5af6ae7be6052b401a23e49747df not found: ID does not exist"
Sep 08 00:06:05.879093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.879072    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5864968fc5-9shh8"]
Sep 08 00:06:05.881065 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.881044    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5864968fc5-9shh8"]
Sep 08 00:06:05.926437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:05.926400    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f8ed3a-0f67-400b-95d6-fe42de5543fd" path="/var/lib/kubelet/pods/f6f8ed3a-0f67-400b-95d6-fe42de5543fd/volumes"
Sep 08 00:06:24.381092 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:24.381059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:36.327177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:36.327138    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:36.384469 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:36.384431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:44.830072 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:44.830032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:45.180825 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:45.180797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:45.233506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:45.233480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:45.788332 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:45.788296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:45.889288 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:45.889255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:48.241845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:48.241789    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:48.293954 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:48.293917    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:53.444468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:53.444431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:53.543245 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:53.543217    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:55.055894 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:55.055854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:56.160661 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:56.160624    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:56.262030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:56.261988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:06:56.308992 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:06:56.308960    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:07:38.443989 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:07:38.443954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:07:39.848945 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:07:39.848915    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 00:07:52.354213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:07:52.354176    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:07:53.476535 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:07:53.476494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:13.861833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:13.861797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:14.640623 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:14.640578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:17.456572 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:17.456524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:17.509040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:17.509011    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:18.767446 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:18.767414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:18.896480 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:18.896444    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:21.155223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:21.155196    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:21.361279 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:21.361249    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:24.257124 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:24.257088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:24.307794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:24.307760    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:27.133426 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.133393    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"]
Sep 08 00:08:27.133814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.133684    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f8ed3a-0f67-400b-95d6-fe42de5543fd" containerName="console"
Sep 08 00:08:27.133814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.133695    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f8ed3a-0f67-400b-95d6-fe42de5543fd" containerName="console"
Sep 08 00:08:27.133814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.133752    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f8ed3a-0f67-400b-95d6-fe42de5543fd" containerName="console"
Sep 08 00:08:27.136636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.136620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.138602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.138579    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 00:08:27.138734 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.138622    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hs6d4\""
Sep 08 00:08:27.139266 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.139248    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 00:08:27.143523 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.143183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"]
Sep 08 00:08:27.177837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.177806    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99935ab2-fb2c-4c9b-ad67-122875eb716c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jpcvm\" (UID: \"99935ab2-fb2c-4c9b-ad67-122875eb716c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.177837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.177837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mss\" (UniqueName: \"kubernetes.io/projected/99935ab2-fb2c-4c9b-ad67-122875eb716c-kube-api-access-g7mss\") pod \"cert-manager-cainjector-559cdd8c87-jpcvm\" (UID: \"99935ab2-fb2c-4c9b-ad67-122875eb716c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.278641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.278606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99935ab2-fb2c-4c9b-ad67-122875eb716c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jpcvm\" (UID: \"99935ab2-fb2c-4c9b-ad67-122875eb716c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.278641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.278640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mss\" (UniqueName: \"kubernetes.io/projected/99935ab2-fb2c-4c9b-ad67-122875eb716c-kube-api-access-g7mss\") pod \"cert-manager-cainjector-559cdd8c87-jpcvm\" (UID: \"99935ab2-fb2c-4c9b-ad67-122875eb716c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.285823 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.285794    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99935ab2-fb2c-4c9b-ad67-122875eb716c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jpcvm\" (UID: \"99935ab2-fb2c-4c9b-ad67-122875eb716c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.285937 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.285839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mss\" (UniqueName: \"kubernetes.io/projected/99935ab2-fb2c-4c9b-ad67-122875eb716c-kube-api-access-g7mss\") pod \"cert-manager-cainjector-559cdd8c87-jpcvm\" (UID: \"99935ab2-fb2c-4c9b-ad67-122875eb716c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.445836 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.445806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"
Sep 08 00:08:27.712671 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.712591    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm"]
Sep 08 00:08:27.715773 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:08:27.715748    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99935ab2_fb2c_4c9b_ad67_122875eb716c.slice/crio-f25584ece409abf54ca87803d1d8818a569c5db3b99ecde104e53bbe0e1c4fcc WatchSource:0}: Error finding container f25584ece409abf54ca87803d1d8818a569c5db3b99ecde104e53bbe0e1c4fcc: Status 404 returned error can't find the container with id f25584ece409abf54ca87803d1d8818a569c5db3b99ecde104e53bbe0e1c4fcc
Sep 08 00:08:27.717742 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:27.717727    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:08:28.401564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:28.401499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm" event={"ID":"99935ab2-fb2c-4c9b-ad67-122875eb716c","Type":"ContainerStarted","Data":"f25584ece409abf54ca87803d1d8818a569c5db3b99ecde104e53bbe0e1c4fcc"}
Sep 08 00:08:28.569102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:28.568947    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:31.341456 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:31.341423    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:31.389883 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:31.389857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:31.414151 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:31.414127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm" event={"ID":"99935ab2-fb2c-4c9b-ad67-122875eb716c","Type":"ContainerStarted","Data":"501165013aee4073e5b9179b77f1cd8c05ab42838c0d72490c4689dc903aaf42"}
Sep 08 00:08:31.429988 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:31.429949    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jpcvm" podStartSLOduration=1.5808633680000002 podStartE2EDuration="4.429935166s" totalImagesPullingTime="2.849071798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:08:31.42883523 +0000 UTC m=+351.914263864" watchObservedRunningTime="2026-09-08 00:08:31.429935166 +0000 UTC m=+351.915363773"
Sep 08 00:08:34.669711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:34.669624    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:34.769758 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:34.769718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:36.988930 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:36.988891    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"]
Sep 08 00:08:36.992361 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:36.992318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:36.994330 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:36.994306    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 00:08:36.994916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:36.994897    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-crvmf\""
Sep 08 00:08:36.995023 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:36.994933    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:08:37.001781 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.001754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"]
Sep 08 00:08:37.061592 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.061556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c7aeb0-34fe-40eb-875d-193177d414e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lncj5\" (UID: \"49c7aeb0-34fe-40eb-875d-193177d414e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:37.061763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.061688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhz6h\" (UniqueName: \"kubernetes.io/projected/49c7aeb0-34fe-40eb-875d-193177d414e4-kube-api-access-qhz6h\") pod \"openshift-lws-operator-fd8ccff4c-lncj5\" (UID: \"49c7aeb0-34fe-40eb-875d-193177d414e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:37.163078 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.163043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c7aeb0-34fe-40eb-875d-193177d414e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lncj5\" (UID: \"49c7aeb0-34fe-40eb-875d-193177d414e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:37.163260 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.163107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhz6h\" (UniqueName: \"kubernetes.io/projected/49c7aeb0-34fe-40eb-875d-193177d414e4-kube-api-access-qhz6h\") pod \"openshift-lws-operator-fd8ccff4c-lncj5\" (UID: \"49c7aeb0-34fe-40eb-875d-193177d414e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:37.163524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.163499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c7aeb0-34fe-40eb-875d-193177d414e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lncj5\" (UID: \"49c7aeb0-34fe-40eb-875d-193177d414e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:37.170027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.170007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhz6h\" (UniqueName: \"kubernetes.io/projected/49c7aeb0-34fe-40eb-875d-193177d414e4-kube-api-access-qhz6h\") pod \"openshift-lws-operator-fd8ccff4c-lncj5\" (UID: \"49c7aeb0-34fe-40eb-875d-193177d414e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:37.302642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.302563    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"
Sep 08 00:08:37.570787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:37.570708    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5"]
Sep 08 00:08:37.573875 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:08:37.573843    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49c7aeb0_34fe_40eb_875d_193177d414e4.slice/crio-bebc6d673d8fc4bda18e2bca5efbaedada8d5a59a37a69c8118262e0d3750d61 WatchSource:0}: Error finding container bebc6d673d8fc4bda18e2bca5efbaedada8d5a59a37a69c8118262e0d3750d61: Status 404 returned error can't find the container with id bebc6d673d8fc4bda18e2bca5efbaedada8d5a59a37a69c8118262e0d3750d61
Sep 08 00:08:38.440543 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:38.440502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5" event={"ID":"49c7aeb0-34fe-40eb-875d-193177d414e4","Type":"ContainerStarted","Data":"bebc6d673d8fc4bda18e2bca5efbaedada8d5a59a37a69c8118262e0d3750d61"}
Sep 08 00:08:47.474599 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:47.474564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5" event={"ID":"49c7aeb0-34fe-40eb-875d-193177d414e4","Type":"ContainerStarted","Data":"048a6593c6d2862434c465c2a7f310a898232af96e94de18bd4e70a5b248a525"}
Sep 08 00:08:47.488994 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:47.488948    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lncj5" podStartSLOduration=2.065205862 podStartE2EDuration="11.488931655s" totalImagesPullingTime="9.423725793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:08:47.487711471 +0000 UTC m=+367.973140078" watchObservedRunningTime="2026-09-08 00:08:47.488931655 +0000 UTC m=+367.974360263"
Sep 08 00:08:48.185031 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:48.185001    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:48.282987 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:48.282956    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:08:50.255674 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:08:50.255628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:02.516247 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.516210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:02.550457 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.550422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"]
Sep 08 00:09:02.555538 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.555515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.557549 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.557524    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 00:09:02.557648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.557525    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 00:09:02.557922 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.557904    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 00:09:02.558009 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.557943    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-749nj\""
Sep 08 00:09:02.569578 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.569556    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"]
Sep 08 00:09:02.597871 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.597836    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:02.669179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.669140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2018ed44-52de-4102-a919-9bb671a399b8-metrics-cert\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.669179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.669185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljw4\" (UniqueName: \"kubernetes.io/projected/2018ed44-52de-4102-a919-9bb671a399b8-kube-api-access-6ljw4\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.669483 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.669308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2018ed44-52de-4102-a919-9bb671a399b8-manager-config\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.669483 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.669374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2018ed44-52de-4102-a919-9bb671a399b8-cert\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.770080 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.769980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2018ed44-52de-4102-a919-9bb671a399b8-metrics-cert\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.770080 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.770024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljw4\" (UniqueName: \"kubernetes.io/projected/2018ed44-52de-4102-a919-9bb671a399b8-kube-api-access-6ljw4\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.770319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.770098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2018ed44-52de-4102-a919-9bb671a399b8-manager-config\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.770319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.770134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2018ed44-52de-4102-a919-9bb671a399b8-cert\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.770828 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.770804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2018ed44-52de-4102-a919-9bb671a399b8-manager-config\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.772744 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.772724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2018ed44-52de-4102-a919-9bb671a399b8-cert\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.772917 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.772897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2018ed44-52de-4102-a919-9bb671a399b8-metrics-cert\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.783962 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.783930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljw4\" (UniqueName: \"kubernetes.io/projected/2018ed44-52de-4102-a919-9bb671a399b8-kube-api-access-6ljw4\") pod \"lws-controller-manager-c54b7b87b-56t2j\" (UID: \"2018ed44-52de-4102-a919-9bb671a399b8\") " pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:02.864713 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:02.864676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:03.134553 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:03.134424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"]
Sep 08 00:09:03.137696 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:09:03.137667    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2018ed44_52de_4102_a919_9bb671a399b8.slice/crio-f3e2a5c994c7ca1bb7b11a17fccc45c877db2140dfd33c9b3222aa93500d8d12 WatchSource:0}: Error finding container f3e2a5c994c7ca1bb7b11a17fccc45c877db2140dfd33c9b3222aa93500d8d12: Status 404 returned error can't find the container with id f3e2a5c994c7ca1bb7b11a17fccc45c877db2140dfd33c9b3222aa93500d8d12
Sep 08 00:09:03.536817 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:03.536782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j" event={"ID":"2018ed44-52de-4102-a919-9bb671a399b8","Type":"ContainerStarted","Data":"f3e2a5c994c7ca1bb7b11a17fccc45c877db2140dfd33c9b3222aa93500d8d12"}
Sep 08 00:09:05.547302 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:05.547263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j" event={"ID":"2018ed44-52de-4102-a919-9bb671a399b8","Type":"ContainerStarted","Data":"04f92fcebb11714b4098bafc53d6730879935b6aef7287bb76b332ad256b54e0"}
Sep 08 00:09:05.547691 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:05.547338    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:05.563736 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:05.563681    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j" podStartSLOduration=1.655737061 podStartE2EDuration="3.56366556s" totalImagesPullingTime="1.907928499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:05.561886054 +0000 UTC m=+386.047314663" watchObservedRunningTime="2026-09-08 00:09:05.56366556 +0000 UTC m=+386.049094167"
Sep 08 00:09:08.272113 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:08.272078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:08.322874 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:08.322840    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:14.282560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:14.282530    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:14.392751 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:14.392704    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:14.818025 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:14.817977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:14.962056 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:14.962020    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.067993 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.067944    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.151022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.150986    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"]
Sep 08 00:09:15.154529 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.154501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.157491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.157448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 00:09:15.157622 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.157542    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 00:09:15.157622 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.157587    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 00:09:15.158523 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.158508    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 00:09:15.158944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.158930    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-flzw7\""
Sep 08 00:09:15.170736 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.170714    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"]
Sep 08 00:09:15.244418 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.244388    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.272145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.272121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vft4d\" (UniqueName: \"kubernetes.io/projected/4b74d374-d28d-429f-86ad-8851ec50f221-kube-api-access-vft4d\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.272261 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.272169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b74d374-d28d-429f-86ad-8851ec50f221-tmp\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.272261 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.272210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b74d374-d28d-429f-86ad-8851ec50f221-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.272261 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.272253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b74d374-d28d-429f-86ad-8851ec50f221-manifests\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.272403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.272302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b74d374-d28d-429f-86ad-8851ec50f221-webhook-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.351681 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.351652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.373004 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.372980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b74d374-d28d-429f-86ad-8851ec50f221-tmp\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.373104 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.373010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b74d374-d28d-429f-86ad-8851ec50f221-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.373104 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.373043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b74d374-d28d-429f-86ad-8851ec50f221-manifests\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.373104 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.373085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b74d374-d28d-429f-86ad-8851ec50f221-webhook-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.373213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.373130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft4d\" (UniqueName: \"kubernetes.io/projected/4b74d374-d28d-429f-86ad-8851ec50f221-kube-api-access-vft4d\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.373596 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.373573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b74d374-d28d-429f-86ad-8851ec50f221-manifests\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.375332 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.375311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b74d374-d28d-429f-86ad-8851ec50f221-tmp\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.375586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.375567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b74d374-d28d-429f-86ad-8851ec50f221-webhook-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.375678 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.375626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b74d374-d28d-429f-86ad-8851ec50f221-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.379403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.379386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vft4d\" (UniqueName: \"kubernetes.io/projected/4b74d374-d28d-429f-86ad-8851ec50f221-kube-api-access-vft4d\") pod \"opendatahub-operator-controller-manager-57cf67b67f-srvgh\" (UID: \"4b74d374-d28d-429f-86ad-8851ec50f221\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.446956 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.446884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.464101 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.464080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:15.545975 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.545940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.647404 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.647374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.711299 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.711223    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:15.736669 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:15.736644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"]
Sep 08 00:09:15.740434 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:09:15.740407    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b74d374_d28d_429f_86ad_8851ec50f221.slice/crio-615b0b0609cae6f6e3b0c1ae7b423519508d9a783be9cac327a0709840d9974e WatchSource:0}: Error finding container 615b0b0609cae6f6e3b0c1ae7b423519508d9a783be9cac327a0709840d9974e: Status 404 returned error can't find the container with id 615b0b0609cae6f6e3b0c1ae7b423519508d9a783be9cac327a0709840d9974e
Sep 08 00:09:16.553330 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:16.553298    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c54b7b87b-56t2j"
Sep 08 00:09:16.602119 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:16.602079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh" event={"ID":"4b74d374-d28d-429f-86ad-8851ec50f221","Type":"ContainerStarted","Data":"615b0b0609cae6f6e3b0c1ae7b423519508d9a783be9cac327a0709840d9974e"}
Sep 08 00:09:18.875453 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:18.875420    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:18.976049 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:18.976015    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:19.080865 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:19.080786    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:19.178495 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:19.178448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:19.617512 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:19.617477    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh" event={"ID":"4b74d374-d28d-429f-86ad-8851ec50f221","Type":"ContainerStarted","Data":"40b2f09c5ef94f2e1a813bee45f92b9a676986402e71f6b42a9356d5addff685"}
Sep 08 00:09:20.623361 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:20.623320    2580 generic.go:356] "Generic (PLEG): container finished" podID="4b74d374-d28d-429f-86ad-8851ec50f221" containerID="40b2f09c5ef94f2e1a813bee45f92b9a676986402e71f6b42a9356d5addff685" exitCode=0
Sep 08 00:09:20.623753 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:20.623373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh" event={"ID":"4b74d374-d28d-429f-86ad-8851ec50f221","Type":"ContainerDied","Data":"40b2f09c5ef94f2e1a813bee45f92b9a676986402e71f6b42a9356d5addff685"}
Sep 08 00:09:21.630127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:21.630091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh" event={"ID":"4b74d374-d28d-429f-86ad-8851ec50f221","Type":"ContainerStarted","Data":"49455df6c1d4bfdaa8dcb54fa229c462ab3cd39502f9755fcaffeb43e2ef27ef"}
Sep 08 00:09:21.630622 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:21.630223    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:21.646986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:21.646938    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh" podStartSLOduration=2.093175317 podStartE2EDuration="6.646923704s" totalImagesPullingTime="3.509503475s" totalInitContainerRuntime="1.044244912s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:21.646081603 +0000 UTC m=+402.131510215" watchObservedRunningTime="2026-09-08 00:09:21.646923704 +0000 UTC m=+402.132352369"
Sep 08 00:09:32.636104 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:32.636067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-srvgh"
Sep 08 00:09:34.386576 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.386538    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:34.543658 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.543619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:34.769920 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.769885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:34.831150 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.831119    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"]
Sep 08 00:09:34.834513 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.834492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:34.836734 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.836712    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 00:09:34.837260 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.837238    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 00:09:34.837366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.837238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 00:09:34.837366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.837240    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v6zxp\""
Sep 08 00:09:34.837366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.837293    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 00:09:34.847228 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.847204    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"]
Sep 08 00:09:34.946851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.946807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:34.947040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.946941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tmp\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:34.947040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:34.947000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-kube-api-access-kkvjq\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.048126 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.048038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tmp\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.048126 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.048119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-kube-api-access-kkvjq\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.048326 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.048166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.048326 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:09:35.048301    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 08 00:09:35.048445 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:09:35.048396    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tls-certs podName:6eefd064-0ed2-4fd1-b43e-03d5086ec8b2 nodeName:}" failed. No retries permitted until 2026-09-08 00:09:35.548374454 +0000 UTC m=+416.033803047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tls-certs") pod "kube-auth-proxy-b9b857bf8-n8lp7" (UID: "6eefd064-0ed2-4fd1-b43e-03d5086ec8b2") : secret "kube-auth-proxy-tls" not found
Sep 08 00:09:35.050309 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.050291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tmp\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.055800 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.055773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-kube-api-access-kkvjq\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.226340 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.226304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:35.554199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.554155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.556587 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.556558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eefd064-0ed2-4fd1-b43e-03d5086ec8b2-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-n8lp7\" (UID: \"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:35.744361 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:35.744318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"
Sep 08 00:09:36.017332 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:36.017295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7"]
Sep 08 00:09:36.020604 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:09:36.020572    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eefd064_0ed2_4fd1_b43e_03d5086ec8b2.slice/crio-57640be3afa804415816c10de571752b26600da998c62b1766c3254df8deb5c6 WatchSource:0}: Error finding container 57640be3afa804415816c10de571752b26600da998c62b1766c3254df8deb5c6: Status 404 returned error can't find the container with id 57640be3afa804415816c10de571752b26600da998c62b1766c3254df8deb5c6
Sep 08 00:09:36.043891 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:36.043861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:36.101645 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:36.101616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:36.695778 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:36.695734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7" event={"ID":"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2","Type":"ContainerStarted","Data":"57640be3afa804415816c10de571752b26600da998c62b1766c3254df8deb5c6"}
Sep 08 00:09:36.836421 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:36.836382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:39.711403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:39.711366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7" event={"ID":"6eefd064-0ed2-4fd1-b43e-03d5086ec8b2","Type":"ContainerStarted","Data":"742ce353884f17110327cd7fcb6b65fc254f6fef8f6b1dd7d583df65a7eff37e"}
Sep 08 00:09:39.725636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:39.725587    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-n8lp7" podStartSLOduration=3.002568975 podStartE2EDuration="5.725573642s" totalImagesPullingTime="2.723004667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:39.72398336 +0000 UTC m=+420.209411979" watchObservedRunningTime="2026-09-08 00:09:39.725573642 +0000 UTC m=+420.211002250"
Sep 08 00:09:41.966255 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:41.966220    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:42.026919 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:42.026862    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:42.532541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:42.532508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:42.763410 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:42.763363    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:42.879267 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:42.879155    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:45.727857 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:45.727819    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:45.827241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:45.827208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:45.927531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:45.927502    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:46.028672 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:46.028570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:46.221628 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:46.221593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:46.635119 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:46.635082    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:55.160398 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:55.160365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:55.241830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:55.241797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:55.368856 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:55.368827    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:55.588200 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:55.588117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:56.403294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:56.403256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:56.504460 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:56.504427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:09:56.557005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:09:56.556970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:01.801226 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:01.801189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:01.899462 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:01.899426    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:03.533544 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:03.533435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:03.634005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:03.633952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:14.391114 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:14.391079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:23.433896 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:23.433861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:46.500700 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:46.500661    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:10:46.597250 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:10:46.597211    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:05.248213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:05.248179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:05.995935 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:05.995896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:09.042211 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:09.042179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:09.208403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:09.208372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:11.239321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:11.239288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:11.414719 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:11.414684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:13.408105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:13.408069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:13.635537 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:13.635497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:13.821633 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:13.821558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:14.404249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:14.404205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:15.046051 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:15.046016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:15.152712 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:15.152677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:19.008955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:19.008918    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:19.109279 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:19.109245    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:19.601473 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:19.601437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:19.702234 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:19.702204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:23.011563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:23.011532    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:23.110953 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:23.110920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:24.617116 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:24.617076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:24.721431 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:24.721395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:24.864711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:24.864679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:25.027643 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:25.027613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:30.945527 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:30.945488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:31.045108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:31.045041    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:31.098792 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:31.098759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:34.415692 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.415612    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"]
Sep 08 00:11:34.418287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.418270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:34.420274 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.420246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lf292\""
Sep 08 00:11:34.420419 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.420255    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 00:11:34.420419 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.420307    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 00:11:34.434013 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.433982    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"]
Sep 08 00:11:34.551034 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.550997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4ll2\" (UniqueName: \"kubernetes.io/projected/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-kube-api-access-q4ll2\") pod \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:34.551034 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.551039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:34.651806 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.651758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4ll2\" (UniqueName: \"kubernetes.io/projected/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-kube-api-access-q4ll2\") pod \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:34.651806 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.651806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:34.652138 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.652124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:34.667969 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.667894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4ll2\" (UniqueName: \"kubernetes.io/projected/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-kube-api-access-q4ll2\") pod \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:34.728239 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:34.728200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:35.006158 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.006130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"]
Sep 08 00:11:35.008975 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:11:35.008946    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9523ac_4b53_44b7_a7b3_0d8daa23f189.slice/crio-5efad350f1e7e226fdb8571f20e68e64ad36164c5a61d4929d525158eb308afd WatchSource:0}: Error finding container 5efad350f1e7e226fdb8571f20e68e64ad36164c5a61d4929d525158eb308afd: Status 404 returned error can't find the container with id 5efad350f1e7e226fdb8571f20e68e64ad36164c5a61d4929d525158eb308afd
Sep 08 00:11:35.215255 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.215215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm" event={"ID":"ea9523ac-4b53-44b7-a7b3-0d8daa23f189","Type":"ContainerStarted","Data":"5efad350f1e7e226fdb8571f20e68e64ad36164c5a61d4929d525158eb308afd"}
Sep 08 00:11:35.385046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.384970    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"]
Sep 08 00:11:35.395048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.395022    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"]
Sep 08 00:11:35.406508 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.406482    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"]
Sep 08 00:11:35.409754 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.409734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:35.420213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.420188    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"]
Sep 08 00:11:35.560865 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.560815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nkhn\" (UniqueName: \"kubernetes.io/projected/b45081ae-db6f-4be8-90b9-e62d47182883-kube-api-access-9nkhn\") pod \"kuadrant-operator-controller-manager-96db98c47-s27wz\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:35.561055 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.560886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b45081ae-db6f-4be8-90b9-e62d47182883-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-s27wz\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:35.667157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.662552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nkhn\" (UniqueName: \"kubernetes.io/projected/b45081ae-db6f-4be8-90b9-e62d47182883-kube-api-access-9nkhn\") pod \"kuadrant-operator-controller-manager-96db98c47-s27wz\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:35.667157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.662644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b45081ae-db6f-4be8-90b9-e62d47182883-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-s27wz\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:35.667157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.663589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b45081ae-db6f-4be8-90b9-e62d47182883-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-s27wz\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:35.672299 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.672277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nkhn\" (UniqueName: \"kubernetes.io/projected/b45081ae-db6f-4be8-90b9-e62d47182883-kube-api-access-9nkhn\") pod \"kuadrant-operator-controller-manager-96db98c47-s27wz\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:35.723297 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:35.723265    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:36.000218 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:36.000002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"]
Sep 08 00:11:36.004027 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:11:36.003995    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45081ae_db6f_4be8_90b9_e62d47182883.slice/crio-f7442725a81ab7f75f76646db347c0d86a0ba2cf593c27a3f7909e9fe250ffd0 WatchSource:0}: Error finding container f7442725a81ab7f75f76646db347c0d86a0ba2cf593c27a3f7909e9fe250ffd0: Status 404 returned error can't find the container with id f7442725a81ab7f75f76646db347c0d86a0ba2cf593c27a3f7909e9fe250ffd0
Sep 08 00:11:36.223897 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:36.223852    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz" event={"ID":"b45081ae-db6f-4be8-90b9-e62d47182883","Type":"ContainerStarted","Data":"f7442725a81ab7f75f76646db347c0d86a0ba2cf593c27a3f7909e9fe250ffd0"}
Sep 08 00:11:38.981292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:38.981251    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:39.087382 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:39.087329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:39.619205 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:39.619145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:39.704562 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:39.704473    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:40.247246 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.247215    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" containerName="manager" containerID="cri-o://97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0" gracePeriod=2
Sep 08 00:11:40.249018 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:11:40.248980    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" is forbidden: User \"system:node:ip-10-0-136-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-92.ec2.internal' and this object" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:40.481626 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.481599    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:40.483432 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:11:40.483374    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" is forbidden: User \"system:node:ip-10-0-136-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-92.ec2.internal' and this object" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:40.608099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.608061    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4ll2\" (UniqueName: \"kubernetes.io/projected/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-kube-api-access-q4ll2\") pod \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") "
Sep 08 00:11:40.608292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.608169    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-extensions-socket-volume\") pod \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\" (UID: \"ea9523ac-4b53-44b7-a7b3-0d8daa23f189\") "
Sep 08 00:11:40.614215 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.608657    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ea9523ac-4b53-44b7-a7b3-0d8daa23f189" (UID: "ea9523ac-4b53-44b7-a7b3-0d8daa23f189"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:11:40.614923 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.614889    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-kube-api-access-q4ll2" (OuterVolumeSpecName: "kube-api-access-q4ll2") pod "ea9523ac-4b53-44b7-a7b3-0d8daa23f189" (UID: "ea9523ac-4b53-44b7-a7b3-0d8daa23f189"). InnerVolumeSpecName "kube-api-access-q4ll2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:11:40.709451 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.709406    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4ll2\" (UniqueName: \"kubernetes.io/projected/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-kube-api-access-q4ll2\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:11:40.709451 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:40.709443    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea9523ac-4b53-44b7-a7b3-0d8daa23f189-extensions-socket-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:11:41.253286 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.253248    2580 generic.go:356] "Generic (PLEG): container finished" podID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" containerID="97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0" exitCode=2
Sep 08 00:11:41.253719 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.253294    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:41.253719 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.253371    2580 scope.go:117] "RemoveContainer" containerID="97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0"
Sep 08 00:11:41.255150 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.255122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz" event={"ID":"b45081ae-db6f-4be8-90b9-e62d47182883","Type":"ContainerStarted","Data":"33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07"}
Sep 08 00:11:41.255310 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.255174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:41.255404 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:11:41.255358    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" is forbidden: User \"system:node:ip-10-0-136-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-92.ec2.internal' and this object" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:41.257092 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:11:41.257064    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" is forbidden: User \"system:node:ip-10-0-136-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-92.ec2.internal' and this object" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:41.262850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.262833    2580 scope.go:117] "RemoveContainer" containerID="97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0"
Sep 08 00:11:41.263109 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:11:41.263090    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0\": container with ID starting with 97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0 not found: ID does not exist" containerID="97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0"
Sep 08 00:11:41.263154 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.263117    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0"} err="failed to get container status \"97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0\": rpc error: code = NotFound desc = could not find container \"97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0\": container with ID starting with 97caf44db0ea1b189a8ef80663d2cfd0b51afde171c93c8b7d36f30266565cc0 not found: ID does not exist"
Sep 08 00:11:41.276178 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:11:41.276151    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-jkvpm\" is forbidden: User \"system:node:ip-10-0-136-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-92.ec2.internal' and this object" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jkvpm"
Sep 08 00:11:41.276466 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.276424    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz" podStartSLOduration=2.049872268 podStartE2EDuration="6.276410397s" totalImagesPullingTime="4.226538129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:41.274337055 +0000 UTC m=+541.759765667" watchObservedRunningTime="2026-09-08 00:11:41.276410397 +0000 UTC m=+541.761839016"
Sep 08 00:11:41.926148 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:41.926117    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" path="/var/lib/kubelet/pods/ea9523ac-4b53-44b7-a7b3-0d8daa23f189/volumes"
Sep 08 00:11:42.970450 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:42.970414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:43.071079 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:43.071046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:45.215134 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:45.215100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:45.315425 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:45.315375    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:50.960755 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:50.960703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:51.057560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:51.057509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:51.158605 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:51.158570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:52.263526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:52.263491    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:11:52.690831 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:52.690796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:56.779002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:56.778959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:11:56.879468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:11:56.879426    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:04.710391 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:04.710340    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"]
Sep 08 00:12:04.710767 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:04.710583    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz" podUID="b45081ae-db6f-4be8-90b9-e62d47182883" containerName="manager" containerID="cri-o://33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07" gracePeriod=10
Sep 08 00:12:04.953085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:04.953061    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:12:04.997315 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:04.997244    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nkhn\" (UniqueName: \"kubernetes.io/projected/b45081ae-db6f-4be8-90b9-e62d47182883-kube-api-access-9nkhn\") pod \"b45081ae-db6f-4be8-90b9-e62d47182883\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") "
Sep 08 00:12:04.997315 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:04.997286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b45081ae-db6f-4be8-90b9-e62d47182883-extensions-socket-volume\") pod \"b45081ae-db6f-4be8-90b9-e62d47182883\" (UID: \"b45081ae-db6f-4be8-90b9-e62d47182883\") "
Sep 08 00:12:04.997788 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:04.997760    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45081ae-db6f-4be8-90b9-e62d47182883-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b45081ae-db6f-4be8-90b9-e62d47182883" (UID: "b45081ae-db6f-4be8-90b9-e62d47182883"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:12:04.999425 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:04.999402    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45081ae-db6f-4be8-90b9-e62d47182883-kube-api-access-9nkhn" (OuterVolumeSpecName: "kube-api-access-9nkhn") pod "b45081ae-db6f-4be8-90b9-e62d47182883" (UID: "b45081ae-db6f-4be8-90b9-e62d47182883"). InnerVolumeSpecName "kube-api-access-9nkhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:12:05.098396 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.098338    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nkhn\" (UniqueName: \"kubernetes.io/projected/b45081ae-db6f-4be8-90b9-e62d47182883-kube-api-access-9nkhn\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:05.098396 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.098394    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b45081ae-db6f-4be8-90b9-e62d47182883-extensions-socket-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:05.363376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.363273    2580 generic.go:356] "Generic (PLEG): container finished" podID="b45081ae-db6f-4be8-90b9-e62d47182883" containerID="33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07" exitCode=0
Sep 08 00:12:05.363376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.363320    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"
Sep 08 00:12:05.363376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.363336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz" event={"ID":"b45081ae-db6f-4be8-90b9-e62d47182883","Type":"ContainerDied","Data":"33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07"}
Sep 08 00:12:05.363631 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.363415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz" event={"ID":"b45081ae-db6f-4be8-90b9-e62d47182883","Type":"ContainerDied","Data":"f7442725a81ab7f75f76646db347c0d86a0ba2cf593c27a3f7909e9fe250ffd0"}
Sep 08 00:12:05.363631 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.363443    2580 scope.go:117] "RemoveContainer" containerID="33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07"
Sep 08 00:12:05.372316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.372297    2580 scope.go:117] "RemoveContainer" containerID="33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07"
Sep 08 00:12:05.372613 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:05.372594    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07\": container with ID starting with 33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07 not found: ID does not exist" containerID="33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07"
Sep 08 00:12:05.372670 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.372621    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07"} err="failed to get container status \"33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07\": rpc error: code = NotFound desc = could not find container \"33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07\": container with ID starting with 33fdc2677ad0a27a831d1e176054be0f53a65e1c14cf9327a2b85fb30333ee07 not found: ID does not exist"
Sep 08 00:12:05.383491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.383470    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"]
Sep 08 00:12:05.392072 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.392052    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-s27wz"]
Sep 08 00:12:05.926399 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:05.926364    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45081ae-db6f-4be8-90b9-e62d47182883" path="/var/lib/kubelet/pods/b45081ae-db6f-4be8-90b9-e62d47182883/volumes"
Sep 08 00:12:08.640466 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:08.640428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:08.691759 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:08.691724    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:21.259488 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.259452    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"]
Sep 08 00:12:21.259879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.259763    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45081ae-db6f-4be8-90b9-e62d47182883" containerName="manager"
Sep 08 00:12:21.259879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.259775    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45081ae-db6f-4be8-90b9-e62d47182883" containerName="manager"
Sep 08 00:12:21.259879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.259801    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" containerName="manager"
Sep 08 00:12:21.259879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.259806    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" containerName="manager"
Sep 08 00:12:21.259879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.259852    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45081ae-db6f-4be8-90b9-e62d47182883" containerName="manager"
Sep 08 00:12:21.259879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.259861    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9523ac-4b53-44b7-a7b3-0d8daa23f189" containerName="manager"
Sep 08 00:12:21.262491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.262475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.268370 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.264397    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 00:12:21.268370 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.264775    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 00:12:21.268370 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.265207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xbkxf\""
Sep 08 00:12:21.268370 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.265601    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 00:12:21.272909 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.272881    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"]
Sep 08 00:12:21.274360 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.274318    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:21.333488 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.333457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6jg4\" (UniqueName: \"kubernetes.io/projected/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-kube-api-access-j6jg4\") pod \"limitador-limitador-859c4d96d6-t4k2f\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.333629 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.333576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-config-file\") pod \"limitador-limitador-859c4d96d6-t4k2f\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.358493 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.358458    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"]
Sep 08 00:12:21.360957 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.360933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:21.414944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.414915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:21.434851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.434825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-config-file\") pod \"limitador-limitador-859c4d96d6-t4k2f\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.434954 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.434887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6jg4\" (UniqueName: \"kubernetes.io/projected/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-kube-api-access-j6jg4\") pod \"limitador-limitador-859c4d96d6-t4k2f\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.435437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.435419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-config-file\") pod \"limitador-limitador-859c4d96d6-t4k2f\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.441521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.441499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6jg4\" (UniqueName: \"kubernetes.io/projected/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-kube-api-access-j6jg4\") pod \"limitador-limitador-859c4d96d6-t4k2f\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.575949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.575862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:21.844172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:21.844092    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"]
Sep 08 00:12:21.847130 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:12:21.847101    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e463bd5_6888_4f05_9d3e_0e11c4c30f26.slice/crio-2c8844ad101c174948b41af93fd99304137e845d1463d05389d7899a109a8073 WatchSource:0}: Error finding container 2c8844ad101c174948b41af93fd99304137e845d1463d05389d7899a109a8073: Status 404 returned error can't find the container with id 2c8844ad101c174948b41af93fd99304137e845d1463d05389d7899a109a8073
Sep 08 00:12:22.089878 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.089845    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-h5lbb"]
Sep 08 00:12:22.092807 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.092780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-h5lbb"
Sep 08 00:12:22.095101 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.095053    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jxs4b\""
Sep 08 00:12:22.103195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.103171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-h5lbb"]
Sep 08 00:12:22.133517 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.133491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:22.239159 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.239125    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:22.241109 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.241087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6962\" (UniqueName: \"kubernetes.io/projected/c1183f44-33fd-44d4-be87-a1fdf964dc42-kube-api-access-f6962\") pod \"authorino-b54df94b4-h5lbb\" (UID: \"c1183f44-33fd-44d4-be87-a1fdf964dc42\") " pod="kuadrant-system/authorino-b54df94b4-h5lbb"
Sep 08 00:12:22.259164 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.259137    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-g645n"]
Sep 08 00:12:22.261654 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.261639    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-g645n"
Sep 08 00:12:22.269060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.269036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-g645n"]
Sep 08 00:12:22.341769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.341731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6962\" (UniqueName: \"kubernetes.io/projected/c1183f44-33fd-44d4-be87-a1fdf964dc42-kube-api-access-f6962\") pod \"authorino-b54df94b4-h5lbb\" (UID: \"c1183f44-33fd-44d4-be87-a1fdf964dc42\") " pod="kuadrant-system/authorino-b54df94b4-h5lbb"
Sep 08 00:12:22.341986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.341810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tnhx\" (UniqueName: \"kubernetes.io/projected/fc4b031a-4d70-4a7f-9c81-8b9d276c2314-kube-api-access-7tnhx\") pod \"authorino-c548b5d7d-g645n\" (UID: \"fc4b031a-4d70-4a7f-9c81-8b9d276c2314\") " pod="kuadrant-system/authorino-c548b5d7d-g645n"
Sep 08 00:12:22.351134 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.351070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6962\" (UniqueName: \"kubernetes.io/projected/c1183f44-33fd-44d4-be87-a1fdf964dc42-kube-api-access-f6962\") pod \"authorino-b54df94b4-h5lbb\" (UID: \"c1183f44-33fd-44d4-be87-a1fdf964dc42\") " pod="kuadrant-system/authorino-b54df94b4-h5lbb"
Sep 08 00:12:22.403119 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.403083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-h5lbb"
Sep 08 00:12:22.438637 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.438601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f" event={"ID":"8e463bd5-6888-4f05-9d3e-0e11c4c30f26","Type":"ContainerStarted","Data":"2c8844ad101c174948b41af93fd99304137e845d1463d05389d7899a109a8073"}
Sep 08 00:12:22.443115 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.443085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tnhx\" (UniqueName: \"kubernetes.io/projected/fc4b031a-4d70-4a7f-9c81-8b9d276c2314-kube-api-access-7tnhx\") pod \"authorino-c548b5d7d-g645n\" (UID: \"fc4b031a-4d70-4a7f-9c81-8b9d276c2314\") " pod="kuadrant-system/authorino-c548b5d7d-g645n"
Sep 08 00:12:22.451140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.450827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tnhx\" (UniqueName: \"kubernetes.io/projected/fc4b031a-4d70-4a7f-9c81-8b9d276c2314-kube-api-access-7tnhx\") pod \"authorino-c548b5d7d-g645n\" (UID: \"fc4b031a-4d70-4a7f-9c81-8b9d276c2314\") " pod="kuadrant-system/authorino-c548b5d7d-g645n"
Sep 08 00:12:22.571003 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.570968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-g645n"
Sep 08 00:12:22.669977 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.669951    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-h5lbb"]
Sep 08 00:12:22.672241 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:12:22.672207    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1183f44_33fd_44d4_be87_a1fdf964dc42.slice/crio-58d996902f38ac2f4fd560b9020ec81edb50a927dc64454c65099756dfa2558f WatchSource:0}: Error finding container 58d996902f38ac2f4fd560b9020ec81edb50a927dc64454c65099756dfa2558f: Status 404 returned error can't find the container with id 58d996902f38ac2f4fd560b9020ec81edb50a927dc64454c65099756dfa2558f
Sep 08 00:12:22.838038 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:22.838003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-g645n"]
Sep 08 00:12:22.841162 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:12:22.841123    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc4b031a_4d70_4a7f_9c81_8b9d276c2314.slice/crio-bc4bfd6e05d4ec0e59189ffb58377f46932a2942fb6986a901a326f4307ad6af WatchSource:0}: Error finding container bc4bfd6e05d4ec0e59189ffb58377f46932a2942fb6986a901a326f4307ad6af: Status 404 returned error can't find the container with id bc4bfd6e05d4ec0e59189ffb58377f46932a2942fb6986a901a326f4307ad6af
Sep 08 00:12:23.444589 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:23.444558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-h5lbb" event={"ID":"c1183f44-33fd-44d4-be87-a1fdf964dc42","Type":"ContainerStarted","Data":"58d996902f38ac2f4fd560b9020ec81edb50a927dc64454c65099756dfa2558f"}
Sep 08 00:12:23.446133 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:23.446109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f" event={"ID":"8e463bd5-6888-4f05-9d3e-0e11c4c30f26","Type":"ContainerStarted","Data":"61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d"}
Sep 08 00:12:23.446252 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:23.446236    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:23.447380 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:23.447361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-g645n" event={"ID":"fc4b031a-4d70-4a7f-9c81-8b9d276c2314","Type":"ContainerStarted","Data":"bc4bfd6e05d4ec0e59189ffb58377f46932a2942fb6986a901a326f4307ad6af"}
Sep 08 00:12:23.460472 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:23.460435    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f" podStartSLOduration=0.956326229 podStartE2EDuration="2.460423421s" totalImagesPullingTime="1.504097192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:12:23.459138013 +0000 UTC m=+583.944566622" watchObservedRunningTime="2026-09-08 00:12:23.460423421 +0000 UTC m=+583.945852028"
Sep 08 00:12:25.461127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:25.461081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-g645n" event={"ID":"fc4b031a-4d70-4a7f-9c81-8b9d276c2314","Type":"ContainerStarted","Data":"c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121"}
Sep 08 00:12:25.462525 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:25.462499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-h5lbb" event={"ID":"c1183f44-33fd-44d4-be87-a1fdf964dc42","Type":"ContainerStarted","Data":"596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9"}
Sep 08 00:12:25.473649 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:25.473608    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-g645n" podStartSLOduration=1.200375172 podStartE2EDuration="3.473594571s" totalImagesPullingTime="2.273219399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:12:25.472037057 +0000 UTC m=+585.957465664" watchObservedRunningTime="2026-09-08 00:12:25.473594571 +0000 UTC m=+585.959023173"
Sep 08 00:12:25.484203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:25.484148    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-h5lbb" podStartSLOduration=1.053740576 podStartE2EDuration="3.484130013s" totalImagesPullingTime="2.430389437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:12:25.483630007 +0000 UTC m=+585.969058617" watchObservedRunningTime="2026-09-08 00:12:25.484130013 +0000 UTC m=+585.969558622"
Sep 08 00:12:25.505651 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:25.505619    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-h5lbb"]
Sep 08 00:12:27.471260 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:27.471222    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-h5lbb" podUID="c1183f44-33fd-44d4-be87-a1fdf964dc42" containerName="authorino" containerID="cri-o://596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9" gracePeriod=30
Sep 08 00:12:27.713138 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:27.713114    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-h5lbb"
Sep 08 00:12:27.795987 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:27.795909    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6962\" (UniqueName: \"kubernetes.io/projected/c1183f44-33fd-44d4-be87-a1fdf964dc42-kube-api-access-f6962\") pod \"c1183f44-33fd-44d4-be87-a1fdf964dc42\" (UID: \"c1183f44-33fd-44d4-be87-a1fdf964dc42\") "
Sep 08 00:12:27.797953 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:27.797922    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1183f44-33fd-44d4-be87-a1fdf964dc42-kube-api-access-f6962" (OuterVolumeSpecName: "kube-api-access-f6962") pod "c1183f44-33fd-44d4-be87-a1fdf964dc42" (UID: "c1183f44-33fd-44d4-be87-a1fdf964dc42"). InnerVolumeSpecName "kube-api-access-f6962". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:12:27.897072 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:27.897042    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6962\" (UniqueName: \"kubernetes.io/projected/c1183f44-33fd-44d4-be87-a1fdf964dc42-kube-api-access-f6962\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:28.476632 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.476593    2580 generic.go:356] "Generic (PLEG): container finished" podID="c1183f44-33fd-44d4-be87-a1fdf964dc42" containerID="596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9" exitCode=0
Sep 08 00:12:28.476632 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.476636    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-h5lbb"
Sep 08 00:12:28.477134 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.476681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-h5lbb" event={"ID":"c1183f44-33fd-44d4-be87-a1fdf964dc42","Type":"ContainerDied","Data":"596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9"}
Sep 08 00:12:28.477134 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.476719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-h5lbb" event={"ID":"c1183f44-33fd-44d4-be87-a1fdf964dc42","Type":"ContainerDied","Data":"58d996902f38ac2f4fd560b9020ec81edb50a927dc64454c65099756dfa2558f"}
Sep 08 00:12:28.477134 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.476737    2580 scope.go:117] "RemoveContainer" containerID="596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9"
Sep 08 00:12:28.484939 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.484920    2580 scope.go:117] "RemoveContainer" containerID="596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9"
Sep 08 00:12:28.485257 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:28.485240    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9\": container with ID starting with 596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9 not found: ID does not exist" containerID="596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9"
Sep 08 00:12:28.485335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.485266    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9"} err="failed to get container status \"596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9\": rpc error: code = NotFound desc = could not find container \"596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9\": container with ID starting with 596a5bf3a35f98cda9e6e92231f9b9cb438876b9addd7eb0c48efa852ffbe9f9 not found: ID does not exist"
Sep 08 00:12:28.489729 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.489692    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-h5lbb"]
Sep 08 00:12:28.494389 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:28.494367    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-h5lbb"]
Sep 08 00:12:29.631891 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:29.631858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:29.926520 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:29.926487    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1183f44-33fd-44d4-be87-a1fdf964dc42" path="/var/lib/kubelet/pods/c1183f44-33fd-44d4-be87-a1fdf964dc42/volumes"
Sep 08 00:12:34.456946 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:34.456911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:34.875858 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:34.875773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"]
Sep 08 00:12:34.876012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:34.875950    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f" podUID="8e463bd5-6888-4f05-9d3e-0e11c4c30f26" containerName="limitador" containerID="cri-o://61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d" gracePeriod=30
Sep 08 00:12:35.415417 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.415392    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:35.512852 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.512776    2580 generic.go:356] "Generic (PLEG): container finished" podID="8e463bd5-6888-4f05-9d3e-0e11c4c30f26" containerID="61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d" exitCode=0
Sep 08 00:12:35.512852 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.512820    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"
Sep 08 00:12:35.513257 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.512863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f" event={"ID":"8e463bd5-6888-4f05-9d3e-0e11c4c30f26","Type":"ContainerDied","Data":"61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d"}
Sep 08 00:12:35.513257 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.512935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-t4k2f" event={"ID":"8e463bd5-6888-4f05-9d3e-0e11c4c30f26","Type":"ContainerDied","Data":"2c8844ad101c174948b41af93fd99304137e845d1463d05389d7899a109a8073"}
Sep 08 00:12:35.513257 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.512958    2580 scope.go:117] "RemoveContainer" containerID="61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d"
Sep 08 00:12:35.520862 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.520846    2580 scope.go:117] "RemoveContainer" containerID="61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d"
Sep 08 00:12:35.521116 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:35.521099    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d\": container with ID starting with 61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d not found: ID does not exist" containerID="61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d"
Sep 08 00:12:35.521163 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.521125    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d"} err="failed to get container status \"61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d\": rpc error: code = NotFound desc = could not find container \"61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d\": container with ID starting with 61c280c445f976998106b453f04677801cb9b572f175d759d92fee3ceeab8b4d not found: ID does not exist"
Sep 08 00:12:35.560589 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.560549    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6jg4\" (UniqueName: \"kubernetes.io/projected/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-kube-api-access-j6jg4\") pod \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") "
Sep 08 00:12:35.560716 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.560599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-config-file\") pod \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\" (UID: \"8e463bd5-6888-4f05-9d3e-0e11c4c30f26\") "
Sep 08 00:12:35.560955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.560932    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-config-file" (OuterVolumeSpecName: "config-file") pod "8e463bd5-6888-4f05-9d3e-0e11c4c30f26" (UID: "8e463bd5-6888-4f05-9d3e-0e11c4c30f26"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:12:35.562582 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.562562    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-kube-api-access-j6jg4" (OuterVolumeSpecName: "kube-api-access-j6jg4") pod "8e463bd5-6888-4f05-9d3e-0e11c4c30f26" (UID: "8e463bd5-6888-4f05-9d3e-0e11c4c30f26"). InnerVolumeSpecName "kube-api-access-j6jg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:12:35.661793 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.661751    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6jg4\" (UniqueName: \"kubernetes.io/projected/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-kube-api-access-j6jg4\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:35.661793 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.661787    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e463bd5-6888-4f05-9d3e-0e11c4c30f26-config-file\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:35.832397 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.832365    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"]
Sep 08 00:12:35.835492 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.835465    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-t4k2f"]
Sep 08 00:12:35.926374 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:35.926329    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e463bd5-6888-4f05-9d3e-0e11c4c30f26" path="/var/lib/kubelet/pods/8e463bd5-6888-4f05-9d3e-0e11c4c30f26/volumes"
Sep 08 00:12:37.032789 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.032758    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:37.131532 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.131498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:37.465843 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.465813    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"]
Sep 08 00:12:37.466202 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.466155    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e463bd5-6888-4f05-9d3e-0e11c4c30f26" containerName="limitador"
Sep 08 00:12:37.466202 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.466168    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e463bd5-6888-4f05-9d3e-0e11c4c30f26" containerName="limitador"
Sep 08 00:12:37.466202 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.466179    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1183f44-33fd-44d4-be87-a1fdf964dc42" containerName="authorino"
Sep 08 00:12:37.466202 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.466184    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1183f44-33fd-44d4-be87-a1fdf964dc42" containerName="authorino"
Sep 08 00:12:37.466498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.466236    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1183f44-33fd-44d4-be87-a1fdf964dc42" containerName="authorino"
Sep 08 00:12:37.466498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.466245    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e463bd5-6888-4f05-9d3e-0e11c4c30f26" containerName="limitador"
Sep 08 00:12:37.470361 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.470330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:37.472259 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.472237    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 00:12:37.472413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.472305    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-btkt7\""
Sep 08 00:12:37.472509 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.472439    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:12:37.472713 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.472699    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 00:12:37.480044 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.480023    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"]
Sep 08 00:12:37.540007 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.539983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:37.578218 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.578187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258-data\") pod \"postgres-69fb4594cf-5ns54\" (UID: \"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:37.578330 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.578244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwggf\" (UniqueName: \"kubernetes.io/projected/de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258-kube-api-access-vwggf\") pod \"postgres-69fb4594cf-5ns54\" (UID: \"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:37.679292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.679251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258-data\") pod \"postgres-69fb4594cf-5ns54\" (UID: \"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:37.679499 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.679319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwggf\" (UniqueName: \"kubernetes.io/projected/de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258-kube-api-access-vwggf\") pod \"postgres-69fb4594cf-5ns54\" (UID: \"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:37.679706 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.679683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258-data\") pod \"postgres-69fb4594cf-5ns54\" (UID: \"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:37.687104 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.687079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwggf\" (UniqueName: \"kubernetes.io/projected/de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258-kube-api-access-vwggf\") pod \"postgres-69fb4594cf-5ns54\" (UID: \"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:37.780852 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:37.780768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:38.056335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:38.056228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"]
Sep 08 00:12:38.059203 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:12:38.059172    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3b00c3_7a3c_4eb1_a89d_f6ff9dc2d258.slice/crio-809b49065814ca1ff20e650d8558082a303ad4d474f34ae23adc14f907a44681 WatchSource:0}: Error finding container 809b49065814ca1ff20e650d8558082a303ad4d474f34ae23adc14f907a44681: Status 404 returned error can't find the container with id 809b49065814ca1ff20e650d8558082a303ad4d474f34ae23adc14f907a44681
Sep 08 00:12:38.531720 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:38.531687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54" event={"ID":"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258","Type":"ContainerStarted","Data":"809b49065814ca1ff20e650d8558082a303ad4d474f34ae23adc14f907a44681"}
Sep 08 00:12:43.721921 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:43.721887    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 00:12:44.562962 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:44.562926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54" event={"ID":"de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258","Type":"ContainerStarted","Data":"f195fdd53234bdcb7e14ab2a10146affe41398ae76d52f03acda92f871f4c7e1"}
Sep 08 00:12:44.563146 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:44.563107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:44.576816 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:44.576765    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54" podStartSLOduration=1.917759372 podStartE2EDuration="7.576749259s" totalImagesPullingTime="5.658989887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:12:44.574986373 +0000 UTC m=+605.060415009" watchObservedRunningTime="2026-09-08 00:12:44.576749259 +0000 UTC m=+605.062177867"
Sep 08 00:12:50.597516 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:50.597486    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ns54"
Sep 08 00:12:50.937448 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:50.937416    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:51.125015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.124976    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tggbn"]
Sep 08 00:12:51.130123 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.130097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tggbn"
Sep 08 00:12:51.134717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.134686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tggbn"]
Sep 08 00:12:51.167366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.167320    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:51.185561 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.185540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj7fc\" (UniqueName: \"kubernetes.io/projected/82c1653b-6019-4af1-aaeb-a73cf4fcb453-kube-api-access-lj7fc\") pod \"authorino-5dc7ccb5f-tggbn\" (UID: \"82c1653b-6019-4af1-aaeb-a73cf4fcb453\") " pod="kuadrant-system/authorino-5dc7ccb5f-tggbn"
Sep 08 00:12:51.207981 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.207924    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tggbn"]
Sep 08 00:12:51.208165 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:51.208146    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lj7fc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-tggbn" podUID="82c1653b-6019-4af1-aaeb-a73cf4fcb453"
Sep 08 00:12:51.233140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.233116    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-ggcgc"]
Sep 08 00:12:51.237641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.237623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.239336 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.239318    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 08 00:12:51.242065 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.242043    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-ggcgc"]
Sep 08 00:12:51.285907 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.285880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7fc\" (UniqueName: \"kubernetes.io/projected/82c1653b-6019-4af1-aaeb-a73cf4fcb453-kube-api-access-lj7fc\") pod \"authorino-5dc7ccb5f-tggbn\" (UID: \"82c1653b-6019-4af1-aaeb-a73cf4fcb453\") " pod="kuadrant-system/authorino-5dc7ccb5f-tggbn"
Sep 08 00:12:51.286029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.285918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzjd7\" (UniqueName: \"kubernetes.io/projected/d0857d85-0e7a-416e-b8c2-136685432cc7-kube-api-access-hzjd7\") pod \"authorino-687bd45585-ggcgc\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") " pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.286029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.285941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0857d85-0e7a-416e-b8c2-136685432cc7-tls-cert\") pod \"authorino-687bd45585-ggcgc\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") " pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.292530 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.292509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj7fc\" (UniqueName: \"kubernetes.io/projected/82c1653b-6019-4af1-aaeb-a73cf4fcb453-kube-api-access-lj7fc\") pod \"authorino-5dc7ccb5f-tggbn\" (UID: \"82c1653b-6019-4af1-aaeb-a73cf4fcb453\") " pod="kuadrant-system/authorino-5dc7ccb5f-tggbn"
Sep 08 00:12:51.353868 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.353844    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-ggcgc"]
Sep 08 00:12:51.354071 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:51.354054    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hzjd7 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-ggcgc" podUID="d0857d85-0e7a-416e-b8c2-136685432cc7"
Sep 08 00:12:51.379106 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.379082    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57fb4cd7bd-289h4"]
Sep 08 00:12:51.386294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.386273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.386883 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.386855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzjd7\" (UniqueName: \"kubernetes.io/projected/d0857d85-0e7a-416e-b8c2-136685432cc7-kube-api-access-hzjd7\") pod \"authorino-687bd45585-ggcgc\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") " pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.387001 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.386913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0857d85-0e7a-416e-b8c2-136685432cc7-tls-cert\") pod \"authorino-687bd45585-ggcgc\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") " pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.387001 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.386967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b656969e-28ec-41f1-bbf4-4d8ae93cfade-tls-cert\") pod \"authorino-57fb4cd7bd-289h4\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") " pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.387117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.387029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnrnx\" (UniqueName: \"kubernetes.io/projected/b656969e-28ec-41f1-bbf4-4d8ae93cfade-kube-api-access-rnrnx\") pod \"authorino-57fb4cd7bd-289h4\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") " pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.388623 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.388600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57fb4cd7bd-289h4"]
Sep 08 00:12:51.389740 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.389716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0857d85-0e7a-416e-b8c2-136685432cc7-tls-cert\") pod \"authorino-687bd45585-ggcgc\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") " pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.393994 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.393970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzjd7\" (UniqueName: \"kubernetes.io/projected/d0857d85-0e7a-416e-b8c2-136685432cc7-kube-api-access-hzjd7\") pod \"authorino-687bd45585-ggcgc\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") " pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.487506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.487453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b656969e-28ec-41f1-bbf4-4d8ae93cfade-tls-cert\") pod \"authorino-57fb4cd7bd-289h4\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") " pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.487506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.487497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnrnx\" (UniqueName: \"kubernetes.io/projected/b656969e-28ec-41f1-bbf4-4d8ae93cfade-kube-api-access-rnrnx\") pod \"authorino-57fb4cd7bd-289h4\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") " pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.489687 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.489669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b656969e-28ec-41f1-bbf4-4d8ae93cfade-tls-cert\") pod \"authorino-57fb4cd7bd-289h4\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") " pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.493823 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.493803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnrnx\" (UniqueName: \"kubernetes.io/projected/b656969e-28ec-41f1-bbf4-4d8ae93cfade-kube-api-access-rnrnx\") pod \"authorino-57fb4cd7bd-289h4\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") " pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.593887 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.593849    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tggbn"
Sep 08 00:12:51.594041 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.593849    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.609190 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.609163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tggbn"
Sep 08 00:12:51.614328 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.614309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:51.689265 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.689232    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj7fc\" (UniqueName: \"kubernetes.io/projected/82c1653b-6019-4af1-aaeb-a73cf4fcb453-kube-api-access-lj7fc\") pod \"82c1653b-6019-4af1-aaeb-a73cf4fcb453\" (UID: \"82c1653b-6019-4af1-aaeb-a73cf4fcb453\") "
Sep 08 00:12:51.689457 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.689297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0857d85-0e7a-416e-b8c2-136685432cc7-tls-cert\") pod \"d0857d85-0e7a-416e-b8c2-136685432cc7\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") "
Sep 08 00:12:51.689457 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.689324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzjd7\" (UniqueName: \"kubernetes.io/projected/d0857d85-0e7a-416e-b8c2-136685432cc7-kube-api-access-hzjd7\") pod \"d0857d85-0e7a-416e-b8c2-136685432cc7\" (UID: \"d0857d85-0e7a-416e-b8c2-136685432cc7\") "
Sep 08 00:12:51.691498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.691469    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0857d85-0e7a-416e-b8c2-136685432cc7-kube-api-access-hzjd7" (OuterVolumeSpecName: "kube-api-access-hzjd7") pod "d0857d85-0e7a-416e-b8c2-136685432cc7" (UID: "d0857d85-0e7a-416e-b8c2-136685432cc7"). InnerVolumeSpecName "kube-api-access-hzjd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:12:51.691498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.691489    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0857d85-0e7a-416e-b8c2-136685432cc7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d0857d85-0e7a-416e-b8c2-136685432cc7" (UID: "d0857d85-0e7a-416e-b8c2-136685432cc7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:12:51.691648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.691505    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c1653b-6019-4af1-aaeb-a73cf4fcb453-kube-api-access-lj7fc" (OuterVolumeSpecName: "kube-api-access-lj7fc") pod "82c1653b-6019-4af1-aaeb-a73cf4fcb453" (UID: "82c1653b-6019-4af1-aaeb-a73cf4fcb453"). InnerVolumeSpecName "kube-api-access-lj7fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:12:51.709669 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.709644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:12:51.790106 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.790075    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj7fc\" (UniqueName: \"kubernetes.io/projected/82c1653b-6019-4af1-aaeb-a73cf4fcb453-kube-api-access-lj7fc\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:51.790106 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.790106    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0857d85-0e7a-416e-b8c2-136685432cc7-tls-cert\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:51.790278 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.790116    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzjd7\" (UniqueName: \"kubernetes.io/projected/d0857d85-0e7a-416e-b8c2-136685432cc7-kube-api-access-hzjd7\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:51.980823 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:51.980797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57fb4cd7bd-289h4"]
Sep 08 00:12:51.983205 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:12:51.983174    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb656969e_28ec_41f1_bbf4_4d8ae93cfade.slice/crio-851e0bcce547fe0a6d5be46c07f789b50109760714f280b32d63ab201a52b100 WatchSource:0}: Error finding container 851e0bcce547fe0a6d5be46c07f789b50109760714f280b32d63ab201a52b100: Status 404 returned error can't find the container with id 851e0bcce547fe0a6d5be46c07f789b50109760714f280b32d63ab201a52b100
Sep 08 00:12:52.602437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:52.602367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ggcgc"
Sep 08 00:12:52.602437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:52.602373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57fb4cd7bd-289h4" event={"ID":"b656969e-28ec-41f1-bbf4-4d8ae93cfade","Type":"ContainerStarted","Data":"851e0bcce547fe0a6d5be46c07f789b50109760714f280b32d63ab201a52b100"}
Sep 08 00:12:52.602437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:52.602399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tggbn"
Sep 08 00:12:52.625327 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:52.625295    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tggbn"]
Sep 08 00:12:52.629836 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:52.629808    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tggbn"]
Sep 08 00:12:52.648085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:52.648057    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-ggcgc"]
Sep 08 00:12:52.650877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:52.650855    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-ggcgc"]
Sep 08 00:12:53.607865 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:53.607821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57fb4cd7bd-289h4" event={"ID":"b656969e-28ec-41f1-bbf4-4d8ae93cfade","Type":"ContainerStarted","Data":"de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690"}
Sep 08 00:12:53.620225 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:53.620174    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57fb4cd7bd-289h4" podStartSLOduration=1.956984543 podStartE2EDuration="2.620154975s" totalImagesPullingTime="663.170432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:12:53.619711581 +0000 UTC m=+614.105140190" watchObservedRunningTime="2026-09-08 00:12:53.620154975 +0000 UTC m=+614.105583587"
Sep 08 00:12:53.644809 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:53.644777    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-g645n"]
Sep 08 00:12:53.644992 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:53.644970    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-g645n" podUID="fc4b031a-4d70-4a7f-9c81-8b9d276c2314" containerName="authorino" containerID="cri-o://c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121" gracePeriod=30
Sep 08 00:12:53.926506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:53.926471    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c1653b-6019-4af1-aaeb-a73cf4fcb453" path="/var/lib/kubelet/pods/82c1653b-6019-4af1-aaeb-a73cf4fcb453/volumes"
Sep 08 00:12:53.926737 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:53.926725    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0857d85-0e7a-416e-b8c2-136685432cc7" path="/var/lib/kubelet/pods/d0857d85-0e7a-416e-b8c2-136685432cc7/volumes"
Sep 08 00:12:53.927141 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:53.927129    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-g645n"
Sep 08 00:12:54.010060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.010021    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tnhx\" (UniqueName: \"kubernetes.io/projected/fc4b031a-4d70-4a7f-9c81-8b9d276c2314-kube-api-access-7tnhx\") pod \"fc4b031a-4d70-4a7f-9c81-8b9d276c2314\" (UID: \"fc4b031a-4d70-4a7f-9c81-8b9d276c2314\") "
Sep 08 00:12:54.012378 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.012339    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc4b031a-4d70-4a7f-9c81-8b9d276c2314-kube-api-access-7tnhx" (OuterVolumeSpecName: "kube-api-access-7tnhx") pod "fc4b031a-4d70-4a7f-9c81-8b9d276c2314" (UID: "fc4b031a-4d70-4a7f-9c81-8b9d276c2314"). InnerVolumeSpecName "kube-api-access-7tnhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:12:54.111524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.111477    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tnhx\" (UniqueName: \"kubernetes.io/projected/fc4b031a-4d70-4a7f-9c81-8b9d276c2314-kube-api-access-7tnhx\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:12:54.613388 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.613334    2580 generic.go:356] "Generic (PLEG): container finished" podID="fc4b031a-4d70-4a7f-9c81-8b9d276c2314" containerID="c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121" exitCode=0
Sep 08 00:12:54.613388 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.613376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-g645n" event={"ID":"fc4b031a-4d70-4a7f-9c81-8b9d276c2314","Type":"ContainerDied","Data":"c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121"}
Sep 08 00:12:54.613594 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.613417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-g645n" event={"ID":"fc4b031a-4d70-4a7f-9c81-8b9d276c2314","Type":"ContainerDied","Data":"bc4bfd6e05d4ec0e59189ffb58377f46932a2942fb6986a901a326f4307ad6af"}
Sep 08 00:12:54.613594 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.613438    2580 scope.go:117] "RemoveContainer" containerID="c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121"
Sep 08 00:12:54.613594 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.613384    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-g645n"
Sep 08 00:12:54.623419 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.623400    2580 scope.go:117] "RemoveContainer" containerID="c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121"
Sep 08 00:12:54.623746 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:54.623725    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121\": container with ID starting with c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121 not found: ID does not exist" containerID="c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121"
Sep 08 00:12:54.623798 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.623755    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121"} err="failed to get container status \"c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121\": rpc error: code = NotFound desc = could not find container \"c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121\": container with ID starting with c87e6e8d14a1393f6d5c0ab0b46f6c176b8cd8e8a748e4c35558b3ecd06a9121 not found: ID does not exist"
Sep 08 00:12:54.632712 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.632685    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-g645n"]
Sep 08 00:12:54.634511 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:54.634489    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-g645n"]
Sep 08 00:12:55.926929 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:55.926892    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc4b031a-4d70-4a7f-9c81-8b9d276c2314" path="/var/lib/kubelet/pods/fc4b031a-4d70-4a7f-9c81-8b9d276c2314/volumes"
Sep 08 00:12:58.325761 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.325724    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:12:58.353830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.353792    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-khr9h"]
Sep 08 00:12:58.354136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.354123    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc4b031a-4d70-4a7f-9c81-8b9d276c2314" containerName="authorino"
Sep 08 00:12:58.354192 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.354137    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc4b031a-4d70-4a7f-9c81-8b9d276c2314" containerName="authorino"
Sep 08 00:12:58.354229 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.354223    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc4b031a-4d70-4a7f-9c81-8b9d276c2314" containerName="authorino"
Sep 08 00:12:58.357154 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.357134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.358987 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.358964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 00:12:58.359127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.358989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 00:12:58.359127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.359012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 00:12:58.359525 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.359509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjbp5\""
Sep 08 00:12:58.365314 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.365236    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-khr9h"]
Sep 08 00:12:58.450199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.450157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.450199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.450206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ppv4\" (UniqueName: \"kubernetes.io/projected/dab595e0-6e5e-424a-9350-b508855bb407-kube-api-access-7ppv4\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.450464 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.450288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-metrics-certs\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.525037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.525000    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8686947476-858wr"]
Sep 08 00:12:58.527294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.527279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.536524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.536483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686947476-858wr"]
Sep 08 00:12:58.551190 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.551156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ppv4\" (UniqueName: \"kubernetes.io/projected/dab595e0-6e5e-424a-9350-b508855bb407-kube-api-access-7ppv4\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.551412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.551234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-metrics-certs\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.551412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.551270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzdfq\" (UniqueName: \"kubernetes.io/projected/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-kube-api-access-rzdfq\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.551412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.551305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.551412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.551395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-metrics-certs\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.551630 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.551507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.551685 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:58.551640    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 00:12:58.551735 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:58.551721    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert podName:dab595e0-6e5e-424a-9350-b508855bb407 nodeName:}" failed. No retries permitted until 2026-09-08 00:12:59.051700167 +0000 UTC m=+619.537128771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert") pod "maas-controller-7bbdd8d44-khr9h" (UID: "dab595e0-6e5e-424a-9350-b508855bb407") : secret "maas-controller-webhook-cert" not found
Sep 08 00:12:58.553930 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.553897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-metrics-certs\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.560972 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.560941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ppv4\" (UniqueName: \"kubernetes.io/projected/dab595e0-6e5e-424a-9350-b508855bb407-kube-api-access-7ppv4\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:58.652356 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.652307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzdfq\" (UniqueName: \"kubernetes.io/projected/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-kube-api-access-rzdfq\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.652356 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.652364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.652573 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:58.652450    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 00:12:58.652573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.652477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-metrics-certs\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.652573 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:12:58.652503    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert podName:e0e83d67-0be6-4bb0-abbd-cd127ef5d179 nodeName:}" failed. No retries permitted until 2026-09-08 00:12:59.15248768 +0000 UTC m=+619.637916266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert") pod "maas-controller-8686947476-858wr" (UID: "e0e83d67-0be6-4bb0-abbd-cd127ef5d179") : secret "maas-controller-webhook-cert" not found
Sep 08 00:12:58.654877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.654854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-metrics-certs\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:58.662984 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:58.662950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzdfq\" (UniqueName: \"kubernetes.io/projected/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-kube-api-access-rzdfq\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:59.055409 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.055313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:59.057672 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.057653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert\") pod \"maas-controller-7bbdd8d44-khr9h\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") " pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:59.156179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.156148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:59.158524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.158505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert\") pod \"maas-controller-8686947476-858wr\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") " pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:59.271071 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.271039    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:12:59.439014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.438979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:12:59.537087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.537059    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-khr9h"]
Sep 08 00:12:59.539319 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:12:59.539292    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab595e0_6e5e_424a_9350_b508855bb407.slice/crio-304d40a9f91e4c9042723ea9b9a87f632fa3327fb0e73eb09970feed750a3caa WatchSource:0}: Error finding container 304d40a9f91e4c9042723ea9b9a87f632fa3327fb0e73eb09970feed750a3caa: Status 404 returned error can't find the container with id 304d40a9f91e4c9042723ea9b9a87f632fa3327fb0e73eb09970feed750a3caa
Sep 08 00:12:59.641961 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.641873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-khr9h" event={"ID":"dab595e0-6e5e-424a-9350-b508855bb407","Type":"ContainerStarted","Data":"304d40a9f91e4c9042723ea9b9a87f632fa3327fb0e73eb09970feed750a3caa"}
Sep 08 00:12:59.704699 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:12:59.704667    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686947476-858wr"]
Sep 08 00:12:59.707980 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:12:59.707951    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e83d67_0be6_4bb0_abbd_cd127ef5d179.slice/crio-73da4273bf1b5473388d2d7dfb46d3be1b8ac23ef124cb9cde21b7f2831ecafb WatchSource:0}: Error finding container 73da4273bf1b5473388d2d7dfb46d3be1b8ac23ef124cb9cde21b7f2831ecafb: Status 404 returned error can't find the container with id 73da4273bf1b5473388d2d7dfb46d3be1b8ac23ef124cb9cde21b7f2831ecafb
Sep 08 00:13:00.649855 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:00.649811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-858wr" event={"ID":"e0e83d67-0be6-4bb0-abbd-cd127ef5d179","Type":"ContainerStarted","Data":"73da4273bf1b5473388d2d7dfb46d3be1b8ac23ef124cb9cde21b7f2831ecafb"}
Sep 08 00:13:00.741266 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:00.741224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:02.236135 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.236082    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:02.335330 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.335211    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:02.661452 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.661415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-858wr" event={"ID":"e0e83d67-0be6-4bb0-abbd-cd127ef5d179","Type":"ContainerStarted","Data":"ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7"}
Sep 08 00:13:02.661634 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.661506    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:13:02.663184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.663156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-khr9h" event={"ID":"dab595e0-6e5e-424a-9350-b508855bb407","Type":"ContainerStarted","Data":"a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671"}
Sep 08 00:13:02.663378 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.663246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:13:02.679130 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.679073    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8686947476-858wr" podStartSLOduration=2.339162007 podStartE2EDuration="4.679054557s" totalImagesPullingTime="2.33989255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:13:02.67731688 +0000 UTC m=+623.162745488" watchObservedRunningTime="2026-09-08 00:13:02.679054557 +0000 UTC m=+623.164483164"
Sep 08 00:13:02.693485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:02.693431    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bbdd8d44-khr9h" podStartSLOduration=2.183414284 podStartE2EDuration="4.693412908s" totalImagesPullingTime="2.509998624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:13:02.6916362 +0000 UTC m=+623.177064807" watchObservedRunningTime="2026-09-08 00:13:02.693412908 +0000 UTC m=+623.178841517"
Sep 08 00:13:13.670938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:13.670902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:13:13.671328 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:13.670978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:13:13.729180 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:13.729132    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-khr9h"]
Sep 08 00:13:13.729468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:13.729438    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bbdd8d44-khr9h" podUID="dab595e0-6e5e-424a-9350-b508855bb407" containerName="manager" containerID="cri-o://a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671" gracePeriod=30
Sep 08 00:13:13.968895 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:13.968870    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:13:14.093643 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.093601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert\") pod \"dab595e0-6e5e-424a-9350-b508855bb407\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") "
Sep 08 00:13:14.093837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.093656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ppv4\" (UniqueName: \"kubernetes.io/projected/dab595e0-6e5e-424a-9350-b508855bb407-kube-api-access-7ppv4\") pod \"dab595e0-6e5e-424a-9350-b508855bb407\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") "
Sep 08 00:13:14.093837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.093694    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-metrics-certs\") pod \"dab595e0-6e5e-424a-9350-b508855bb407\" (UID: \"dab595e0-6e5e-424a-9350-b508855bb407\") "
Sep 08 00:13:14.095962 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.095931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dab595e0-6e5e-424a-9350-b508855bb407" (UID: "dab595e0-6e5e-424a-9350-b508855bb407"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:13:14.095962 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.095951    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dab595e0-6e5e-424a-9350-b508855bb407" (UID: "dab595e0-6e5e-424a-9350-b508855bb407"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:13:14.096123 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.095999    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab595e0-6e5e-424a-9350-b508855bb407-kube-api-access-7ppv4" (OuterVolumeSpecName: "kube-api-access-7ppv4") pod "dab595e0-6e5e-424a-9350-b508855bb407" (UID: "dab595e0-6e5e-424a-9350-b508855bb407"). InnerVolumeSpecName "kube-api-access-7ppv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:13:14.194665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.194620    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-webhook-cert\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:13:14.194665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.194660    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ppv4\" (UniqueName: \"kubernetes.io/projected/dab595e0-6e5e-424a-9350-b508855bb407-kube-api-access-7ppv4\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:13:14.194665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.194672    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dab595e0-6e5e-424a-9350-b508855bb407-metrics-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:13:14.718821 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.718785    2580 generic.go:356] "Generic (PLEG): container finished" podID="dab595e0-6e5e-424a-9350-b508855bb407" containerID="a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671" exitCode=0
Sep 08 00:13:14.719318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.718841    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-khr9h"
Sep 08 00:13:14.719318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.718870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-khr9h" event={"ID":"dab595e0-6e5e-424a-9350-b508855bb407","Type":"ContainerDied","Data":"a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671"}
Sep 08 00:13:14.719318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.718940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-khr9h" event={"ID":"dab595e0-6e5e-424a-9350-b508855bb407","Type":"ContainerDied","Data":"304d40a9f91e4c9042723ea9b9a87f632fa3327fb0e73eb09970feed750a3caa"}
Sep 08 00:13:14.719318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.718976    2580 scope.go:117] "RemoveContainer" containerID="a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671"
Sep 08 00:13:14.728869 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.728849    2580 scope.go:117] "RemoveContainer" containerID="a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671"
Sep 08 00:13:14.729233 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:13:14.729213    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671\": container with ID starting with a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671 not found: ID does not exist" containerID="a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671"
Sep 08 00:13:14.729288 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.729245    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671"} err="failed to get container status \"a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671\": rpc error: code = NotFound desc = could not find container \"a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671\": container with ID starting with a5cd8d69b6a132d9b2af0fec4c04d87f4abb0390e1da556cd5be1e4df7360671 not found: ID does not exist"
Sep 08 00:13:14.738650 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.738620    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-khr9h"]
Sep 08 00:13:14.741935 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:14.741910    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-khr9h"]
Sep 08 00:13:15.926864 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:15.926829    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab595e0-6e5e-424a-9350-b508855bb407" path="/var/lib/kubelet/pods/dab595e0-6e5e-424a-9350-b508855bb407/volumes"
Sep 08 00:13:33.942433 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:33.942394    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:34.036307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:34.036264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:35.327628 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.327591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:35.433948 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.433915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:35.687474 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.687437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:35.787180 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.787146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:35.883499 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.883471    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:35.938842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.938762    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"]
Sep 08 00:13:35.939096 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.939084    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab595e0-6e5e-424a-9350-b508855bb407" containerName="manager"
Sep 08 00:13:35.939137 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.939097    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab595e0-6e5e-424a-9350-b508855bb407" containerName="manager"
Sep 08 00:13:35.939176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.939157    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab595e0-6e5e-424a-9350-b508855bb407" containerName="manager"
Sep 08 00:13:35.943278 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.943259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:35.945715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.945692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5jjhl\""
Sep 08 00:13:35.945835 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.945694    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 00:13:35.957296 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.957260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"]
Sep 08 00:13:35.960314 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.960253    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:35.961758 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.961732    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"]
Sep 08 00:13:35.964159 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.964143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:35.974113 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.974089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"]
Sep 08 00:13:35.988251 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.988218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rfvm\" (UniqueName: \"kubernetes.io/projected/ce919e3c-7796-4faa-81b8-578bdbba2dd4-kube-api-access-7rfvm\") pod \"payload-processing-5b54b7fbb7-5fvdg\" (UID: \"ce919e3c-7796-4faa-81b8-578bdbba2dd4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:35.988391 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.988284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce919e3c-7796-4faa-81b8-578bdbba2dd4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5fvdg\" (UID: \"ce919e3c-7796-4faa-81b8-578bdbba2dd4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:35.988391 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.988322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3969be7a-7bc3-421d-8f76-2aa182fc1d56-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rkh9c\" (UID: \"3969be7a-7bc3-421d-8f76-2aa182fc1d56\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:35.988391 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:35.988377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlblr\" (UniqueName: \"kubernetes.io/projected/3969be7a-7bc3-421d-8f76-2aa182fc1d56-kube-api-access-vlblr\") pod \"payload-pre-processing-59fbc47bf8-rkh9c\" (UID: \"3969be7a-7bc3-421d-8f76-2aa182fc1d56\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:36.088818 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.088773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfvm\" (UniqueName: \"kubernetes.io/projected/ce919e3c-7796-4faa-81b8-578bdbba2dd4-kube-api-access-7rfvm\") pod \"payload-processing-5b54b7fbb7-5fvdg\" (UID: \"ce919e3c-7796-4faa-81b8-578bdbba2dd4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:36.089027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.088847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce919e3c-7796-4faa-81b8-578bdbba2dd4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5fvdg\" (UID: \"ce919e3c-7796-4faa-81b8-578bdbba2dd4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:36.089027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.088886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3969be7a-7bc3-421d-8f76-2aa182fc1d56-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rkh9c\" (UID: \"3969be7a-7bc3-421d-8f76-2aa182fc1d56\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:36.089027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.088911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlblr\" (UniqueName: \"kubernetes.io/projected/3969be7a-7bc3-421d-8f76-2aa182fc1d56-kube-api-access-vlblr\") pod \"payload-pre-processing-59fbc47bf8-rkh9c\" (UID: \"3969be7a-7bc3-421d-8f76-2aa182fc1d56\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:36.089797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.089773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3969be7a-7bc3-421d-8f76-2aa182fc1d56-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rkh9c\" (UID: \"3969be7a-7bc3-421d-8f76-2aa182fc1d56\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:36.089863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.089831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce919e3c-7796-4faa-81b8-578bdbba2dd4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5fvdg\" (UID: \"ce919e3c-7796-4faa-81b8-578bdbba2dd4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:36.096056 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.096032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlblr\" (UniqueName: \"kubernetes.io/projected/3969be7a-7bc3-421d-8f76-2aa182fc1d56-kube-api-access-vlblr\") pod \"payload-pre-processing-59fbc47bf8-rkh9c\" (UID: \"3969be7a-7bc3-421d-8f76-2aa182fc1d56\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:36.096176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.096049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rfvm\" (UniqueName: \"kubernetes.io/projected/ce919e3c-7796-4faa-81b8-578bdbba2dd4-kube-api-access-7rfvm\") pod \"payload-processing-5b54b7fbb7-5fvdg\" (UID: \"ce919e3c-7796-4faa-81b8-578bdbba2dd4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:36.254539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.254444    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:36.275145 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.275116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:36.534155 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.534129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"]
Sep 08 00:13:36.537224 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:13:36.537194    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3969be7a_7bc3_421d_8f76_2aa182fc1d56.slice/crio-8957684ee9d9210993d62c95640869badc5e05ca4aee7403e340a1a92623c308 WatchSource:0}: Error finding container 8957684ee9d9210993d62c95640869badc5e05ca4aee7403e340a1a92623c308: Status 404 returned error can't find the container with id 8957684ee9d9210993d62c95640869badc5e05ca4aee7403e340a1a92623c308
Sep 08 00:13:36.539126 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.539109    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:13:36.561031 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.560918    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"]
Sep 08 00:13:36.563764 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:13:36.563734    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce919e3c_7796_4faa_81b8_578bdbba2dd4.slice/crio-712c76a1bf634408e1e033a1a2bd946bae58c7f0b018d670baa1e126de782d13 WatchSource:0}: Error finding container 712c76a1bf634408e1e033a1a2bd946bae58c7f0b018d670baa1e126de782d13: Status 404 returned error can't find the container with id 712c76a1bf634408e1e033a1a2bd946bae58c7f0b018d670baa1e126de782d13
Sep 08 00:13:36.826098 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.825988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c" event={"ID":"3969be7a-7bc3-421d-8f76-2aa182fc1d56","Type":"ContainerStarted","Data":"8957684ee9d9210993d62c95640869badc5e05ca4aee7403e340a1a92623c308"}
Sep 08 00:13:36.827233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:36.827201    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg" event={"ID":"ce919e3c-7796-4faa-81b8-578bdbba2dd4","Type":"ContainerStarted","Data":"712c76a1bf634408e1e033a1a2bd946bae58c7f0b018d670baa1e126de782d13"}
Sep 08 00:13:39.844308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:39.844267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg" event={"ID":"ce919e3c-7796-4faa-81b8-578bdbba2dd4","Type":"ContainerStarted","Data":"6096ad17c0b881a8a6357c0de81ef411ee986146218d0eb1a4029077fda4fbba"}
Sep 08 00:13:39.844756 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:39.844382    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:39.845877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:39.845851    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c" event={"ID":"3969be7a-7bc3-421d-8f76-2aa182fc1d56","Type":"ContainerStarted","Data":"33f14f34df5f09ebb72c49eea8a9000854692ee9a23ba4f1c1ad1037959c96c9"}
Sep 08 00:13:39.845993 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:39.845902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:13:39.858413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:39.858371    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg" podStartSLOduration=2.609341371 podStartE2EDuration="4.858340764s" totalImagesPullingTime="2.248999393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:13:39.856966092 +0000 UTC m=+660.342394703" watchObservedRunningTime="2026-09-08 00:13:39.858340764 +0000 UTC m=+660.343769371"
Sep 08 00:13:39.872711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:39.872665    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c" podStartSLOduration=2.578134065 podStartE2EDuration="4.872650582s" totalImagesPullingTime="2.294516517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:13:39.870877183 +0000 UTC m=+660.356305792" watchObservedRunningTime="2026-09-08 00:13:39.872650582 +0000 UTC m=+660.358079190"
Sep 08 00:13:46.962118 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:46.962080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:47.068161 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:47.068123    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:13:50.853470 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:50.853436    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5fvdg"
Sep 08 00:13:50.853908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:13:50.853510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rkh9c"
Sep 08 00:14:05.507516 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:05.507476    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:14:20.402368 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:20.402305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:14:33.781149 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.781060    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"]
Sep 08 00:14:33.786776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.786752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.788767 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.788743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 00:14:33.789503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.789479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 00:14:33.789631 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.789519    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 00:14:33.789705 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.789643    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2xmvm\""
Sep 08 00:14:33.791416 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.791396    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"]
Sep 08 00:14:33.866459 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.866427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:14:33.871255 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.871232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.871395 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.871259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.871395 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.871359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlb6w\" (UniqueName: \"kubernetes.io/projected/24fde025-5f1a-4fcc-adb7-cbb0200852d7-kube-api-access-rlb6w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.871475 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.871403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.871475 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.871420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fde025-5f1a-4fcc-adb7-cbb0200852d7-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.871475 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.871447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.972796 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.972757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.972949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.972819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.972949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.972844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.972949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.972920    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlb6w\" (UniqueName: \"kubernetes.io/projected/24fde025-5f1a-4fcc-adb7-cbb0200852d7-kube-api-access-rlb6w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.973068 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.972957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.973068 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.972984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fde025-5f1a-4fcc-adb7-cbb0200852d7-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.973200 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.973177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.973259 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.973226    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.973304 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.973265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.975221 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.975201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fde025-5f1a-4fcc-adb7-cbb0200852d7-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.975422 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.975403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fde025-5f1a-4fcc-adb7-cbb0200852d7-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:33.979525 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:33.979502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlb6w\" (UniqueName: \"kubernetes.io/projected/24fde025-5f1a-4fcc-adb7-cbb0200852d7-kube-api-access-rlb6w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd\" (UID: \"24fde025-5f1a-4fcc-adb7-cbb0200852d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:34.097990 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:34.097883    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:34.368011 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:34.367925    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"]
Sep 08 00:14:34.371903 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:14:34.371869    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24fde025_5f1a_4fcc_adb7_cbb0200852d7.slice/crio-97fef6e90bcb76434632e23f1362946417659af45dd1ff1201a007937053edde WatchSource:0}: Error finding container 97fef6e90bcb76434632e23f1362946417659af45dd1ff1201a007937053edde: Status 404 returned error can't find the container with id 97fef6e90bcb76434632e23f1362946417659af45dd1ff1201a007937053edde
Sep 08 00:14:35.097187 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:35.097138    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd" event={"ID":"24fde025-5f1a-4fcc-adb7-cbb0200852d7","Type":"ContainerStarted","Data":"97fef6e90bcb76434632e23f1362946417659af45dd1ff1201a007937053edde"}
Sep 08 00:14:36.103124 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:36.103088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd" event={"ID":"24fde025-5f1a-4fcc-adb7-cbb0200852d7","Type":"ContainerStarted","Data":"627cb101a6a38e95b611d181929848ce1a79d24bf2b0daae73c120d18a68397a"}
Sep 08 00:14:36.117335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:36.117258    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd" podStartSLOduration=2.02959819 podStartE2EDuration="3.117236132s" totalImagesPullingTime="1.087637942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:14:36.116999934 +0000 UTC m=+716.602428544" watchObservedRunningTime="2026-09-08 00:14:36.117236132 +0000 UTC m=+716.602664767"
Sep 08 00:14:44.098307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:44.098272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:44.098859 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:44.098336    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:44.110571 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:44.110549    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:14:44.151055 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:14:44.151027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd"
Sep 08 00:15:13.792299 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:13.792261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:15:14.041504 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:14.041468    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:15:21.407199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:21.407152    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:15:38.468041 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:38.468008    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:15:44.276140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.276102    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"]
Sep 08 00:15:44.279682 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.279658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.281375 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.281339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 00:15:44.287409 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.287391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"]
Sep 08 00:15:44.303530 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.303507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:15:44.381395 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.381325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.381564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.381445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.381564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.381517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.381564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.381549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bgs4\" (UniqueName: \"kubernetes.io/projected/f7c51170-1057-4ee8-bf59-49c55d7514a6-kube-api-access-6bgs4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.381676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.381583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.381676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.381607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c51170-1057-4ee8-bf59-49c55d7514a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.482942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.482896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.482956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.482987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bgs4\" (UniqueName: \"kubernetes.io/projected/f7c51170-1057-4ee8-bf59-49c55d7514a6-kube-api-access-6bgs4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.483026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483311 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.483167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c51170-1057-4ee8-bf59-49c55d7514a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483311 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.483266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.483412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483535 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.483470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.483603 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.483587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.485396 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.485371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c51170-1057-4ee8-bf59-49c55d7514a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.485642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.485624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c51170-1057-4ee8-bf59-49c55d7514a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.489769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.489741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bgs4\" (UniqueName: \"kubernetes.io/projected/f7c51170-1057-4ee8-bf59-49c55d7514a6-kube-api-access-6bgs4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d9bll\" (UID: \"f7c51170-1057-4ee8-bf59-49c55d7514a6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.592577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.592474    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:44.866906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:44.864301    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"]
Sep 08 00:15:44.867917 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:15:44.867887    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c51170_1057_4ee8_bf59_49c55d7514a6.slice/crio-010c1dae5f583c06dbd88144523ccc42ce28258046b9cb9eb8db8724a00296e3 WatchSource:0}: Error finding container 010c1dae5f583c06dbd88144523ccc42ce28258046b9cb9eb8db8724a00296e3: Status 404 returned error can't find the container with id 010c1dae5f583c06dbd88144523ccc42ce28258046b9cb9eb8db8724a00296e3
Sep 08 00:15:45.416695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:45.416654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll" event={"ID":"f7c51170-1057-4ee8-bf59-49c55d7514a6","Type":"ContainerStarted","Data":"e641f992d9023a16ddc2dead85bfea9573f6e013ae26f79416974b8e99c39fea"}
Sep 08 00:15:45.417072 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:45.416733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll" event={"ID":"f7c51170-1057-4ee8-bf59-49c55d7514a6","Type":"ContainerStarted","Data":"010c1dae5f583c06dbd88144523ccc42ce28258046b9cb9eb8db8724a00296e3"}
Sep 08 00:15:45.430110 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:45.430063    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll" podStartSLOduration=1.215686813 podStartE2EDuration="1.430042907s" totalImagesPullingTime="214.356094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:15:45.429908262 +0000 UTC m=+785.915336870" watchObservedRunningTime="2026-09-08 00:15:45.430042907 +0000 UTC m=+785.915471514"
Sep 08 00:15:54.592951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:54.592908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:54.593459 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:54.592971    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:54.605719 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:54.605685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:54.975675 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:54.975640    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"]
Sep 08 00:15:54.979766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:54.979743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:54.981518 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:54.981494    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 08 00:15:54.989108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:54.989081    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"]
Sep 08 00:15:55.080127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.080087    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:15:55.081172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.081149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.081245 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.081207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.081299 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.081243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.081299 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.081268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmcsr\" (UniqueName: \"kubernetes.io/projected/b65dca57-f1a0-43e9-ab08-6bad29fba164-kube-api-access-pmcsr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.081299 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.081288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.081470 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.081412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b65dca57-f1a0-43e9-ab08-6bad29fba164-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.182572 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.182535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmcsr\" (UniqueName: \"kubernetes.io/projected/b65dca57-f1a0-43e9-ab08-6bad29fba164-kube-api-access-pmcsr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.182572 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.182578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.182807 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.182704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b65dca57-f1a0-43e9-ab08-6bad29fba164-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.182865 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.182843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.182921 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.182876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.182921 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.182906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.183037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.183020    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.183209 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.183187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.183289 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.183274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.185040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.185021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b65dca57-f1a0-43e9-ab08-6bad29fba164-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.185313 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.185294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b65dca57-f1a0-43e9-ab08-6bad29fba164-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.189221 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.189203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmcsr\" (UniqueName: \"kubernetes.io/projected/b65dca57-f1a0-43e9-ab08-6bad29fba164-kube-api-access-pmcsr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk\" (UID: \"b65dca57-f1a0-43e9-ab08-6bad29fba164\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.290052 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.289962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:15:55.475092 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.475064    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d9bll"
Sep 08 00:15:55.557224 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:55.557198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"]
Sep 08 00:15:55.559448 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:15:55.559423    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb65dca57_f1a0_43e9_ab08_6bad29fba164.slice/crio-58f2fa2e6a5b2a1dde729dbae1cb6986d87c98aba516dd65a62492f978b2db19 WatchSource:0}: Error finding container 58f2fa2e6a5b2a1dde729dbae1cb6986d87c98aba516dd65a62492f978b2db19: Status 404 returned error can't find the container with id 58f2fa2e6a5b2a1dde729dbae1cb6986d87c98aba516dd65a62492f978b2db19
Sep 08 00:15:56.469531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:56.469489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk" event={"ID":"b65dca57-f1a0-43e9-ab08-6bad29fba164","Type":"ContainerStarted","Data":"84e5335a80897b946c0a69ad40d9ca5677e3f826bae10bedfa82708e3f191133"}
Sep 08 00:15:56.469531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:56.469537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk" event={"ID":"b65dca57-f1a0-43e9-ab08-6bad29fba164","Type":"ContainerStarted","Data":"58f2fa2e6a5b2a1dde729dbae1cb6986d87c98aba516dd65a62492f978b2db19"}
Sep 08 00:15:56.484434 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:56.484378    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk" podStartSLOduration=2.302454217 podStartE2EDuration="2.484335629s" totalImagesPullingTime="181.881412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:15:56.482825825 +0000 UTC m=+796.968254435" watchObservedRunningTime="2026-09-08 00:15:56.484335629 +0000 UTC m=+796.969764238"
Sep 08 00:15:57.045319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:15:57.045289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:16:05.290906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:16:05.290814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:16:05.290906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:16:05.290863    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:16:05.302971 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:16:05.302944    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:16:05.523502 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:16:05.523471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk"
Sep 08 00:16:09.269740 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:16:09.269704    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:11.613736 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.613695    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6db78868f7-lx9n8"]
Sep 08 00:17:11.616983 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.616965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:11.625256 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.625232    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6db78868f7-lx9n8"]
Sep 08 00:17:11.653009 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.652977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd5097a4-100c-4c2b-9a2a-792afe97f265-tls-cert\") pod \"authorino-6db78868f7-lx9n8\" (UID: \"dd5097a4-100c-4c2b-9a2a-792afe97f265\") " pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:11.653144 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.653017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5lg\" (UniqueName: \"kubernetes.io/projected/dd5097a4-100c-4c2b-9a2a-792afe97f265-kube-api-access-fg5lg\") pod \"authorino-6db78868f7-lx9n8\" (UID: \"dd5097a4-100c-4c2b-9a2a-792afe97f265\") " pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:11.753555 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.753512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd5097a4-100c-4c2b-9a2a-792afe97f265-tls-cert\") pod \"authorino-6db78868f7-lx9n8\" (UID: \"dd5097a4-100c-4c2b-9a2a-792afe97f265\") " pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:11.753555 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.753560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5lg\" (UniqueName: \"kubernetes.io/projected/dd5097a4-100c-4c2b-9a2a-792afe97f265-kube-api-access-fg5lg\") pod \"authorino-6db78868f7-lx9n8\" (UID: \"dd5097a4-100c-4c2b-9a2a-792afe97f265\") " pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:11.756171 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.756146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd5097a4-100c-4c2b-9a2a-792afe97f265-tls-cert\") pod \"authorino-6db78868f7-lx9n8\" (UID: \"dd5097a4-100c-4c2b-9a2a-792afe97f265\") " pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:11.760677 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.760656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5lg\" (UniqueName: \"kubernetes.io/projected/dd5097a4-100c-4c2b-9a2a-792afe97f265-kube-api-access-fg5lg\") pod \"authorino-6db78868f7-lx9n8\" (UID: \"dd5097a4-100c-4c2b-9a2a-792afe97f265\") " pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:11.927179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:11.927151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6db78868f7-lx9n8"
Sep 08 00:17:12.193688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:12.193599    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6db78868f7-lx9n8"]
Sep 08 00:17:12.200216 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:17:12.200180    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd5097a4_100c_4c2b_9a2a_792afe97f265.slice/crio-21dcce3f5457ecbd2e2705d7360aac3dd17ed06ce8a8a62f9ea15c901ea5e98b WatchSource:0}: Error finding container 21dcce3f5457ecbd2e2705d7360aac3dd17ed06ce8a8a62f9ea15c901ea5e98b: Status 404 returned error can't find the container with id 21dcce3f5457ecbd2e2705d7360aac3dd17ed06ce8a8a62f9ea15c901ea5e98b
Sep 08 00:17:12.835396 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:12.835339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6db78868f7-lx9n8" event={"ID":"dd5097a4-100c-4c2b-9a2a-792afe97f265","Type":"ContainerStarted","Data":"21dcce3f5457ecbd2e2705d7360aac3dd17ed06ce8a8a62f9ea15c901ea5e98b"}
Sep 08 00:17:13.842683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:13.842643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6db78868f7-lx9n8" event={"ID":"dd5097a4-100c-4c2b-9a2a-792afe97f265","Type":"ContainerStarted","Data":"84221d92c9706e860002380c2c5725eced83a340153d956d8f9f94f34cc088df"}
Sep 08 00:17:13.862489 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:13.862423    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6db78868f7-lx9n8" podStartSLOduration=1.857091778 podStartE2EDuration="2.862401653s" totalImagesPullingTime="1.005309875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:13.861143436 +0000 UTC m=+874.346572044" watchObservedRunningTime="2026-09-08 00:17:13.862401653 +0000 UTC m=+874.347830261"
Sep 08 00:17:13.906573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:13.906540    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57fb4cd7bd-289h4"]
Sep 08 00:17:13.906988 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:13.906961    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57fb4cd7bd-289h4" podUID="b656969e-28ec-41f1-bbf4-4d8ae93cfade" containerName="authorino" containerID="cri-o://de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690" gracePeriod=30
Sep 08 00:17:14.150472 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.150442    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:17:14.174847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.174817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b656969e-28ec-41f1-bbf4-4d8ae93cfade-tls-cert\") pod \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") "
Sep 08 00:17:14.175013 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.174935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnrnx\" (UniqueName: \"kubernetes.io/projected/b656969e-28ec-41f1-bbf4-4d8ae93cfade-kube-api-access-rnrnx\") pod \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\" (UID: \"b656969e-28ec-41f1-bbf4-4d8ae93cfade\") "
Sep 08 00:17:14.177614 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.177580    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b656969e-28ec-41f1-bbf4-4d8ae93cfade-kube-api-access-rnrnx" (OuterVolumeSpecName: "kube-api-access-rnrnx") pod "b656969e-28ec-41f1-bbf4-4d8ae93cfade" (UID: "b656969e-28ec-41f1-bbf4-4d8ae93cfade"). InnerVolumeSpecName "kube-api-access-rnrnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:17:14.186242 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.186201    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b656969e-28ec-41f1-bbf4-4d8ae93cfade-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b656969e-28ec-41f1-bbf4-4d8ae93cfade" (UID: "b656969e-28ec-41f1-bbf4-4d8ae93cfade"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:17:14.276002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.275962    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b656969e-28ec-41f1-bbf4-4d8ae93cfade-tls-cert\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:17:14.276002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.275996    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnrnx\" (UniqueName: \"kubernetes.io/projected/b656969e-28ec-41f1-bbf4-4d8ae93cfade-kube-api-access-rnrnx\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:17:14.367543 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.367501    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:14.471327 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.471278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:14.849012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.848907    2580 generic.go:356] "Generic (PLEG): container finished" podID="b656969e-28ec-41f1-bbf4-4d8ae93cfade" containerID="de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690" exitCode=0
Sep 08 00:17:14.849012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.848963    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57fb4cd7bd-289h4"
Sep 08 00:17:14.849012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.848988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57fb4cd7bd-289h4" event={"ID":"b656969e-28ec-41f1-bbf4-4d8ae93cfade","Type":"ContainerDied","Data":"de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690"}
Sep 08 00:17:14.849609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.849040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57fb4cd7bd-289h4" event={"ID":"b656969e-28ec-41f1-bbf4-4d8ae93cfade","Type":"ContainerDied","Data":"851e0bcce547fe0a6d5be46c07f789b50109760714f280b32d63ab201a52b100"}
Sep 08 00:17:14.849609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.849066    2580 scope.go:117] "RemoveContainer" containerID="de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690"
Sep 08 00:17:14.858741 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.858720    2580 scope.go:117] "RemoveContainer" containerID="de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690"
Sep 08 00:17:14.859093 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:17:14.859069    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690\": container with ID starting with de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690 not found: ID does not exist" containerID="de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690"
Sep 08 00:17:14.859184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.859102    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690"} err="failed to get container status \"de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690\": rpc error: code = NotFound desc = could not find container \"de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690\": container with ID starting with de02309c0b07bc0cff7efa0e43ff28f37a2c48959e2e85d0358c9d847b8fb690 not found: ID does not exist"
Sep 08 00:17:14.870414 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.870384    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57fb4cd7bd-289h4"]
Sep 08 00:17:14.876846 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:14.876812    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57fb4cd7bd-289h4"]
Sep 08 00:17:15.450368 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:15.450318    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:15.550945 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:15.550908    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:15.928925 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:15.928888    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b656969e-28ec-41f1-bbf4-4d8ae93cfade" path="/var/lib/kubelet/pods/b656969e-28ec-41f1-bbf4-4d8ae93cfade/volumes"
Sep 08 00:17:31.701651 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:31.701614    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:31.803754 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:31.803721    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:32.028734 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:32.028618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:32.496974 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:32.496935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:33.154452 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:33.154414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:33.255737 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:33.255700    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:33.627973 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:33.627879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:35.670540 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:35.670500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:35.762608 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:35.762576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:36.873750 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:36.873714    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:36.974333 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:36.974289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:37.079408 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.079378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:37.359809 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.359771    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:37.441478 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.441445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:37.463478 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.463447    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"]
Sep 08 00:17:37.463820 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.463806    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b656969e-28ec-41f1-bbf4-4d8ae93cfade" containerName="authorino"
Sep 08 00:17:37.463860 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.463822    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b656969e-28ec-41f1-bbf4-4d8ae93cfade" containerName="authorino"
Sep 08 00:17:37.463894 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.463887    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b656969e-28ec-41f1-bbf4-4d8ae93cfade" containerName="authorino"
Sep 08 00:17:37.466120 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.466104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.468402 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.468336    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-4374d7\""
Sep 08 00:17:37.477046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.477025    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"]
Sep 08 00:17:37.483739 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.483715    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"]
Sep 08 00:17:37.486144 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.486121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:37.488170 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.488149    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-4374d7-dockercfg-z869t\""
Sep 08 00:17:37.496222 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.496200    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"]
Sep 08 00:17:37.587562 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.587515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c48x\" (UniqueName: \"kubernetes.io/projected/dcad275e-3729-4eac-a146-5bc8ed4eb66f-kube-api-access-8c48x\") pod \"payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:37.587766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.587606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcad275e-3729-4eac-a146-5bc8ed4eb66f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:37.587766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.587663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6e0b2e9-8378-4fba-9630-febc82ade566-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.587766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.587748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xlpk\" (UniqueName: \"kubernetes.io/projected/c6e0b2e9-8378-4fba-9630-febc82ade566-kube-api-access-2xlpk\") pod \"payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.688559 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.688515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xlpk\" (UniqueName: \"kubernetes.io/projected/c6e0b2e9-8378-4fba-9630-febc82ade566-kube-api-access-2xlpk\") pod \"payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.688729 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.688573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c48x\" (UniqueName: \"kubernetes.io/projected/dcad275e-3729-4eac-a146-5bc8ed4eb66f-kube-api-access-8c48x\") pod \"payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:37.688729 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.688618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcad275e-3729-4eac-a146-5bc8ed4eb66f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:37.688729 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.688657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6e0b2e9-8378-4fba-9630-febc82ade566-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.689371 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.689325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcad275e-3729-4eac-a146-5bc8ed4eb66f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:37.689417 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.689390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6e0b2e9-8378-4fba-9630-febc82ade566-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.695642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.695623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c48x\" (UniqueName: \"kubernetes.io/projected/dcad275e-3729-4eac-a146-5bc8ed4eb66f-kube-api-access-8c48x\") pod \"payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:37.695871 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.695853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xlpk\" (UniqueName: \"kubernetes.io/projected/c6e0b2e9-8378-4fba-9630-febc82ade566-kube-api-access-2xlpk\") pod \"payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.777060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.777025    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:37.798079 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:37.798055    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:38.049059 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.049030    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"]
Sep 08 00:17:38.051939 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:17:38.051912    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e0b2e9_8378_4fba_9630_febc82ade566.slice/crio-66e36b260f3f022f32e669a45a9b9cd1db7968935b9dd9ce25373ff20ad08e54 WatchSource:0}: Error finding container 66e36b260f3f022f32e669a45a9b9cd1db7968935b9dd9ce25373ff20ad08e54: Status 404 returned error can't find the container with id 66e36b260f3f022f32e669a45a9b9cd1db7968935b9dd9ce25373ff20ad08e54
Sep 08 00:17:38.079578 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.079549    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"]
Sep 08 00:17:38.089559 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:17:38.089533    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcad275e_3729_4eac_a146_5bc8ed4eb66f.slice/crio-0559160d18511dd73f3fbb7b71ed5927c6af737cc34227d1137a2cf568b1cb1d WatchSource:0}: Error finding container 0559160d18511dd73f3fbb7b71ed5927c6af737cc34227d1137a2cf568b1cb1d: Status 404 returned error can't find the container with id 0559160d18511dd73f3fbb7b71ed5927c6af737cc34227d1137a2cf568b1cb1d
Sep 08 00:17:38.969961 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.969922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8" event={"ID":"dcad275e-3729-4eac-a146-5bc8ed4eb66f","Type":"ContainerStarted","Data":"656940fab0788f6ef4cff9cb3acd09c6eb3df8a675aa0de25a8485a3ba7aba14"}
Sep 08 00:17:38.970179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.969982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8" event={"ID":"dcad275e-3729-4eac-a146-5bc8ed4eb66f","Type":"ContainerStarted","Data":"0559160d18511dd73f3fbb7b71ed5927c6af737cc34227d1137a2cf568b1cb1d"}
Sep 08 00:17:38.970179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.970108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:38.971525 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.971477    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl" event={"ID":"c6e0b2e9-8378-4fba-9630-febc82ade566","Type":"ContainerStarted","Data":"6b372ae8f14e2a0c5a49457bfe44c568b4ddce60d9ffee4887614f5996fa65e2"}
Sep 08 00:17:38.971669 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.971531    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:38.971669 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.971554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl" event={"ID":"c6e0b2e9-8378-4fba-9630-febc82ade566","Type":"ContainerStarted","Data":"66e36b260f3f022f32e669a45a9b9cd1db7968935b9dd9ce25373ff20ad08e54"}
Sep 08 00:17:38.983985 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.983929    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8" podStartSLOduration=1.9839140290000001 podStartE2EDuration="1.983914029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:38.982767766 +0000 UTC m=+899.468196375" watchObservedRunningTime="2026-09-08 00:17:38.983914029 +0000 UTC m=+899.469342636"
Sep 08 00:17:38.997646 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:38.997605    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl" podStartSLOduration=1.997591428 podStartE2EDuration="1.997591428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:38.995496012 +0000 UTC m=+899.480924624" watchObservedRunningTime="2026-09-08 00:17:38.997591428 +0000 UTC m=+899.483020036"
Sep 08 00:17:39.534305 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.534264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:39.646822 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.646787    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:39.780551 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.780508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:39.787799 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.787729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"]
Sep 08 00:17:39.790866 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.790848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:39.792969 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.792950    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-da86cacf-kserve-self-signed-certs\""
Sep 08 00:17:39.800476 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.800454    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"]
Sep 08 00:17:39.909511 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.909476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7gvw\" (UniqueName: \"kubernetes.io/projected/c501fbef-0643-47de-afc6-e3542789ec69-kube-api-access-j7gvw\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:39.909694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.909569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-tmp-dir\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:39.909694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.909597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c501fbef-0643-47de-afc6-e3542789ec69-tls-certs\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:39.909694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.909631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-model-cache\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:39.909694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.909660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-home\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:39.909694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:39.909684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-dshm\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011017 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.010979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gvw\" (UniqueName: \"kubernetes.io/projected/c501fbef-0643-47de-afc6-e3542789ec69-kube-api-access-j7gvw\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-tmp-dir\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c501fbef-0643-47de-afc6-e3542789ec69-tls-certs\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-model-cache\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011435 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-home\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011435 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-dshm\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011633 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-tmp-dir\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-home\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.011922 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.011831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-model-cache\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.013535 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.013508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-da86cacf-kserve-self-signed-certs\""
Sep 08 00:17:40.014396 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.014324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-dshm\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.019660 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.019616    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7gvw\" (UniqueName: \"kubernetes.io/projected/c501fbef-0643-47de-afc6-e3542789ec69-kube-api-access-j7gvw\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.024598 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.024575    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c501fbef-0643-47de-afc6-e3542789ec69-tls-certs\") pod \"e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") " pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.054896 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.054803    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:40.101327 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.101280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:40.165855 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.165774    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:40.273159 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.273115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:40.385102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.385076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"]
Sep 08 00:17:40.386969 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:17:40.386937    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc501fbef_0643_47de_afc6_e3542789ec69.slice/crio-1358288e7191b566c7b339555c427ce3801594678b9435cdf33258df04700b7f WatchSource:0}: Error finding container 1358288e7191b566c7b339555c427ce3801594678b9435cdf33258df04700b7f: Status 404 returned error can't find the container with id 1358288e7191b566c7b339555c427ce3801594678b9435cdf33258df04700b7f
Sep 08 00:17:40.983117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.983083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8" event={"ID":"c501fbef-0643-47de-afc6-e3542789ec69","Type":"ContainerStarted","Data":"c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae"}
Sep 08 00:17:40.983580 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.983125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8" event={"ID":"c501fbef-0643-47de-afc6-e3542789ec69","Type":"ContainerStarted","Data":"1358288e7191b566c7b339555c427ce3801594678b9435cdf33258df04700b7f"}
Sep 08 00:17:40.996946 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:40.996890    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8" podStartSLOduration=1.9968742179999999 podStartE2EDuration="1.996874218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:40.996395426 +0000 UTC m=+901.481824031" watchObservedRunningTime="2026-09-08 00:17:40.996874218 +0000 UTC m=+901.482302825"
Sep 08 00:17:41.480786 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:41.480748    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:41.770659 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:41.770563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:41.874612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:41.874575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:42.119825 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:42.119722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:42.294070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:42.294036    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:43.271978 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.271943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:43.368904 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.368871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:43.493577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.493545    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:43.765383 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.765332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:43.865689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.865656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:43.869355 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.869319    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"]
Sep 08 00:17:43.874070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.874054    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:43.876084 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.876063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-46c5cdbb\""
Sep 08 00:17:43.876190 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.876069    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-46c5cdbb-dockercfg-svzcp\""
Sep 08 00:17:43.881019 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.880994    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"]
Sep 08 00:17:43.912593 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.912564    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"]
Sep 08 00:17:43.916022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.916006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:43.928853 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:43.928831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"]
Sep 08 00:17:44.047244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.047152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdxb\" (UniqueName: \"kubernetes.io/projected/77eb605c-7be9-4578-bc05-e8e92d3c5400-kube-api-access-bhdxb\") pod \"payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") " pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:44.047244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.047201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85pzd\" (UniqueName: \"kubernetes.io/projected/f7d5f51b-5837-4639-8d02-88365263dc99-kube-api-access-85pzd\") pod \"payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:44.047244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.047243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb605c-7be9-4578-bc05-e8e92d3c5400-plugins-config-volume\") pod \"payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") " pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:44.047528 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.047275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7d5f51b-5837-4639-8d02-88365263dc99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:44.149963 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.149930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdxb\" (UniqueName: \"kubernetes.io/projected/77eb605c-7be9-4578-bc05-e8e92d3c5400-kube-api-access-bhdxb\") pod \"payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") " pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:44.150147 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.149981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85pzd\" (UniqueName: \"kubernetes.io/projected/f7d5f51b-5837-4639-8d02-88365263dc99-kube-api-access-85pzd\") pod \"payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:44.150147 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.150017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb605c-7be9-4578-bc05-e8e92d3c5400-plugins-config-volume\") pod \"payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") " pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:44.150147 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.150049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7d5f51b-5837-4639-8d02-88365263dc99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:44.150963 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.150935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7d5f51b-5837-4639-8d02-88365263dc99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:44.150963 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.150954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb605c-7be9-4578-bc05-e8e92d3c5400-plugins-config-volume\") pod \"payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") " pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:44.157712 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.157689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdxb\" (UniqueName: \"kubernetes.io/projected/77eb605c-7be9-4578-bc05-e8e92d3c5400-kube-api-access-bhdxb\") pod \"payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") " pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:44.157907 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.157884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85pzd\" (UniqueName: \"kubernetes.io/projected/f7d5f51b-5837-4639-8d02-88365263dc99-kube-api-access-85pzd\") pod \"payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:44.185320 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.185292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:44.227196 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.227167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:44.454899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.454744    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"]
Sep 08 00:17:44.458280 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:17:44.458250    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d5f51b_5837_4639_8d02_88365263dc99.slice/crio-b86a0cd1b0cb7a99bceee12ffbbcebd19e887ee326d9471eb26aafe1849035f2 WatchSource:0}: Error finding container b86a0cd1b0cb7a99bceee12ffbbcebd19e887ee326d9471eb26aafe1849035f2: Status 404 returned error can't find the container with id b86a0cd1b0cb7a99bceee12ffbbcebd19e887ee326d9471eb26aafe1849035f2
Sep 08 00:17:44.511371 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.511328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"]
Sep 08 00:17:44.518597 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:17:44.518559    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77eb605c_7be9_4578_bc05_e8e92d3c5400.slice/crio-99832f8e850e86c5c82ba3828d00402576a628deebe3491be52462955e714a46 WatchSource:0}: Error finding container 99832f8e850e86c5c82ba3828d00402576a628deebe3491be52462955e714a46: Status 404 returned error can't find the container with id 99832f8e850e86c5c82ba3828d00402576a628deebe3491be52462955e714a46
Sep 08 00:17:44.771212 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.771069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:44.862314 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:44.862277    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:45.004763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.004722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv" event={"ID":"77eb605c-7be9-4578-bc05-e8e92d3c5400","Type":"ContainerStarted","Data":"d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4"}
Sep 08 00:17:45.004963 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.004793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv" event={"ID":"77eb605c-7be9-4578-bc05-e8e92d3c5400","Type":"ContainerStarted","Data":"99832f8e850e86c5c82ba3828d00402576a628deebe3491be52462955e714a46"}
Sep 08 00:17:45.004963 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.004845    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:45.006584 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.006555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86" event={"ID":"f7d5f51b-5837-4639-8d02-88365263dc99","Type":"ContainerStarted","Data":"48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b"}
Sep 08 00:17:45.006748 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.006599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86" event={"ID":"f7d5f51b-5837-4639-8d02-88365263dc99","Type":"ContainerStarted","Data":"b86a0cd1b0cb7a99bceee12ffbbcebd19e887ee326d9471eb26aafe1849035f2"}
Sep 08 00:17:45.006748 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.006708    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:45.020010 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.019950    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv" podStartSLOduration=2.019932377 podStartE2EDuration="2.019932377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:45.018562572 +0000 UTC m=+905.503991199" watchObservedRunningTime="2026-09-08 00:17:45.019932377 +0000 UTC m=+905.505360978"
Sep 08 00:17:45.034666 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.034551    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86" podStartSLOduration=2.034535529 podStartE2EDuration="2.034535529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:45.034050076 +0000 UTC m=+905.519478684" watchObservedRunningTime="2026-09-08 00:17:45.034535529 +0000 UTC m=+905.519964137"
Sep 08 00:17:45.918676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:45.918644    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:46.018859 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.018818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:46.408920 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.408885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:46.494535 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.494492    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"]
Sep 08 00:17:46.497992 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.497965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:46.498766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.498748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:46.500718 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.500696    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-90b207\""
Sep 08 00:17:46.500830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.500759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-90b207-dockercfg-hj9v4\""
Sep 08 00:17:46.506711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.506683    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"]
Sep 08 00:17:46.562906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.562870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:46.574869 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.574827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:46.575060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.574996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pjmj\" (UniqueName: \"kubernetes.io/projected/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-kube-api-access-6pjmj\") pod \"payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:46.675843 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.675740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pjmj\" (UniqueName: \"kubernetes.io/projected/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-kube-api-access-6pjmj\") pod \"payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:46.675843 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.675792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:46.676593 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.676566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:46.682487 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.682462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pjmj\" (UniqueName: \"kubernetes.io/projected/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-kube-api-access-6pjmj\") pod \"payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:46.811724 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:46.811675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:47.083848 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:47.083819    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"]
Sep 08 00:17:47.086619 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:17:47.086590    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8815a3c6_cdac_4b08_8551_bc9cda0dc1ac.slice/crio-eb097337d9bbe84dd0fdd9c59524ed50ceb6602538f9077625cfa245547777bf WatchSource:0}: Error finding container eb097337d9bbe84dd0fdd9c59524ed50ceb6602538f9077625cfa245547777bf: Status 404 returned error can't find the container with id eb097337d9bbe84dd0fdd9c59524ed50ceb6602538f9077625cfa245547777bf
Sep 08 00:17:48.024512 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:48.024467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb" event={"ID":"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac","Type":"ContainerStarted","Data":"d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357"}
Sep 08 00:17:48.024786 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:48.024529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb" event={"ID":"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac","Type":"ContainerStarted","Data":"eb097337d9bbe84dd0fdd9c59524ed50ceb6602538f9077625cfa245547777bf"}
Sep 08 00:17:48.024786 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:48.024607    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:17:48.039183 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:48.039133    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb" podStartSLOduration=2.039118665 podStartE2EDuration="2.039118665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:48.037144569 +0000 UTC m=+908.522573177" watchObservedRunningTime="2026-09-08 00:17:48.039118665 +0000 UTC m=+908.524547324"
Sep 08 00:17:49.978319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:49.978279    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:17:49.978820 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:49.978473    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:17:50.101676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:50.101642    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:50.101853 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:50.101724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:50.115188 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:50.115169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:51.053074 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:51.053042    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:17:52.311249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:52.311216    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:52.499088 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:52.499052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:52.593425 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:52.593324    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:52.693064 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:52.693028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:55.330889 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:55.330839    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:56.015418 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:56.015381    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:17:56.015629 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:56.015502    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:17:56.920853 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:56.920814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:58.640676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:58.640617    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:17:59.032158 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:17:59.032121    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:18:00.508184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:00.508151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:00.809539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:00.809435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:02.321301 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:02.321264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:03.855843 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:03.855808    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:03.957756 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:03.957721    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:04.155998 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:04.155961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:05.567015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:05.566979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:05.664593 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:05.664533    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:05.926038 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:05.925995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:06.108547 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.108512    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:06.210455 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.210368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:06.217825 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.217797    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"]
Sep 08 00:18:06.221547 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.221529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.223536 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.223513    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c4541b-dockercfg-hzsvs\""
Sep 08 00:18:06.223628 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.223543    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c4541b\""
Sep 08 00:18:06.228193 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.228171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"]
Sep 08 00:18:06.249948 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.249920    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"]
Sep 08 00:18:06.253431 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.253409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.262724 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.262701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"]
Sep 08 00:18:06.368318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.368284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b082d56c-9183-4b64-855a-df788e05defc-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.368318 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.368321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7zzm\" (UniqueName: \"kubernetes.io/projected/b082d56c-9183-4b64-855a-df788e05defc-kube-api-access-h7zzm\") pod \"payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.368593 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.368372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.368593 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.368435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzkff\" (UniqueName: \"kubernetes.io/projected/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-kube-api-access-xzkff\") pod \"payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.460110 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.460069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:06.469292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.469218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b082d56c-9183-4b64-855a-df788e05defc-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.469292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.469255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7zzm\" (UniqueName: \"kubernetes.io/projected/b082d56c-9183-4b64-855a-df788e05defc-kube-api-access-h7zzm\") pod \"payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.469513 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.469289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.469513 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.469321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzkff\" (UniqueName: \"kubernetes.io/projected/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-kube-api-access-xzkff\") pod \"payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.470082 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.470057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b082d56c-9183-4b64-855a-df788e05defc-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.470082 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.470075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.477018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.476990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7zzm\" (UniqueName: \"kubernetes.io/projected/b082d56c-9183-4b64-855a-df788e05defc-kube-api-access-h7zzm\") pod \"payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.477108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.477033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzkff\" (UniqueName: \"kubernetes.io/projected/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-kube-api-access-xzkff\") pod \"payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.533178 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.533136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:06.565021 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.564983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:06.808016 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.807986    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"]
Sep 08 00:18:06.809850 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:18:06.809822    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8d86c5_4db3_4de8_87d1_80ad510ac89b.slice/crio-6210a6f76b7362fe2934a8696d704d5fc54c0d9e37a30019e59dfae3539817a8 WatchSource:0}: Error finding container 6210a6f76b7362fe2934a8696d704d5fc54c0d9e37a30019e59dfae3539817a8: Status 404 returned error can't find the container with id 6210a6f76b7362fe2934a8696d704d5fc54c0d9e37a30019e59dfae3539817a8
Sep 08 00:18:06.846593 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:06.846566    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"]
Sep 08 00:18:06.848714 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:18:06.848680    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb082d56c_9183_4b64_855a_df788e05defc.slice/crio-f02028e1b925320113eaf3111ca0a6aa51993f761032c09c0d7654d925d19fa2 WatchSource:0}: Error finding container f02028e1b925320113eaf3111ca0a6aa51993f761032c09c0d7654d925d19fa2: Status 404 returned error can't find the container with id f02028e1b925320113eaf3111ca0a6aa51993f761032c09c0d7654d925d19fa2
Sep 08 00:18:07.132537 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.132437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9" event={"ID":"b082d56c-9183-4b64-855a-df788e05defc","Type":"ContainerStarted","Data":"d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd"}
Sep 08 00:18:07.132537 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.132504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9" event={"ID":"b082d56c-9183-4b64-855a-df788e05defc","Type":"ContainerStarted","Data":"f02028e1b925320113eaf3111ca0a6aa51993f761032c09c0d7654d925d19fa2"}
Sep 08 00:18:07.132753 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.132563    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:07.134199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.134175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk" event={"ID":"2b8d86c5-4db3-4de8-87d1-80ad510ac89b","Type":"ContainerStarted","Data":"7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c"}
Sep 08 00:18:07.134308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.134217    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:07.134308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.134234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk" event={"ID":"2b8d86c5-4db3-4de8-87d1-80ad510ac89b","Type":"ContainerStarted","Data":"6210a6f76b7362fe2934a8696d704d5fc54c0d9e37a30019e59dfae3539817a8"}
Sep 08 00:18:07.148845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.148802    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9" podStartSLOduration=1.148787536 podStartE2EDuration="1.148787536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:07.146409612 +0000 UTC m=+927.631838221" watchObservedRunningTime="2026-09-08 00:18:07.148787536 +0000 UTC m=+927.634216143"
Sep 08 00:18:07.160824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.160780    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk" podStartSLOduration=1.160765288 podStartE2EDuration="1.160765288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:07.159073034 +0000 UTC m=+927.644501643" watchObservedRunningTime="2026-09-08 00:18:07.160765288 +0000 UTC m=+927.646193953"
Sep 08 00:18:07.279563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.279534    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:07.754919 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.754890    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:07.851552 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.851516    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:07.969480 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:07.969440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:08.133046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:08.132954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:08.888416 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:08.888380    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:09.581884 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:09.581848    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:09.682585 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:09.682548    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:13.637032 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:13.636993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:13.909839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:13.909795    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.010559 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.010521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.110902 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.110858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.247897 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.247818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.373664 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.373627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.399864 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.399832    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"]
Sep 08 00:18:14.400094 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.400068    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv" podUID="77eb605c-7be9-4578-bc05-e8e92d3c5400" containerName="payload-processing" containerID="cri-o://d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4" gracePeriod=30
Sep 08 00:18:14.409796 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.408165    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"]
Sep 08 00:18:14.409796 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.408381    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86" podUID="f7d5f51b-5837-4639-8d02-88365263dc99" containerName="payload-pre-processing" containerID="cri-o://48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b" gracePeriod=30
Sep 08 00:18:14.473467 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.473421    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.561948 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.561909    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.620913 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.620863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.671074 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.669494    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:18:14.702912 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.702883    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:18:14.719365 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.719304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:14.752557 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.752517    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhdxb\" (UniqueName: \"kubernetes.io/projected/77eb605c-7be9-4578-bc05-e8e92d3c5400-kube-api-access-bhdxb\") pod \"77eb605c-7be9-4578-bc05-e8e92d3c5400\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") "
Sep 08 00:18:14.752732 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.752586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb605c-7be9-4578-bc05-e8e92d3c5400-plugins-config-volume\") pod \"77eb605c-7be9-4578-bc05-e8e92d3c5400\" (UID: \"77eb605c-7be9-4578-bc05-e8e92d3c5400\") "
Sep 08 00:18:14.752990 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.752965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77eb605c-7be9-4578-bc05-e8e92d3c5400-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "77eb605c-7be9-4578-bc05-e8e92d3c5400" (UID: "77eb605c-7be9-4578-bc05-e8e92d3c5400"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:14.754742 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.754714    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77eb605c-7be9-4578-bc05-e8e92d3c5400-kube-api-access-bhdxb" (OuterVolumeSpecName: "kube-api-access-bhdxb") pod "77eb605c-7be9-4578-bc05-e8e92d3c5400" (UID: "77eb605c-7be9-4578-bc05-e8e92d3c5400"). InnerVolumeSpecName "kube-api-access-bhdxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:14.854246 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.854161    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85pzd\" (UniqueName: \"kubernetes.io/projected/f7d5f51b-5837-4639-8d02-88365263dc99-kube-api-access-85pzd\") pod \"f7d5f51b-5837-4639-8d02-88365263dc99\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") "
Sep 08 00:18:14.854246 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.854199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7d5f51b-5837-4639-8d02-88365263dc99-plugins-config-volume\") pod \"f7d5f51b-5837-4639-8d02-88365263dc99\" (UID: \"f7d5f51b-5837-4639-8d02-88365263dc99\") "
Sep 08 00:18:14.854484 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.854399    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhdxb\" (UniqueName: \"kubernetes.io/projected/77eb605c-7be9-4578-bc05-e8e92d3c5400-kube-api-access-bhdxb\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:14.854484 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.854411    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb605c-7be9-4578-bc05-e8e92d3c5400-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:14.854667 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.854636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7d5f51b-5837-4639-8d02-88365263dc99-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7d5f51b-5837-4639-8d02-88365263dc99" (UID: "f7d5f51b-5837-4639-8d02-88365263dc99"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:14.856412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.856393    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d5f51b-5837-4639-8d02-88365263dc99-kube-api-access-85pzd" (OuterVolumeSpecName: "kube-api-access-85pzd") pod "f7d5f51b-5837-4639-8d02-88365263dc99" (UID: "f7d5f51b-5837-4639-8d02-88365263dc99"). InnerVolumeSpecName "kube-api-access-85pzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:14.954899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.954858    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85pzd\" (UniqueName: \"kubernetes.io/projected/f7d5f51b-5837-4639-8d02-88365263dc99-kube-api-access-85pzd\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:14.954899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:14.954892    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7d5f51b-5837-4639-8d02-88365263dc99-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:15.134123 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.134034    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:15.176246 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.176201    2580 generic.go:356] "Generic (PLEG): container finished" podID="77eb605c-7be9-4578-bc05-e8e92d3c5400" containerID="d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4" exitCode=0
Sep 08 00:18:15.176246 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.176245    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"
Sep 08 00:18:15.176515 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.176285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv" event={"ID":"77eb605c-7be9-4578-bc05-e8e92d3c5400","Type":"ContainerDied","Data":"d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4"}
Sep 08 00:18:15.176515 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.176363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv" event={"ID":"77eb605c-7be9-4578-bc05-e8e92d3c5400","Type":"ContainerDied","Data":"99832f8e850e86c5c82ba3828d00402576a628deebe3491be52462955e714a46"}
Sep 08 00:18:15.176515 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.176400    2580 scope.go:117] "RemoveContainer" containerID="d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4"
Sep 08 00:18:15.177914 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.177881    2580 generic.go:356] "Generic (PLEG): container finished" podID="f7d5f51b-5837-4639-8d02-88365263dc99" containerID="48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b" exitCode=0
Sep 08 00:18:15.178008 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.177936    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"
Sep 08 00:18:15.178008 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.177955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86" event={"ID":"f7d5f51b-5837-4639-8d02-88365263dc99","Type":"ContainerDied","Data":"48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b"}
Sep 08 00:18:15.178008 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.177996    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86" event={"ID":"f7d5f51b-5837-4639-8d02-88365263dc99","Type":"ContainerDied","Data":"b86a0cd1b0cb7a99bceee12ffbbcebd19e887ee326d9471eb26aafe1849035f2"}
Sep 08 00:18:15.187838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.187814    2580 scope.go:117] "RemoveContainer" containerID="d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4"
Sep 08 00:18:15.188432 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:18:15.188152    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4\": container with ID starting with d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4 not found: ID does not exist" containerID="d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4"
Sep 08 00:18:15.188432 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.188180    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4"} err="failed to get container status \"d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4\": rpc error: code = NotFound desc = could not find container \"d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4\": container with ID starting with d54ad8e0d3107b69436ce4167a49ad19ae8fe22a76c1109f4e8fc413d3d2bcb4 not found: ID does not exist"
Sep 08 00:18:15.188432 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.188196    2580 scope.go:117] "RemoveContainer" containerID="48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b"
Sep 08 00:18:15.199150 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.199132    2580 scope.go:117] "RemoveContainer" containerID="48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b"
Sep 08 00:18:15.199497 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:18:15.199476    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b\": container with ID starting with 48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b not found: ID does not exist" containerID="48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b"
Sep 08 00:18:15.199569 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.199508    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b"} err="failed to get container status \"48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b\": rpc error: code = NotFound desc = could not find container \"48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b\": container with ID starting with 48285376e9dc9d6d334a01dba724cdb65fdb261bec42eae91c0a58713a6e5d2b not found: ID does not exist"
Sep 08 00:18:15.200075 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.200057    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"]
Sep 08 00:18:15.208166 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.208132    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:15.209532 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.209512    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46c5cdbb-7745444cb5-vdtlv"]
Sep 08 00:18:15.218739 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.218719    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"]
Sep 08 00:18:15.224492 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.224471    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46c5cdbb-685cf7d7f4-stq86"]
Sep 08 00:18:15.369813 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.369770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:15.620688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.620655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:15.775092 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.775014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:15.927597 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.927567    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77eb605c-7be9-4578-bc05-e8e92d3c5400" path="/var/lib/kubelet/pods/77eb605c-7be9-4578-bc05-e8e92d3c5400/volumes"
Sep 08 00:18:15.927937 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:15.927923    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7d5f51b-5837-4639-8d02-88365263dc99" path="/var/lib/kubelet/pods/f7d5f51b-5837-4639-8d02-88365263dc99/volumes"
Sep 08 00:18:18.141240 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:18.141204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:18:18.141631 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:18.141290    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:18:18.517181 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:18.517141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:18.617213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:18.617177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:18.750528 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:18.750488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:18.850999 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:18.850906    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:18.973464 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:18.973423    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:19.435105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.435068    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:19.477454 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.477421    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"]
Sep 08 00:18:19.477872 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.477858    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d5f51b-5837-4639-8d02-88365263dc99" containerName="payload-pre-processing"
Sep 08 00:18:19.477911 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.477873    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d5f51b-5837-4639-8d02-88365263dc99" containerName="payload-pre-processing"
Sep 08 00:18:19.477911 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.477885    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77eb605c-7be9-4578-bc05-e8e92d3c5400" containerName="payload-processing"
Sep 08 00:18:19.477911 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.477890    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="77eb605c-7be9-4578-bc05-e8e92d3c5400" containerName="payload-processing"
Sep 08 00:18:19.478022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.477960    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d5f51b-5837-4639-8d02-88365263dc99" containerName="payload-pre-processing"
Sep 08 00:18:19.478022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.477967    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="77eb605c-7be9-4578-bc05-e8e92d3c5400" containerName="payload-processing"
Sep 08 00:18:19.482565 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.482546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.484641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.484616    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-693d9ea3\""
Sep 08 00:18:19.484812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.484790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-693d9ea3-dockercfg-cxgwl\""
Sep 08 00:18:19.492940 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.492918    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"]
Sep 08 00:18:19.500130 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.500111    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"]
Sep 08 00:18:19.503618 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.503604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:19.513040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.513016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:19.518546 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.518256    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"]
Sep 08 00:18:19.599835 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.599801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wppp\" (UniqueName: \"kubernetes.io/projected/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-kube-api-access-6wppp\") pod \"payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") " pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:19.600015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.599890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.600015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.599942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxw9\" (UniqueName: \"kubernetes.io/projected/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-kube-api-access-2qxw9\") pod \"payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.600140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.600058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") " pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:19.701570 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.701463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxw9\" (UniqueName: \"kubernetes.io/projected/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-kube-api-access-2qxw9\") pod \"payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.701570 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.701553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") " pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:19.701809 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.701600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wppp\" (UniqueName: \"kubernetes.io/projected/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-kube-api-access-6wppp\") pod \"payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") " pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:19.701809 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.701678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.702287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.702264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") " pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:19.702695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.702672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.708652 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.708629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxw9\" (UniqueName: \"kubernetes.io/projected/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-kube-api-access-2qxw9\") pod \"payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.708824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.708804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wppp\" (UniqueName: \"kubernetes.io/projected/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-kube-api-access-6wppp\") pod \"payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") " pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:19.793654 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.793620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:19.815198 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:19.815166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:20.064841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.064814    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"]
Sep 08 00:18:20.065786 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:18:20.065763    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bf19ff_7997_48c2_865a_85bf18ec9ffc.slice/crio-75b73200747944b311afdc00fa455ba3bf3a49180a9fde4ded3ceeb877ec8bc7 WatchSource:0}: Error finding container 75b73200747944b311afdc00fa455ba3bf3a49180a9fde4ded3ceeb877ec8bc7: Status 404 returned error can't find the container with id 75b73200747944b311afdc00fa455ba3bf3a49180a9fde4ded3ceeb877ec8bc7
Sep 08 00:18:20.094444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.094418    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"]
Sep 08 00:18:20.098566 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:18:20.098537    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364b5c7e_ff1d_4dbe_a617_1ded71c3bae2.slice/crio-0fdffc6c9429a61afeff15c42a9fd27a6428d1b3848ca0c3401303411aafece8 WatchSource:0}: Error finding container 0fdffc6c9429a61afeff15c42a9fd27a6428d1b3848ca0c3401303411aafece8: Status 404 returned error can't find the container with id 0fdffc6c9429a61afeff15c42a9fd27a6428d1b3848ca0c3401303411aafece8
Sep 08 00:18:20.209560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.209506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4" event={"ID":"a3bf19ff-7997-48c2-865a-85bf18ec9ffc","Type":"ContainerStarted","Data":"e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516"}
Sep 08 00:18:20.209772 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.209589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4" event={"ID":"a3bf19ff-7997-48c2-865a-85bf18ec9ffc","Type":"ContainerStarted","Data":"75b73200747944b311afdc00fa455ba3bf3a49180a9fde4ded3ceeb877ec8bc7"}
Sep 08 00:18:20.209772 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.209727    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:20.211498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.211470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr" event={"ID":"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2","Type":"ContainerStarted","Data":"1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36"}
Sep 08 00:18:20.211630 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.211521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr" event={"ID":"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2","Type":"ContainerStarted","Data":"0fdffc6c9429a61afeff15c42a9fd27a6428d1b3848ca0c3401303411aafece8"}
Sep 08 00:18:20.211630 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.211573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:20.226228 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.226173    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4" podStartSLOduration=1.226154663 podStartE2EDuration="1.226154663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:20.223559529 +0000 UTC m=+940.708988141" watchObservedRunningTime="2026-09-08 00:18:20.226154663 +0000 UTC m=+940.711583277"
Sep 08 00:18:20.237171 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.237111    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr" podStartSLOduration=1.237092405 podStartE2EDuration="1.237092405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:20.236464449 +0000 UTC m=+940.721893056" watchObservedRunningTime="2026-09-08 00:18:20.237092405 +0000 UTC m=+940.722521014"
Sep 08 00:18:20.509278 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.509238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:20.609087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:20.609050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:26.471934 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:26.471894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:28.758193 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:28.758141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:31.217949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:31.217914    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:31.218406 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:31.218229    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:39.836306 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:39.836275    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:49.241738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.241699    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:49.271918 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.271887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"]
Sep 08 00:18:49.272195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.272166    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr" podUID="364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" containerName="payload-processing" containerID="cri-o://1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36" gracePeriod=30
Sep 08 00:18:49.280103 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.280075    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"]
Sep 08 00:18:49.280386 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.280324    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4" podUID="a3bf19ff-7997-48c2-865a-85bf18ec9ffc" containerName="payload-pre-processing" containerID="cri-o://e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516" gracePeriod=30
Sep 08 00:18:49.305713 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.305686    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:49.366524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.366497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:49.430206 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.430170    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:49.483460 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.483435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:49.567172 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.567150    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:49.569814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.569790    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:49.578629 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.578604    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:49.661987 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.661939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-plugins-config-volume\") pod \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") "
Sep 08 00:18:49.661987 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.661991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-plugins-config-volume\") pod \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") "
Sep 08 00:18:49.662241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.662016    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxw9\" (UniqueName: \"kubernetes.io/projected/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-kube-api-access-2qxw9\") pod \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\" (UID: \"a3bf19ff-7997-48c2-865a-85bf18ec9ffc\") "
Sep 08 00:18:49.662241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.662050    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wppp\" (UniqueName: \"kubernetes.io/projected/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-kube-api-access-6wppp\") pod \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\" (UID: \"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2\") "
Sep 08 00:18:49.662390 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.662339    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" (UID: "364b5c7e-ff1d-4dbe-a617-1ded71c3bae2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:49.662446 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.662338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3bf19ff-7997-48c2-865a-85bf18ec9ffc" (UID: "a3bf19ff-7997-48c2-865a-85bf18ec9ffc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:49.664203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.664180    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-kube-api-access-6wppp" (OuterVolumeSpecName: "kube-api-access-6wppp") pod "364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" (UID: "364b5c7e-ff1d-4dbe-a617-1ded71c3bae2"). InnerVolumeSpecName "kube-api-access-6wppp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:49.664255 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.664214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-kube-api-access-2qxw9" (OuterVolumeSpecName: "kube-api-access-2qxw9") pod "a3bf19ff-7997-48c2-865a-85bf18ec9ffc" (UID: "a3bf19ff-7997-48c2-865a-85bf18ec9ffc"). InnerVolumeSpecName "kube-api-access-2qxw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:49.763727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.763689    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:49.763727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.763721    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:49.763727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.763730    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxw9\" (UniqueName: \"kubernetes.io/projected/a3bf19ff-7997-48c2-865a-85bf18ec9ffc-kube-api-access-2qxw9\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:49.763949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:49.763739    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wppp\" (UniqueName: \"kubernetes.io/projected/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2-kube-api-access-6wppp\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:18:50.015017 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.014982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:50.318624 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.318593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:50.364690 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.364656    2580 generic.go:356] "Generic (PLEG): container finished" podID="a3bf19ff-7997-48c2-865a-85bf18ec9ffc" containerID="e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516" exitCode=0
Sep 08 00:18:50.364873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.364707    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"
Sep 08 00:18:50.364873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.364742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4" event={"ID":"a3bf19ff-7997-48c2-865a-85bf18ec9ffc","Type":"ContainerDied","Data":"e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516"}
Sep 08 00:18:50.364873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.364798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4" event={"ID":"a3bf19ff-7997-48c2-865a-85bf18ec9ffc","Type":"ContainerDied","Data":"75b73200747944b311afdc00fa455ba3bf3a49180a9fde4ded3ceeb877ec8bc7"}
Sep 08 00:18:50.364873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.364829    2580 scope.go:117] "RemoveContainer" containerID="e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516"
Sep 08 00:18:50.366284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.366215    2580 generic.go:356] "Generic (PLEG): container finished" podID="364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" containerID="1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36" exitCode=0
Sep 08 00:18:50.366284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.366265    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"
Sep 08 00:18:50.366284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.366271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr" event={"ID":"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2","Type":"ContainerDied","Data":"1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36"}
Sep 08 00:18:50.366468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.366311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr" event={"ID":"364b5c7e-ff1d-4dbe-a617-1ded71c3bae2","Type":"ContainerDied","Data":"0fdffc6c9429a61afeff15c42a9fd27a6428d1b3848ca0c3401303411aafece8"}
Sep 08 00:18:50.374808 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.374782    2580 scope.go:117] "RemoveContainer" containerID="e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516"
Sep 08 00:18:50.375100 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:18:50.375077    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516\": container with ID starting with e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516 not found: ID does not exist" containerID="e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516"
Sep 08 00:18:50.375191 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.375112    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516"} err="failed to get container status \"e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516\": rpc error: code = NotFound desc = could not find container \"e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516\": container with ID starting with e7bce2d2a61302ae934a2ce166b55f75bd2ded80824542d855009d2d1f400516 not found: ID does not exist"
Sep 08 00:18:50.375191 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.375134    2580 scope.go:117] "RemoveContainer" containerID="1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36"
Sep 08 00:18:50.383130 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.383107    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"]
Sep 08 00:18:50.383324 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.383308    2580 scope.go:117] "RemoveContainer" containerID="1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36"
Sep 08 00:18:50.383627 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:18:50.383604    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36\": container with ID starting with 1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36 not found: ID does not exist" containerID="1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36"
Sep 08 00:18:50.383710 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.383632    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36"} err="failed to get container status \"1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36\": rpc error: code = NotFound desc = could not find container \"1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36\": container with ID starting with 1d8a8d0c921c8cd63c5260a1c7a1625cf9689c18df7b8a1ae9f5073292029c36 not found: ID does not exist"
Sep 08 00:18:50.389403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.389382    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-693d9ea3-5cdbc96874-9hglr"]
Sep 08 00:18:50.398077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.398045    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"]
Sep 08 00:18:50.399760 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.399744    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-693d9ea3-774674f658-d6px4"]
Sep 08 00:18:50.520376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:50.520318    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:51.930444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:51.930395    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" path="/var/lib/kubelet/pods/364b5c7e-ff1d-4dbe-a617-1ded71c3bae2/volumes"
Sep 08 00:18:51.931535 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:51.931510    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3bf19ff-7997-48c2-865a-85bf18ec9ffc" path="/var/lib/kubelet/pods/a3bf19ff-7997-48c2-865a-85bf18ec9ffc/volumes"
Sep 08 00:18:52.688268 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:52.688233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:52.785638 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:52.785589    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:53.976404 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:53.976324    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:54.031082 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.031043    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:54.468599 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.468543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:54.566563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.566525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:54.567413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.567390    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"]
Sep 08 00:18:54.567821 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.567809    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" containerName="payload-processing"
Sep 08 00:18:54.567857 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.567824    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" containerName="payload-processing"
Sep 08 00:18:54.567857 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.567838    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bf19ff-7997-48c2-865a-85bf18ec9ffc" containerName="payload-pre-processing"
Sep 08 00:18:54.567857 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.567844    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bf19ff-7997-48c2-865a-85bf18ec9ffc" containerName="payload-pre-processing"
Sep 08 00:18:54.567948 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.567904    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3bf19ff-7997-48c2-865a-85bf18ec9ffc" containerName="payload-pre-processing"
Sep 08 00:18:54.567948 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.567914    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="364b5c7e-ff1d-4dbe-a617-1ded71c3bae2" containerName="payload-processing"
Sep 08 00:18:54.572766 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.572749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.574444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.574422    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-93fccec0\""
Sep 08 00:18:54.581687 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.581666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"]
Sep 08 00:18:54.608753 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.608718    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"]
Sep 08 00:18:54.612385 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.612366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:54.614177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.614156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-93fccec0-dockercfg-zfdm2\""
Sep 08 00:18:54.625661 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.625636    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"]
Sep 08 00:18:54.627881 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.627849    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:18:54.709672 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.709631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-plugins-config-volume\") pod \"payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") " pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:54.709672 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.709671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be8184ef-cebe-4971-8826-1b9afdf0f33a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.709899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.709711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5f26\" (UniqueName: \"kubernetes.io/projected/be8184ef-cebe-4971-8826-1b9afdf0f33a-kube-api-access-v5f26\") pod \"payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.709899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.709753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9mm\" (UniqueName: \"kubernetes.io/projected/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-kube-api-access-9c9mm\") pod \"payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") " pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:54.810780 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.810679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5f26\" (UniqueName: \"kubernetes.io/projected/be8184ef-cebe-4971-8826-1b9afdf0f33a-kube-api-access-v5f26\") pod \"payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.810780 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.810735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9mm\" (UniqueName: \"kubernetes.io/projected/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-kube-api-access-9c9mm\") pod \"payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") " pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:54.811044 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.810804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-plugins-config-volume\") pod \"payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") " pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:54.811044 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.810821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be8184ef-cebe-4971-8826-1b9afdf0f33a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.811575 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.811555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be8184ef-cebe-4971-8826-1b9afdf0f33a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.811628 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.811555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-plugins-config-volume\") pod \"payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") " pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:54.832641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.832602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5f26\" (UniqueName: \"kubernetes.io/projected/be8184ef-cebe-4971-8826-1b9afdf0f33a-kube-api-access-v5f26\") pod \"payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.839370 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.839313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9mm\" (UniqueName: \"kubernetes.io/projected/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-kube-api-access-9c9mm\") pod \"payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") " pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:54.884272 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.884233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:54.923960 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:54.923923    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:55.162081 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.162054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"]
Sep 08 00:18:55.164443 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:18:55.164409    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8184ef_cebe_4971_8826_1b9afdf0f33a.slice/crio-3b87cd097f999268c8ee31760886b167099a9140de6544ac7efe1d6326bde63e WatchSource:0}: Error finding container 3b87cd097f999268c8ee31760886b167099a9140de6544ac7efe1d6326bde63e: Status 404 returned error can't find the container with id 3b87cd097f999268c8ee31760886b167099a9140de6544ac7efe1d6326bde63e
Sep 08 00:18:55.220555 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.220534    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"]
Sep 08 00:18:55.223556 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:18:55.223527    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8d634e_c6b1_4795_9e61_7dfe7c6ffc35.slice/crio-d166637346e3c90667c182bcc0e029cb170de8c3db5b014320797bf060eed9e8 WatchSource:0}: Error finding container d166637346e3c90667c182bcc0e029cb170de8c3db5b014320797bf060eed9e8: Status 404 returned error can't find the container with id d166637346e3c90667c182bcc0e029cb170de8c3db5b014320797bf060eed9e8
Sep 08 00:18:55.399806 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.399758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8" event={"ID":"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35","Type":"ContainerStarted","Data":"347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718"}
Sep 08 00:18:55.399980 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.399827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8" event={"ID":"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35","Type":"ContainerStarted","Data":"d166637346e3c90667c182bcc0e029cb170de8c3db5b014320797bf060eed9e8"}
Sep 08 00:18:55.399980 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.399867    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:18:55.401620 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.401593    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6" event={"ID":"be8184ef-cebe-4971-8826-1b9afdf0f33a","Type":"ContainerStarted","Data":"962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d"}
Sep 08 00:18:55.401776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.401638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6" event={"ID":"be8184ef-cebe-4971-8826-1b9afdf0f33a","Type":"ContainerStarted","Data":"3b87cd097f999268c8ee31760886b167099a9140de6544ac7efe1d6326bde63e"}
Sep 08 00:18:55.401776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.401688    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:18:55.414214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.414127    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8" podStartSLOduration=1.414113406 podStartE2EDuration="1.414113406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:55.413316203 +0000 UTC m=+975.898744810" watchObservedRunningTime="2026-09-08 00:18:55.414113406 +0000 UTC m=+975.899542014"
Sep 08 00:18:55.427744 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:55.427693    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6" podStartSLOduration=1.427679279 podStartE2EDuration="1.427679279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:55.425498279 +0000 UTC m=+975.910926887" watchObservedRunningTime="2026-09-08 00:18:55.427679279 +0000 UTC m=+975.913107884"
Sep 08 00:18:57.265859 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:18:57.265794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:06.409586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:06.409496    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:19:06.409586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:06.409587    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:19:07.753835 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:07.753794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:07.853262 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:07.853229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:13.185801 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.185761    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"]
Sep 08 00:19:13.189353 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.189328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.191236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.191214    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-da86cacf-kserve-self-signed-certs\""
Sep 08 00:19:13.196204 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.196178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"]
Sep 08 00:19:13.286893 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.286865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-home\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.287060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.286944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfjnw\" (UniqueName: \"kubernetes.io/projected/f228546a-909d-47ca-a1b8-89a5deaa392e-kube-api-access-vfjnw\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.287060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.286967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-dshm\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.287060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.286990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-model-cache\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.287060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.287028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f228546a-909d-47ca-a1b8-89a5deaa392e-tls-certs\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.287060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.287048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-tmp-dir\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.292637 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.292615    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:13.387976 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.387954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-home\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388071 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfjnw\" (UniqueName: \"kubernetes.io/projected/f228546a-909d-47ca-a1b8-89a5deaa392e-kube-api-access-vfjnw\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388071 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-dshm\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388071 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-model-cache\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388071 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f228546a-909d-47ca-a1b8-89a5deaa392e-tls-certs\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388221 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-tmp-dir\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-home\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388463 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-tmp-dir\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.388513 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.388488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-model-cache\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.390259 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.390240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-dshm\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.390570 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.390552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f228546a-909d-47ca-a1b8-89a5deaa392e-tls-certs\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.394695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.394677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfjnw\" (UniqueName: \"kubernetes.io/projected/f228546a-909d-47ca-a1b8-89a5deaa392e-kube-api-access-vfjnw\") pod \"e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") " pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.500800 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.500744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:13.770791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:13.770764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"]
Sep 08 00:19:13.773463 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:19:13.773424    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf228546a_909d_47ca_a1b8_89a5deaa392e.slice/crio-557430997f25f125a4e08275b5c245a1fb2d2a1c2f3830001354bba7edc773b9 WatchSource:0}: Error finding container 557430997f25f125a4e08275b5c245a1fb2d2a1c2f3830001354bba7edc773b9: Status 404 returned error can't find the container with id 557430997f25f125a4e08275b5c245a1fb2d2a1c2f3830001354bba7edc773b9
Sep 08 00:19:14.506099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:14.506050    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm" event={"ID":"f228546a-909d-47ca-a1b8-89a5deaa392e","Type":"ContainerStarted","Data":"69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879"}
Sep 08 00:19:14.506543 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:14.506112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm" event={"ID":"f228546a-909d-47ca-a1b8-89a5deaa392e","Type":"ContainerStarted","Data":"557430997f25f125a4e08275b5c245a1fb2d2a1c2f3830001354bba7edc773b9"}
Sep 08 00:19:14.520801 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:14.520745    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm" podStartSLOduration=1.52072703 podStartE2EDuration="1.52072703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:19:14.518788667 +0000 UTC m=+995.004217274" watchObservedRunningTime="2026-09-08 00:19:14.52072703 +0000 UTC m=+995.006155639"
Sep 08 00:19:15.111690 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:15.111649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:23.501475 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:23.501442    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:23.501850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:23.501489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:23.513703 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:23.513678    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:23.562955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:23.562928    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:19:24.452987 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.452955    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:24.474819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.474782    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"]
Sep 08 00:19:24.475087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.475031    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8" podUID="0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" containerName="payload-processing" containerID="cri-o://347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718" gracePeriod=30
Sep 08 00:19:24.480912 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.480884    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"]
Sep 08 00:19:24.481132 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.481103    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6" podUID="be8184ef-cebe-4971-8826-1b9afdf0f33a" containerName="payload-pre-processing" containerID="cri-o://962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d" gracePeriod=30
Sep 08 00:19:24.553761 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.553719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:24.633623 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.633581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:24.692536 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.692498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:24.766893 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.766866    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:19:24.769839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.769812    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:19:24.799229 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.799197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-plugins-config-volume\") pod \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") "
Sep 08 00:19:24.799423 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.799303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5f26\" (UniqueName: \"kubernetes.io/projected/be8184ef-cebe-4971-8826-1b9afdf0f33a-kube-api-access-v5f26\") pod \"be8184ef-cebe-4971-8826-1b9afdf0f33a\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") "
Sep 08 00:19:24.799423 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.799340    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be8184ef-cebe-4971-8826-1b9afdf0f33a-plugins-config-volume\") pod \"be8184ef-cebe-4971-8826-1b9afdf0f33a\" (UID: \"be8184ef-cebe-4971-8826-1b9afdf0f33a\") "
Sep 08 00:19:24.799423 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.799378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c9mm\" (UniqueName: \"kubernetes.io/projected/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-kube-api-access-9c9mm\") pod \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\" (UID: \"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35\") "
Sep 08 00:19:24.799716 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.799680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" (UID: "0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:19:24.799842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.799776    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8184ef-cebe-4971-8826-1b9afdf0f33a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be8184ef-cebe-4971-8826-1b9afdf0f33a" (UID: "be8184ef-cebe-4971-8826-1b9afdf0f33a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:19:24.801822 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.801794    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8184ef-cebe-4971-8826-1b9afdf0f33a-kube-api-access-v5f26" (OuterVolumeSpecName: "kube-api-access-v5f26") pod "be8184ef-cebe-4971-8826-1b9afdf0f33a" (UID: "be8184ef-cebe-4971-8826-1b9afdf0f33a"). InnerVolumeSpecName "kube-api-access-v5f26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:19:24.801948 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.801869    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-kube-api-access-9c9mm" (OuterVolumeSpecName: "kube-api-access-9c9mm") pod "0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" (UID: "0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35"). InnerVolumeSpecName "kube-api-access-9c9mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:19:24.900392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.900330    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:19:24.900392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.900385    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5f26\" (UniqueName: \"kubernetes.io/projected/be8184ef-cebe-4971-8826-1b9afdf0f33a-kube-api-access-v5f26\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:19:24.900392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.900395    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be8184ef-cebe-4971-8826-1b9afdf0f33a-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:19:24.900392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:24.900405    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c9mm\" (UniqueName: \"kubernetes.io/projected/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35-kube-api-access-9c9mm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:19:25.565904 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.565866    2580 generic.go:356] "Generic (PLEG): container finished" podID="0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" containerID="347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718" exitCode=0
Sep 08 00:19:25.566357 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.565925    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"
Sep 08 00:19:25.566357 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.565954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8" event={"ID":"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35","Type":"ContainerDied","Data":"347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718"}
Sep 08 00:19:25.566357 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.566009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8" event={"ID":"0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35","Type":"ContainerDied","Data":"d166637346e3c90667c182bcc0e029cb170de8c3db5b014320797bf060eed9e8"}
Sep 08 00:19:25.566357 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.566025    2580 scope.go:117] "RemoveContainer" containerID="347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718"
Sep 08 00:19:25.567485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.567468    2580 generic.go:356] "Generic (PLEG): container finished" podID="be8184ef-cebe-4971-8826-1b9afdf0f33a" containerID="962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d" exitCode=0
Sep 08 00:19:25.567567 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.567529    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"
Sep 08 00:19:25.567620 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.567534    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6" event={"ID":"be8184ef-cebe-4971-8826-1b9afdf0f33a","Type":"ContainerDied","Data":"962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d"}
Sep 08 00:19:25.567683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.567661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6" event={"ID":"be8184ef-cebe-4971-8826-1b9afdf0f33a","Type":"ContainerDied","Data":"3b87cd097f999268c8ee31760886b167099a9140de6544ac7efe1d6326bde63e"}
Sep 08 00:19:25.579012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.578758    2580 scope.go:117] "RemoveContainer" containerID="347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718"
Sep 08 00:19:25.579761 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:19:25.579338    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718\": container with ID starting with 347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718 not found: ID does not exist" containerID="347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718"
Sep 08 00:19:25.579920 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.579773    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718"} err="failed to get container status \"347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718\": rpc error: code = NotFound desc = could not find container \"347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718\": container with ID starting with 347f34654274978ef327997239a786aec58b3b49e88c7037480d1f2b7cd30718 not found: ID does not exist"
Sep 08 00:19:25.579920 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.579797    2580 scope.go:117] "RemoveContainer" containerID="962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d"
Sep 08 00:19:25.588017 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.587998    2580 scope.go:117] "RemoveContainer" containerID="962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d"
Sep 08 00:19:25.588327 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:19:25.588297    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d\": container with ID starting with 962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d not found: ID does not exist" containerID="962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d"
Sep 08 00:19:25.588439 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.588335    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d"} err="failed to get container status \"962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d\": rpc error: code = NotFound desc = could not find container \"962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d\": container with ID starting with 962c227b9aaf037c3c59de69365c808457891c315e6aec96a43ff283917a969d not found: ID does not exist"
Sep 08 00:19:25.593300 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.593275    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"]
Sep 08 00:19:25.597213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.597190    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93fccec0-9f4f79947-8zlc8"]
Sep 08 00:19:25.606639 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.606609    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"]
Sep 08 00:19:25.612433 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.610294    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93fccec0-86d86df85d-48fv6"]
Sep 08 00:19:25.749588 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.749504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:25.927331 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.927297    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" path="/var/lib/kubelet/pods/0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35/volumes"
Sep 08 00:19:25.927699 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:25.927685    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be8184ef-cebe-4971-8826-1b9afdf0f33a" path="/var/lib/kubelet/pods/be8184ef-cebe-4971-8826-1b9afdf0f33a/volumes"
Sep 08 00:19:26.148154 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:26.148117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:26.447214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:26.447130    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:26.589377 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:26.589330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:28.968115 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:28.968073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:29.063894 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:29.063863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:30.153319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.153286    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:30.216305 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.216254    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:30.381017 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.380980    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:30.744401 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.744358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:30.833041 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.833007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:19:30.866986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.866953    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"]
Sep 08 00:19:30.867440 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.867426    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8184ef-cebe-4971-8826-1b9afdf0f33a" containerName="payload-pre-processing"
Sep 08 00:19:30.867485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.867442    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8184ef-cebe-4971-8826-1b9afdf0f33a" containerName="payload-pre-processing"
Sep 08 00:19:30.867485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.867453    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" containerName="payload-processing"
Sep 08 00:19:30.867485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.867460    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" containerName="payload-processing"
Sep 08 00:19:30.867581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.867543    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c8d634e-c6b1-4795-9e61-7dfe7c6ffc35" containerName="payload-processing"
Sep 08 00:19:30.867581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.867554    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="be8184ef-cebe-4971-8826-1b9afdf0f33a" containerName="payload-pre-processing"
Sep 08 00:19:30.872201 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.872178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:30.874006 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.873982    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-5de06f3e-dockercfg-m5fjc\""
Sep 08 00:19:30.874232 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.874218    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-5de06f3e\""
Sep 08 00:19:30.880466 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.880443    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"]
Sep 08 00:19:30.956631 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.956592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-plugins-config-volume\") pod \"payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") " pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:30.956806 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:30.956703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8pqh\" (UniqueName: \"kubernetes.io/projected/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-kube-api-access-q8pqh\") pod \"payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") " pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:31.058135 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.058030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-plugins-config-volume\") pod \"payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") " pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:31.058135 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.058109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8pqh\" (UniqueName: \"kubernetes.io/projected/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-kube-api-access-q8pqh\") pod \"payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") " pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:31.058904 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.058874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-plugins-config-volume\") pod \"payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") " pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:31.065518 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.065478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8pqh\" (UniqueName: \"kubernetes.io/projected/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-kube-api-access-q8pqh\") pod \"payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") " pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:31.184037 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.183999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:31.459369 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.455521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"]
Sep 08 00:19:31.464425 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:19:31.464391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79dcb277_c9b3_48df_ab3e_12cb381fdfcb.slice/crio-446192332b8be1b96f6678dff8d9682a6b0e30d30ae1304665af0273868571e2 WatchSource:0}: Error finding container 446192332b8be1b96f6678dff8d9682a6b0e30d30ae1304665af0273868571e2: Status 404 returned error can't find the container with id 446192332b8be1b96f6678dff8d9682a6b0e30d30ae1304665af0273868571e2
Sep 08 00:19:31.603328 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.603293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x" event={"ID":"79dcb277-c9b3-48df-ab3e-12cb381fdfcb","Type":"ContainerStarted","Data":"527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3"}
Sep 08 00:19:31.603523 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.603365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x" event={"ID":"79dcb277-c9b3-48df-ab3e-12cb381fdfcb","Type":"ContainerStarted","Data":"446192332b8be1b96f6678dff8d9682a6b0e30d30ae1304665af0273868571e2"}
Sep 08 00:19:31.603523 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.603504    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:31.618639 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:31.618587    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x" podStartSLOduration=1.6185720049999999 podStartE2EDuration="1.618572005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:19:31.617139482 +0000 UTC m=+1012.102568090" watchObservedRunningTime="2026-09-08 00:19:31.618572005 +0000 UTC m=+1012.104000610"
Sep 08 00:19:42.610558 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:42.610522    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:19:57.970617 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:19:57.970584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:00.696989 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:00.696955    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:00.717187 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:00.717148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"]
Sep 08 00:20:00.717571 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:00.717506    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x" podUID="79dcb277-c9b3-48df-ab3e-12cb381fdfcb" containerName="payload-processing" containerID="cri-o://527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3" gracePeriod=30
Sep 08 00:20:00.797227 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:00.797185    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:00.878420 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:00.878385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:00.960500 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:00.960463    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:00.987405 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:00.987377    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:20:01.033030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.032997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:01.040146 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.040124    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-plugins-config-volume\") pod \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") "
Sep 08 00:20:01.040282 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.040268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8pqh\" (UniqueName: \"kubernetes.io/projected/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-kube-api-access-q8pqh\") pod \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\" (UID: \"79dcb277-c9b3-48df-ab3e-12cb381fdfcb\") "
Sep 08 00:20:01.040542 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.040519    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79dcb277-c9b3-48df-ab3e-12cb381fdfcb" (UID: "79dcb277-c9b3-48df-ab3e-12cb381fdfcb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:20:01.042659 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.042631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-kube-api-access-q8pqh" (OuterVolumeSpecName: "kube-api-access-q8pqh") pod "79dcb277-c9b3-48df-ab3e-12cb381fdfcb" (UID: "79dcb277-c9b3-48df-ab3e-12cb381fdfcb"). InnerVolumeSpecName "kube-api-access-q8pqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:01.141208 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.141169    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8pqh\" (UniqueName: \"kubernetes.io/projected/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-kube-api-access-q8pqh\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:01.141208 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.141200    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79dcb277-c9b3-48df-ab3e-12cb381fdfcb-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:01.647908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.647858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:01.762413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.762379    2580 generic.go:356] "Generic (PLEG): container finished" podID="79dcb277-c9b3-48df-ab3e-12cb381fdfcb" containerID="527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3" exitCode=0
Sep 08 00:20:01.762819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.762426    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"
Sep 08 00:20:01.762819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.762463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x" event={"ID":"79dcb277-c9b3-48df-ab3e-12cb381fdfcb","Type":"ContainerDied","Data":"527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3"}
Sep 08 00:20:01.762819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.762521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x" event={"ID":"79dcb277-c9b3-48df-ab3e-12cb381fdfcb","Type":"ContainerDied","Data":"446192332b8be1b96f6678dff8d9682a6b0e30d30ae1304665af0273868571e2"}
Sep 08 00:20:01.762819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.762553    2580 scope.go:117] "RemoveContainer" containerID="527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3"
Sep 08 00:20:01.772105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.772087    2580 scope.go:117] "RemoveContainer" containerID="527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3"
Sep 08 00:20:01.772415 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:20:01.772396    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3\": container with ID starting with 527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3 not found: ID does not exist" containerID="527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3"
Sep 08 00:20:01.772470 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.772425    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3"} err="failed to get container status \"527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3\": rpc error: code = NotFound desc = could not find container \"527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3\": container with ID starting with 527720026c2d46aa3c1b0cb7126900bdd75dfd00d68587fb1c6f1c230ec079e3 not found: ID does not exist"
Sep 08 00:20:01.786738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.786688    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"]
Sep 08 00:20:01.788694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.788672    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5de06f3e-64796d8c69-f5b5x"]
Sep 08 00:20:01.889392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.889365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:01.927300 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.927232    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79dcb277-c9b3-48df-ab3e-12cb381fdfcb" path="/var/lib/kubelet/pods/79dcb277-c9b3-48df-ab3e-12cb381fdfcb/volumes"
Sep 08 00:20:01.989967 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:01.989924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:03.177564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:03.177519    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:04.291307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:04.290851    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"]
Sep 08 00:20:04.303672 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:04.303643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:09.006321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:09.006286    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:09.067537 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:09.067496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:09.441580 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:09.441540    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:14.374922 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:14.374867    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:15.080821 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.080782    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"]
Sep 08 00:20:15.081413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.081396    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79dcb277-c9b3-48df-ab3e-12cb381fdfcb" containerName="payload-processing"
Sep 08 00:20:15.081465 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.081414    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="79dcb277-c9b3-48df-ab3e-12cb381fdfcb" containerName="payload-processing"
Sep 08 00:20:15.081501 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.081490    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="79dcb277-c9b3-48df-ab3e-12cb381fdfcb" containerName="payload-processing"
Sep 08 00:20:15.085016 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.084987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.087287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.087256    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4374d7\"/\"default-dockercfg-dnm89\""
Sep 08 00:20:15.087441 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.087280    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4374d7\"/\"openshift-service-ca.crt\""
Sep 08 00:20:15.087441 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.087318    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4374d7\"/\"kube-root-ca.crt\""
Sep 08 00:20:15.087441 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.087383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4374d7\"/\"test-model-4374d7-kserve-self-signed-certs\""
Sep 08 00:20:15.090337 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.090316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"]
Sep 08 00:20:15.104213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.104183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:15.177620 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.177587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-home\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.177791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.177638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-dshm\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.177791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.177665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqfgq\" (UniqueName: \"kubernetes.io/projected/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-kube-api-access-qqfgq\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.177791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.177717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-model-cache\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.177791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.177740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tmp-dir\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.177961 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.177793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tls-certs\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.278742 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.278709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-home\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.278909 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.278755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-dshm\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.278909 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.278783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqfgq\" (UniqueName: \"kubernetes.io/projected/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-kube-api-access-qqfgq\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.278909 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.278829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-model-cache\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.278909 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.278855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tmp-dir\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.279161 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.278913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tls-certs\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.279219 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.279172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-home\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.279274 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.279252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-model-cache\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.279313 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.279278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tmp-dir\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.281148 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.281129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-dshm\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.281313 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.281300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tls-certs\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.287729 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.287704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqfgq\" (UniqueName: \"kubernetes.io/projected/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-kube-api-access-qqfgq\") pod \"test-model-4374d7-kserve-945497ddc-c9dfm\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") " pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.396362 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.396284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:15.663312 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.663288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"]
Sep 08 00:20:15.665472 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:20:15.665447    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6a2eec7_9c7d_4486_aaef_b35672a4ad17.slice/crio-573ce305a1e6e5078da1c392c1dfa1ec34a979a2f62715ef694cea3f00508881 WatchSource:0}: Error finding container 573ce305a1e6e5078da1c392c1dfa1ec34a979a2f62715ef694cea3f00508881: Status 404 returned error can't find the container with id 573ce305a1e6e5078da1c392c1dfa1ec34a979a2f62715ef694cea3f00508881
Sep 08 00:20:15.836604 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.836566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm" event={"ID":"f6a2eec7-9c7d-4486-aaef-b35672a4ad17","Type":"ContainerStarted","Data":"ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47"}
Sep 08 00:20:15.836604 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.836607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm" event={"ID":"f6a2eec7-9c7d-4486-aaef-b35672a4ad17","Type":"ContainerStarted","Data":"573ce305a1e6e5078da1c392c1dfa1ec34a979a2f62715ef694cea3f00508881"}
Sep 08 00:20:15.856364 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:15.852523    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm" podStartSLOduration=0.852501991 podStartE2EDuration="852.501991ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:20:15.849803926 +0000 UTC m=+1056.335232533" watchObservedRunningTime="2026-09-08 00:20:15.852501991 +0000 UTC m=+1056.337930602"
Sep 08 00:20:17.799000 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:17.798965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"]
Sep 08 00:20:17.819736 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:17.819707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:19.206160 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.206120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:19.313718 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.313681    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8" podUID="c501fbef-0643-47de-afc6-e3542789ec69" containerName="main" containerID="cri-o://c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae" gracePeriod=45
Sep 08 00:20:19.474705 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.474598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:19.579954 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.579931    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:20:19.724641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.724604    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c501fbef-0643-47de-afc6-e3542789ec69-tls-certs\") pod \"c501fbef-0643-47de-afc6-e3542789ec69\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") "
Sep 08 00:20:19.724842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.724678    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-home\") pod \"c501fbef-0643-47de-afc6-e3542789ec69\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") "
Sep 08 00:20:19.724842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.724701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-tmp-dir\") pod \"c501fbef-0643-47de-afc6-e3542789ec69\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") "
Sep 08 00:20:19.724842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.724719    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7gvw\" (UniqueName: \"kubernetes.io/projected/c501fbef-0643-47de-afc6-e3542789ec69-kube-api-access-j7gvw\") pod \"c501fbef-0643-47de-afc6-e3542789ec69\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") "
Sep 08 00:20:19.724842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.724749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-dshm\") pod \"c501fbef-0643-47de-afc6-e3542789ec69\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") "
Sep 08 00:20:19.724842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.724784    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-model-cache\") pod \"c501fbef-0643-47de-afc6-e3542789ec69\" (UID: \"c501fbef-0643-47de-afc6-e3542789ec69\") "
Sep 08 00:20:19.725117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.725016    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-home" (OuterVolumeSpecName: "home") pod "c501fbef-0643-47de-afc6-e3542789ec69" (UID: "c501fbef-0643-47de-afc6-e3542789ec69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:19.725117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.725049    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c501fbef-0643-47de-afc6-e3542789ec69" (UID: "c501fbef-0643-47de-afc6-e3542789ec69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:19.725117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.725087    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-model-cache" (OuterVolumeSpecName: "model-cache") pod "c501fbef-0643-47de-afc6-e3542789ec69" (UID: "c501fbef-0643-47de-afc6-e3542789ec69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:19.727095 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.727065    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-dshm" (OuterVolumeSpecName: "dshm") pod "c501fbef-0643-47de-afc6-e3542789ec69" (UID: "c501fbef-0643-47de-afc6-e3542789ec69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:19.727220 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.727116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c501fbef-0643-47de-afc6-e3542789ec69-kube-api-access-j7gvw" (OuterVolumeSpecName: "kube-api-access-j7gvw") pod "c501fbef-0643-47de-afc6-e3542789ec69" (UID: "c501fbef-0643-47de-afc6-e3542789ec69"). InnerVolumeSpecName "kube-api-access-j7gvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:19.727220 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.727184    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c501fbef-0643-47de-afc6-e3542789ec69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c501fbef-0643-47de-afc6-e3542789ec69" (UID: "c501fbef-0643-47de-afc6-e3542789ec69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:20:19.826281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.826235    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-home\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:19.826281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.826275    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-tmp-dir\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:19.826281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.826285    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7gvw\" (UniqueName: \"kubernetes.io/projected/c501fbef-0643-47de-afc6-e3542789ec69-kube-api-access-j7gvw\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:19.826281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.826296    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-dshm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:19.826558 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.826305    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c501fbef-0643-47de-afc6-e3542789ec69-model-cache\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:19.826558 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.826313    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c501fbef-0643-47de-afc6-e3542789ec69-tls-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:19.859265 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.859235    2580 generic.go:356] "Generic (PLEG): container finished" podID="c501fbef-0643-47de-afc6-e3542789ec69" containerID="c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae" exitCode=0
Sep 08 00:20:19.859448 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.859278    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"
Sep 08 00:20:19.859448 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.859284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8" event={"ID":"c501fbef-0643-47de-afc6-e3542789ec69","Type":"ContainerDied","Data":"c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae"}
Sep 08 00:20:19.859448 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.859322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8" event={"ID":"c501fbef-0643-47de-afc6-e3542789ec69","Type":"ContainerDied","Data":"1358288e7191b566c7b339555c427ce3801594678b9435cdf33258df04700b7f"}
Sep 08 00:20:19.859448 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.859358    2580 scope.go:117] "RemoveContainer" containerID="c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae"
Sep 08 00:20:19.869724 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.869707    2580 scope.go:117] "RemoveContainer" containerID="c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae"
Sep 08 00:20:19.870053 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:20:19.870023    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae\": container with ID starting with c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae not found: ID does not exist" containerID="c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae"
Sep 08 00:20:19.870176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.870065    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae"} err="failed to get container status \"c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae\": rpc error: code = NotFound desc = could not find container \"c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae\": container with ID starting with c5f66d7407c023e7de297e9be1280a194110dd146ec68296f2b8d287647722ae not found: ID does not exist"
Sep 08 00:20:19.879179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.879154    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"]
Sep 08 00:20:19.882874 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.882853    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-da86cacf-kserve-79fccd67d9-hknp8"]
Sep 08 00:20:19.927310 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:19.927278    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c501fbef-0643-47de-afc6-e3542789ec69" path="/var/lib/kubelet/pods/c501fbef-0643-47de-afc6-e3542789ec69/volumes"
Sep 08 00:20:25.397310 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:25.397270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:25.397733 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:25.397328    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:25.409793 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:25.409765    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:25.901804 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:25.901767    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:20:29.371187 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:29.371152    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:29.785163 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:29.785132    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:29.822632 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:29.822601    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"]
Sep 08 00:20:29.822863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:29.822837    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb" podUID="8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" containerName="payload-pre-processing" containerID="cri-o://d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357" gracePeriod=30
Sep 08 00:20:29.848444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:29.848402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:29.947872 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:29.947834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:30.032337 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.032302    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:30.081248 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.081225    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:20:30.221085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.221057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pjmj\" (UniqueName: \"kubernetes.io/projected/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-kube-api-access-6pjmj\") pod \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") "
Sep 08 00:20:30.221280 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.221133    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-plugins-config-volume\") pod \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\" (UID: \"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac\") "
Sep 08 00:20:30.221553 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.221524    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" (UID: "8815a3c6-cdac-4b08-8551-bc9cda0dc1ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:20:30.223194 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.223166    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-kube-api-access-6pjmj" (OuterVolumeSpecName: "kube-api-access-6pjmj") pod "8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" (UID: "8815a3c6-cdac-4b08-8551-bc9cda0dc1ac"). InnerVolumeSpecName "kube-api-access-6pjmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:30.320687 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.320602    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:30.322810 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.322786    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pjmj\" (UniqueName: \"kubernetes.io/projected/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-kube-api-access-6pjmj\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:30.322882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.322814    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:30.919832 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.919793    2580 generic.go:356] "Generic (PLEG): container finished" podID="8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" containerID="d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357" exitCode=0
Sep 08 00:20:30.920289 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.919838    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"
Sep 08 00:20:30.920289 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.919874    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb" event={"ID":"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac","Type":"ContainerDied","Data":"d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357"}
Sep 08 00:20:30.920289 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.919921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb" event={"ID":"8815a3c6-cdac-4b08-8551-bc9cda0dc1ac","Type":"ContainerDied","Data":"eb097337d9bbe84dd0fdd9c59524ed50ceb6602538f9077625cfa245547777bf"}
Sep 08 00:20:30.920289 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.919946    2580 scope.go:117] "RemoveContainer" containerID="d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357"
Sep 08 00:20:30.929316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.929291    2580 scope.go:117] "RemoveContainer" containerID="d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357"
Sep 08 00:20:30.929650 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:20:30.929629    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357\": container with ID starting with d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357 not found: ID does not exist" containerID="d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357"
Sep 08 00:20:30.929719 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.929660    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357"} err="failed to get container status \"d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357\": rpc error: code = NotFound desc = could not find container \"d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357\": container with ID starting with d09f752a4ecf672e7b0f0cfa4ddfc4ba17b59ba08b4c346d957b350cb18c7357 not found: ID does not exist"
Sep 08 00:20:30.940219 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.940191    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"]
Sep 08 00:20:30.943232 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:30.943207    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-90b207-5bdd757b54-vl5qb"]
Sep 08 00:20:31.926607 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:31.926575    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" path="/var/lib/kubelet/pods/8815a3c6-cdac-4b08-8551-bc9cda0dc1ac/volumes"
Sep 08 00:20:32.820208 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:32.820164    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm" podUID="f228546a-909d-47ca-a1b8-89a5deaa392e" containerName="main" containerID="cri-o://69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879" gracePeriod=45
Sep 08 00:20:33.080139 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.080081    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:20:33.145421 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145390    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfjnw\" (UniqueName: \"kubernetes.io/projected/f228546a-909d-47ca-a1b8-89a5deaa392e-kube-api-access-vfjnw\") pod \"f228546a-909d-47ca-a1b8-89a5deaa392e\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") "
Sep 08 00:20:33.145421 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145423    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f228546a-909d-47ca-a1b8-89a5deaa392e-tls-certs\") pod \"f228546a-909d-47ca-a1b8-89a5deaa392e\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") "
Sep 08 00:20:33.145650 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145457    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-model-cache\") pod \"f228546a-909d-47ca-a1b8-89a5deaa392e\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") "
Sep 08 00:20:33.145650 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145473    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-dshm\") pod \"f228546a-909d-47ca-a1b8-89a5deaa392e\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") "
Sep 08 00:20:33.145650 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145495    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-tmp-dir\") pod \"f228546a-909d-47ca-a1b8-89a5deaa392e\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") "
Sep 08 00:20:33.145650 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145519    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-home\") pod \"f228546a-909d-47ca-a1b8-89a5deaa392e\" (UID: \"f228546a-909d-47ca-a1b8-89a5deaa392e\") "
Sep 08 00:20:33.145863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145768    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-model-cache" (OuterVolumeSpecName: "model-cache") pod "f228546a-909d-47ca-a1b8-89a5deaa392e" (UID: "f228546a-909d-47ca-a1b8-89a5deaa392e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:33.145863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145799    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-home" (OuterVolumeSpecName: "home") pod "f228546a-909d-47ca-a1b8-89a5deaa392e" (UID: "f228546a-909d-47ca-a1b8-89a5deaa392e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:33.145863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.145777    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f228546a-909d-47ca-a1b8-89a5deaa392e" (UID: "f228546a-909d-47ca-a1b8-89a5deaa392e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:33.147757 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.147731    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-dshm" (OuterVolumeSpecName: "dshm") pod "f228546a-909d-47ca-a1b8-89a5deaa392e" (UID: "f228546a-909d-47ca-a1b8-89a5deaa392e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:33.147757 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.147737    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f228546a-909d-47ca-a1b8-89a5deaa392e-kube-api-access-vfjnw" (OuterVolumeSpecName: "kube-api-access-vfjnw") pod "f228546a-909d-47ca-a1b8-89a5deaa392e" (UID: "f228546a-909d-47ca-a1b8-89a5deaa392e"). InnerVolumeSpecName "kube-api-access-vfjnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:33.147905 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.147760    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f228546a-909d-47ca-a1b8-89a5deaa392e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f228546a-909d-47ca-a1b8-89a5deaa392e" (UID: "f228546a-909d-47ca-a1b8-89a5deaa392e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:20:33.246506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.246472    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfjnw\" (UniqueName: \"kubernetes.io/projected/f228546a-909d-47ca-a1b8-89a5deaa392e-kube-api-access-vfjnw\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:33.246506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.246500    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f228546a-909d-47ca-a1b8-89a5deaa392e-tls-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:33.246506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.246512    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-model-cache\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:33.246743 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.246520    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-dshm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:33.246743 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.246528    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-tmp-dir\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:33.246743 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.246536    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f228546a-909d-47ca-a1b8-89a5deaa392e-home\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:20:33.937763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.937446    2580 generic.go:356] "Generic (PLEG): container finished" podID="f228546a-909d-47ca-a1b8-89a5deaa392e" containerID="69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879" exitCode=0
Sep 08 00:20:33.937763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.937520    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"
Sep 08 00:20:33.937763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.937550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm" event={"ID":"f228546a-909d-47ca-a1b8-89a5deaa392e","Type":"ContainerDied","Data":"69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879"}
Sep 08 00:20:33.937763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.937604    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm" event={"ID":"f228546a-909d-47ca-a1b8-89a5deaa392e","Type":"ContainerDied","Data":"557430997f25f125a4e08275b5c245a1fb2d2a1c2f3830001354bba7edc773b9"}
Sep 08 00:20:33.937763 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.937628    2580 scope.go:117] "RemoveContainer" containerID="69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879"
Sep 08 00:20:33.947403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.947384    2580 scope.go:117] "RemoveContainer" containerID="69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879"
Sep 08 00:20:33.947672 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:20:33.947656    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879\": container with ID starting with 69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879 not found: ID does not exist" containerID="69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879"
Sep 08 00:20:33.947712 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.947680    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879"} err="failed to get container status \"69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879\": rpc error: code = NotFound desc = could not find container \"69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879\": container with ID starting with 69828780c8e284c42a1d6edc6c3a6893206e54c6884d2f41d4b7ce7752e95879 not found: ID does not exist"
Sep 08 00:20:33.951609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.951586    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"]
Sep 08 00:20:33.956726 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:33.956704    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-da86cacf-kserve-c8ffc4b79-7j7pm"]
Sep 08 00:20:35.350470 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:35.350434    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:35.928139 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:35.928108    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f228546a-909d-47ca-a1b8-89a5deaa392e" path="/var/lib/kubelet/pods/f228546a-909d-47ca-a1b8-89a5deaa392e/volumes"
Sep 08 00:20:36.036358 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:36.036322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:36.139631 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:36.139596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:36.266445 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:36.266329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:36.685470 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:36.685432    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:37.545944 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:37.545909    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:37.607545 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:37.607513    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:40.045507 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:40.045467    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:40.145532 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:40.145489    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:41.143658 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:41.143625    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:41.264444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:41.264414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:41.368490 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:41.368451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:41.467393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:41.467324    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:41.896628 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:41.896547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:41.991215 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:41.991182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:20:57.204978 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:20:57.204934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:02.744031 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:02.743983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:02.844969 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:02.844931    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:02.946848 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:02.946804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:05.039657 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:05.039616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:13.470477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:13.470448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:14.267710 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:14.267674    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:19.817586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:19.817553    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:19.881472 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:19.881437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:19.942626 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:19.942592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:20.041712 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:20.041677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:20.142382 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:20.142270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:20.805497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:20.805396    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:20.894558 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:20.894522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:20.994213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:20.994177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:21.278202 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278163    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"]
Sep 08 00:21:21.278835 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278813    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c501fbef-0643-47de-afc6-e3542789ec69" containerName="main"
Sep 08 00:21:21.278885 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278840    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c501fbef-0643-47de-afc6-e3542789ec69" containerName="main"
Sep 08 00:21:21.278885 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278854    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f228546a-909d-47ca-a1b8-89a5deaa392e" containerName="main"
Sep 08 00:21:21.278885 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278863    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f228546a-909d-47ca-a1b8-89a5deaa392e" containerName="main"
Sep 08 00:21:21.278885 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278878    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" containerName="payload-pre-processing"
Sep 08 00:21:21.279014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278887    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" containerName="payload-pre-processing"
Sep 08 00:21:21.279014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.278998    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c501fbef-0643-47de-afc6-e3542789ec69" containerName="main"
Sep 08 00:21:21.279014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.279012    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8815a3c6-cdac-4b08-8551-bc9cda0dc1ac" containerName="payload-pre-processing"
Sep 08 00:21:21.279107 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.279021    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f228546a-909d-47ca-a1b8-89a5deaa392e" containerName="main"
Sep 08 00:21:21.282420 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.282400    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.284366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.284311    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-75e439\"/\"kube-root-ca.crt\""
Sep 08 00:21:21.284509 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.284375    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-75e439\"/\"openshift-service-ca.crt\""
Sep 08 00:21:21.284978 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.284963    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-75e439\"/\"explicit-model-75e439-kserve-self-signed-certs\""
Sep 08 00:21:21.285071 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.285026    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-75e439\"/\"default-dockercfg-4n8ln\""
Sep 08 00:21:21.292011 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.291991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"]
Sep 08 00:21:21.314355 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.314324    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:21.398892 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.398860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-dshm\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.398892 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.398892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzw5c\" (UniqueName: \"kubernetes.io/projected/2f8432bf-41aa-4d91-9142-58c2af0b2b87-kube-api-access-qzw5c\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.399100 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.398926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-model-cache\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.399100 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.399013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tmp-dir\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.399100 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.399066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.399100 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.399097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-home\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.499771 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.499742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.499938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.499776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-home\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.499938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.499878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-dshm\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.499938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.499908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzw5c\" (UniqueName: \"kubernetes.io/projected/2f8432bf-41aa-4d91-9142-58c2af0b2b87-kube-api-access-qzw5c\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.500062 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.499959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-model-cache\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.500062 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.500027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tmp-dir\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.500214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.500193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-home\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.500341 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.500319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-model-cache\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.500436 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.500324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tmp-dir\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.502170 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.502143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-dshm\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.502444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.502427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.506436 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.506418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzw5c\" (UniqueName: \"kubernetes.io/projected/2f8432bf-41aa-4d91-9142-58c2af0b2b87-kube-api-access-qzw5c\") pod \"explicit-model-75e439-kserve-54df7fdd99-xpwxc\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") " pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.594359 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.594261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:21.868067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:21.868042    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"]
Sep 08 00:21:21.870489 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:21:21.870462    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f8432bf_41aa_4d91_9142_58c2af0b2b87.slice/crio-b94c0ee568182ae9eb3c11b75dafd4a5320eee4e48d8a1053fa84b61a31f2bdd WatchSource:0}: Error finding container b94c0ee568182ae9eb3c11b75dafd4a5320eee4e48d8a1053fa84b61a31f2bdd: Status 404 returned error can't find the container with id b94c0ee568182ae9eb3c11b75dafd4a5320eee4e48d8a1053fa84b61a31f2bdd
Sep 08 00:21:22.194173 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:22.194133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc" event={"ID":"2f8432bf-41aa-4d91-9142-58c2af0b2b87","Type":"ContainerStarted","Data":"db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5"}
Sep 08 00:21:22.194173 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:22.194180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc" event={"ID":"2f8432bf-41aa-4d91-9142-58c2af0b2b87","Type":"ContainerStarted","Data":"b94c0ee568182ae9eb3c11b75dafd4a5320eee4e48d8a1053fa84b61a31f2bdd"}
Sep 08 00:21:22.217999 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:22.217949    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc" podStartSLOduration=1.2179346899999999 podStartE2EDuration="1.21793469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:21:22.21695972 +0000 UTC m=+1122.702388328" watchObservedRunningTime="2026-09-08 00:21:22.21793469 +0000 UTC m=+1122.703363298"
Sep 08 00:21:22.485861 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:22.485769    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:22.589399 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:22.589328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:28.285862 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:28.285824    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:28.386858 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:28.386822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:28.954260 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:28.954226    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:31.594840 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:31.594782    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:31.594840 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:31.594857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:31.607921 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:31.607895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:31.768546 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:31.768512    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"]
Sep 08 00:21:31.776597 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:31.776563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:32.255000 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:32.254973    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:32.304977 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:32.304934    2580 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-self-signed-certs: secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:32.305174 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:32.305033    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs podName:2f8432bf-41aa-4d91-9142-58c2af0b2b87 nodeName:}" failed. No retries permitted until 2026-09-08 00:21:32.805009662 +0000 UTC m=+1133.290438254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs") pod "explicit-model-75e439-kserve-54df7fdd99-xpwxc" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87") : secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:32.810843 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:32.810800    2580 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-self-signed-certs: secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:32.811302 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:32.810891    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs podName:2f8432bf-41aa-4d91-9142-58c2af0b2b87 nodeName:}" failed. No retries permitted until 2026-09-08 00:21:33.810873078 +0000 UTC m=+1134.296301669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs") pod "explicit-model-75e439-kserve-54df7fdd99-xpwxc" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87") : secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:33.819719 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:33.819684    2580 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-self-signed-certs: secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:33.820177 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:33.819756    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs podName:2f8432bf-41aa-4d91-9142-58c2af0b2b87 nodeName:}" failed. No retries permitted until 2026-09-08 00:21:35.819740692 +0000 UTC m=+1136.305169278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs") pod "explicit-model-75e439-kserve-54df7fdd99-xpwxc" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87") : secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:34.901057 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:34.901026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:35.002433 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:35.002393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:35.172276 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:35.172182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:35.462634 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:35.462549    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:35.839001 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:35.838914    2580 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-self-signed-certs: secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:35.839001 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:35.838998    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs podName:2f8432bf-41aa-4d91-9142-58c2af0b2b87 nodeName:}" failed. No retries permitted until 2026-09-08 00:21:39.838981336 +0000 UTC m=+1140.324409921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs") pod "explicit-model-75e439-kserve-54df7fdd99-xpwxc" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87") : secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:36.008710 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:36.008675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:38.570213 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:38.570178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:38.649218 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:38.649169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:39.295893 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:39.295860    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"]
Sep 08 00:21:39.312788 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:39.312752    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:39.810328 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:39.810284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:39.879169 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:39.879137    2580 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-self-signed-certs: secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:39.879335 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:39.879211    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs podName:2f8432bf-41aa-4d91-9142-58c2af0b2b87 nodeName:}" failed. No retries permitted until 2026-09-08 00:21:47.879197082 +0000 UTC m=+1148.364625668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs") pod "explicit-model-75e439-kserve-54df7fdd99-xpwxc" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87") : secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:39.904563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:39.904533    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:40.253929 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.253895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:40.349067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.349028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:40.352861 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.352830    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"]
Sep 08 00:21:40.356501 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.356476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.358675 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.358650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e250ebf1-dockercfg-9rdf4\""
Sep 08 00:21:40.362635 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.362613    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e250ebf1\""
Sep 08 00:21:40.371932 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.371909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"]
Sep 08 00:21:40.434070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.434035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:40.483748 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.483717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77xsh\" (UniqueName: \"kubernetes.io/projected/812f7fd3-7b29-4583-8cb3-0bddedfa2299-kube-api-access-77xsh\") pod \"payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.483928 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.483874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/812f7fd3-7b29-4583-8cb3-0bddedfa2299-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.585108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.585006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77xsh\" (UniqueName: \"kubernetes.io/projected/812f7fd3-7b29-4583-8cb3-0bddedfa2299-kube-api-access-77xsh\") pod \"payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.585294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.585183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/812f7fd3-7b29-4583-8cb3-0bddedfa2299-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.586105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.586075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/812f7fd3-7b29-4583-8cb3-0bddedfa2299-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.593068 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.593040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77xsh\" (UniqueName: \"kubernetes.io/projected/812f7fd3-7b29-4583-8cb3-0bddedfa2299-kube-api-access-77xsh\") pod \"payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.668169 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.668117    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:40.943456 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:40.943425    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"]
Sep 08 00:21:40.945906 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:21:40.945877    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812f7fd3_7b29_4583_8cb3_0bddedfa2299.slice/crio-768514c6b9c3faea772f3b51e1dbfda61cbfeab1c34bffe4a9969c4f2e50c5e2 WatchSource:0}: Error finding container 768514c6b9c3faea772f3b51e1dbfda61cbfeab1c34bffe4a9969c4f2e50c5e2: Status 404 returned error can't find the container with id 768514c6b9c3faea772f3b51e1dbfda61cbfeab1c34bffe4a9969c4f2e50c5e2
Sep 08 00:21:41.293469 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:41.293383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg" event={"ID":"812f7fd3-7b29-4583-8cb3-0bddedfa2299","Type":"ContainerStarted","Data":"6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69"}
Sep 08 00:21:41.293469 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:41.293434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg" event={"ID":"812f7fd3-7b29-4583-8cb3-0bddedfa2299","Type":"ContainerStarted","Data":"768514c6b9c3faea772f3b51e1dbfda61cbfeab1c34bffe4a9969c4f2e50c5e2"}
Sep 08 00:21:41.293469 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:41.293464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:41.310678 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:41.310630    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg" podStartSLOduration=1.310615799 podStartE2EDuration="1.310615799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:21:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:21:41.308701437 +0000 UTC m=+1141.794130045" watchObservedRunningTime="2026-09-08 00:21:41.310615799 +0000 UTC m=+1141.796044406"
Sep 08 00:21:41.457421 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:41.457373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:41.579004 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:41.578919    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:41.760602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:41.760565    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:42.337000 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:42.336967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:42.436290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:42.436245    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:42.510549 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:42.510515    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:42.567302 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:42.567260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:42.831273 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:42.831233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:47.959359 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:47.959308    2580 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-self-signed-certs: secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:47.959763 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:47.959393    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs podName:2f8432bf-41aa-4d91-9142-58c2af0b2b87 nodeName:}" failed. No retries permitted until 2026-09-08 00:22:03.959378601 +0000 UTC m=+1164.444807187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs") pod "explicit-model-75e439-kserve-54df7fdd99-xpwxc" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87") : secret "explicit-model-75e439-kserve-self-signed-certs" not found
Sep 08 00:21:47.965499 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:47.965475    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:48.267837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.267731    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc" podUID="2f8432bf-41aa-4d91-9142-58c2af0b2b87" containerName="main" containerID="cri-o://db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5" gracePeriod=45
Sep 08 00:21:48.531589 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.531516    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:48.565480 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.565442    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-dshm\") pod \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") "
Sep 08 00:21:48.565662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.565501    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs\") pod \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") "
Sep 08 00:21:48.565662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.565531    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-home\") pod \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") "
Sep 08 00:21:48.565662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.565576    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzw5c\" (UniqueName: \"kubernetes.io/projected/2f8432bf-41aa-4d91-9142-58c2af0b2b87-kube-api-access-qzw5c\") pod \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") "
Sep 08 00:21:48.565838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.565666    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tmp-dir\") pod \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") "
Sep 08 00:21:48.565838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.565735    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-model-cache\") pod \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\" (UID: \"2f8432bf-41aa-4d91-9142-58c2af0b2b87\") "
Sep 08 00:21:48.565934 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.565881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-home" (OuterVolumeSpecName: "home") pod "2f8432bf-41aa-4d91-9142-58c2af0b2b87" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:48.566137 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.566101    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f8432bf-41aa-4d91-9142-58c2af0b2b87" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:48.566137 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.566122    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-home\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:48.566277 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.566118    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f8432bf-41aa-4d91-9142-58c2af0b2b87" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:48.568333 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.568312    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-dshm" (OuterVolumeSpecName: "dshm") pod "2f8432bf-41aa-4d91-9142-58c2af0b2b87" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:48.568429 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.568332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f8432bf-41aa-4d91-9142-58c2af0b2b87" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:21:48.568481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.568439    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8432bf-41aa-4d91-9142-58c2af0b2b87-kube-api-access-qzw5c" (OuterVolumeSpecName: "kube-api-access-qzw5c") pod "2f8432bf-41aa-4d91-9142-58c2af0b2b87" (UID: "2f8432bf-41aa-4d91-9142-58c2af0b2b87"). InnerVolumeSpecName "kube-api-access-qzw5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:21:48.666927 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.666871    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-dshm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:48.666927 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.666922    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tls-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:48.666927 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.666936    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzw5c\" (UniqueName: \"kubernetes.io/projected/2f8432bf-41aa-4d91-9142-58c2af0b2b87-kube-api-access-qzw5c\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:48.667186 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.666948    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-tmp-dir\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:48.667186 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:48.666960    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f8432bf-41aa-4d91-9142-58c2af0b2b87-model-cache\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:49.339002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.338969    2580 generic.go:356] "Generic (PLEG): container finished" podID="2f8432bf-41aa-4d91-9142-58c2af0b2b87" containerID="db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5" exitCode=0
Sep 08 00:21:49.339422 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.339009    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"
Sep 08 00:21:49.339422 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.339022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc" event={"ID":"2f8432bf-41aa-4d91-9142-58c2af0b2b87","Type":"ContainerDied","Data":"db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5"}
Sep 08 00:21:49.339422 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.339055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc" event={"ID":"2f8432bf-41aa-4d91-9142-58c2af0b2b87","Type":"ContainerDied","Data":"b94c0ee568182ae9eb3c11b75dafd4a5320eee4e48d8a1053fa84b61a31f2bdd"}
Sep 08 00:21:49.339422 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.339071    2580 scope.go:117] "RemoveContainer" containerID="db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5"
Sep 08 00:21:49.348793 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.348758    2580 scope.go:117] "RemoveContainer" containerID="db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5"
Sep 08 00:21:49.349069 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:49.349049    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5\": container with ID starting with db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5 not found: ID does not exist" containerID="db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5"
Sep 08 00:21:49.349108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.349080    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5"} err="failed to get container status \"db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5\": rpc error: code = NotFound desc = could not find container \"db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5\": container with ID starting with db008a681cf97bccce368823f36fa5011e952d382c06f2c75c2e74ef721447d5 not found: ID does not exist"
Sep 08 00:21:49.359412 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.359359    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"]
Sep 08 00:21:49.363947 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.363922    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-75e439/explicit-model-75e439-kserve-54df7fdd99-xpwxc"]
Sep 08 00:21:49.927786 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:49.927746    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8432bf-41aa-4d91-9142-58c2af0b2b87" path="/var/lib/kubelet/pods/2f8432bf-41aa-4d91-9142-58c2af0b2b87/volumes"
Sep 08 00:21:52.101300 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.101270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:52.130752 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.130717    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"]
Sep 08 00:21:52.131008 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.130978    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8" podUID="dcad275e-3729-4eac-a146-5bc8ed4eb66f" containerName="payload-processing" containerID="cri-o://656940fab0788f6ef4cff9cb3acd09c6eb3df8a675aa0de25a8485a3ba7aba14" gracePeriod=30
Sep 08 00:21:52.137015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.136984    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"]
Sep 08 00:21:52.137228 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.137199    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl" podUID="c6e0b2e9-8378-4fba-9630-febc82ade566" containerName="payload-pre-processing" containerID="cri-o://6b372ae8f14e2a0c5a49457bfe44c568b4ddce60d9ffee4887614f5996fa65e2" gracePeriod=30
Sep 08 00:21:52.166877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.166850    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:52.258099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.258067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:52.303502 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.303473    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:21:52.314846 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.314811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:52.359609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.359372    2580 generic.go:356] "Generic (PLEG): container finished" podID="dcad275e-3729-4eac-a146-5bc8ed4eb66f" containerID="656940fab0788f6ef4cff9cb3acd09c6eb3df8a675aa0de25a8485a3ba7aba14" exitCode=0
Sep 08 00:21:52.359609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.359445    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8" event={"ID":"dcad275e-3729-4eac-a146-5bc8ed4eb66f","Type":"ContainerDied","Data":"656940fab0788f6ef4cff9cb3acd09c6eb3df8a675aa0de25a8485a3ba7aba14"}
Sep 08 00:21:52.361645 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.361615    2580 generic.go:356] "Generic (PLEG): container finished" podID="c6e0b2e9-8378-4fba-9630-febc82ade566" containerID="6b372ae8f14e2a0c5a49457bfe44c568b4ddce60d9ffee4887614f5996fa65e2" exitCode=0
Sep 08 00:21:52.361788 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.361707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl" event={"ID":"c6e0b2e9-8378-4fba-9630-febc82ade566","Type":"ContainerDied","Data":"6b372ae8f14e2a0c5a49457bfe44c568b4ddce60d9ffee4887614f5996fa65e2"}
Sep 08 00:21:52.424321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.424294    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:21:52.427539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.427517    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:21:52.500640 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.500602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6e0b2e9-8378-4fba-9630-febc82ade566-plugins-config-volume\") pod \"c6e0b2e9-8378-4fba-9630-febc82ade566\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") "
Sep 08 00:21:52.500849 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.500657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c48x\" (UniqueName: \"kubernetes.io/projected/dcad275e-3729-4eac-a146-5bc8ed4eb66f-kube-api-access-8c48x\") pod \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") "
Sep 08 00:21:52.500849 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.500709    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcad275e-3729-4eac-a146-5bc8ed4eb66f-plugins-config-volume\") pod \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\" (UID: \"dcad275e-3729-4eac-a146-5bc8ed4eb66f\") "
Sep 08 00:21:52.500849 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.500753    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xlpk\" (UniqueName: \"kubernetes.io/projected/c6e0b2e9-8378-4fba-9630-febc82ade566-kube-api-access-2xlpk\") pod \"c6e0b2e9-8378-4fba-9630-febc82ade566\" (UID: \"c6e0b2e9-8378-4fba-9630-febc82ade566\") "
Sep 08 00:21:52.501077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.501048    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e0b2e9-8378-4fba-9630-febc82ade566-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6e0b2e9-8378-4fba-9630-febc82ade566" (UID: "c6e0b2e9-8378-4fba-9630-febc82ade566"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:21:52.501175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.501140    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcad275e-3729-4eac-a146-5bc8ed4eb66f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dcad275e-3729-4eac-a146-5bc8ed4eb66f" (UID: "dcad275e-3729-4eac-a146-5bc8ed4eb66f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:21:52.503119 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.503087    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcad275e-3729-4eac-a146-5bc8ed4eb66f-kube-api-access-8c48x" (OuterVolumeSpecName: "kube-api-access-8c48x") pod "dcad275e-3729-4eac-a146-5bc8ed4eb66f" (UID: "dcad275e-3729-4eac-a146-5bc8ed4eb66f"). InnerVolumeSpecName "kube-api-access-8c48x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:21:52.503235 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.503127    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e0b2e9-8378-4fba-9630-febc82ade566-kube-api-access-2xlpk" (OuterVolumeSpecName: "kube-api-access-2xlpk") pod "c6e0b2e9-8378-4fba-9630-febc82ade566" (UID: "c6e0b2e9-8378-4fba-9630-febc82ade566"). InnerVolumeSpecName "kube-api-access-2xlpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:21:52.602181 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.602139    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xlpk\" (UniqueName: \"kubernetes.io/projected/c6e0b2e9-8378-4fba-9630-febc82ade566-kube-api-access-2xlpk\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:52.602181 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.602173    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6e0b2e9-8378-4fba-9630-febc82ade566-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:52.602181 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.602183    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c48x\" (UniqueName: \"kubernetes.io/projected/dcad275e-3729-4eac-a146-5bc8ed4eb66f-kube-api-access-8c48x\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:52.602181 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.602192    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcad275e-3729-4eac-a146-5bc8ed4eb66f-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:52.627229 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:52.627140    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:53.367749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.367716    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"
Sep 08 00:21:53.367749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.367726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8" event={"ID":"dcad275e-3729-4eac-a146-5bc8ed4eb66f","Type":"ContainerDied","Data":"0559160d18511dd73f3fbb7b71ed5927c6af737cc34227d1137a2cf568b1cb1d"}
Sep 08 00:21:53.368239 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.367787    2580 scope.go:117] "RemoveContainer" containerID="656940fab0788f6ef4cff9cb3acd09c6eb3df8a675aa0de25a8485a3ba7aba14"
Sep 08 00:21:53.369182 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.369164    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"
Sep 08 00:21:53.369259 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.369185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl" event={"ID":"c6e0b2e9-8378-4fba-9630-febc82ade566","Type":"ContainerDied","Data":"66e36b260f3f022f32e669a45a9b9cd1db7968935b9dd9ce25373ff20ad08e54"}
Sep 08 00:21:53.377111 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.377090    2580 scope.go:117] "RemoveContainer" containerID="6b372ae8f14e2a0c5a49457bfe44c568b4ddce60d9ffee4887614f5996fa65e2"
Sep 08 00:21:53.394394 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.394373    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"]
Sep 08 00:21:53.397738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.397717    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4374d7-5bdcfdbfbc-g2cq8"]
Sep 08 00:21:53.406273 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.406253    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"]
Sep 08 00:21:53.409658 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.409636    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4374d7-7df88875d6-kvkvl"]
Sep 08 00:21:53.706338 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.706305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:53.927900 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.927863    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6e0b2e9-8378-4fba-9630-febc82ade566" path="/var/lib/kubelet/pods/c6e0b2e9-8378-4fba-9630-febc82ade566/volumes"
Sep 08 00:21:53.931045 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.928379    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcad275e-3729-4eac-a146-5bc8ed4eb66f" path="/var/lib/kubelet/pods/dcad275e-3729-4eac-a146-5bc8ed4eb66f/volumes"
Sep 08 00:21:53.931045 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:53.929136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:54.317458 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.317409    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm" podUID="f6a2eec7-9c7d-4486-aaef-b35672a4ad17" containerName="main" containerID="cri-o://ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47" gracePeriod=45
Sep 08 00:21:54.358052 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.358021    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:54.561738 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.561711    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:21:54.621931 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.621820    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tmp-dir\") pod \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") "
Sep 08 00:21:54.621931 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.621903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqfgq\" (UniqueName: \"kubernetes.io/projected/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-kube-api-access-qqfgq\") pod \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") "
Sep 08 00:21:54.622177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.621939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-model-cache\") pod \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") "
Sep 08 00:21:54.622177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-dshm\") pod \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") "
Sep 08 00:21:54.622177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622025    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tls-certs\") pod \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") "
Sep 08 00:21:54.622177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-home\") pod \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\" (UID: \"f6a2eec7-9c7d-4486-aaef-b35672a4ad17\") "
Sep 08 00:21:54.622507 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622230    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f6a2eec7-9c7d-4486-aaef-b35672a4ad17" (UID: "f6a2eec7-9c7d-4486-aaef-b35672a4ad17"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:54.622507 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622273    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-model-cache" (OuterVolumeSpecName: "model-cache") pod "f6a2eec7-9c7d-4486-aaef-b35672a4ad17" (UID: "f6a2eec7-9c7d-4486-aaef-b35672a4ad17"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:54.622669 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622648    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tmp-dir\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:54.622726 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622676    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-model-cache\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:54.622726 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.622681    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-home" (OuterVolumeSpecName: "home") pod "f6a2eec7-9c7d-4486-aaef-b35672a4ad17" (UID: "f6a2eec7-9c7d-4486-aaef-b35672a4ad17"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:54.625075 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.625048    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-dshm" (OuterVolumeSpecName: "dshm") pod "f6a2eec7-9c7d-4486-aaef-b35672a4ad17" (UID: "f6a2eec7-9c7d-4486-aaef-b35672a4ad17"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:54.625206 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.625109    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-kube-api-access-qqfgq" (OuterVolumeSpecName: "kube-api-access-qqfgq") pod "f6a2eec7-9c7d-4486-aaef-b35672a4ad17" (UID: "f6a2eec7-9c7d-4486-aaef-b35672a4ad17"). InnerVolumeSpecName "kube-api-access-qqfgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:21:54.625658 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.625620    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f6a2eec7-9c7d-4486-aaef-b35672a4ad17" (UID: "f6a2eec7-9c7d-4486-aaef-b35672a4ad17"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:21:54.638878 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.638848    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:54.723688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.723652    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-dshm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:54.723688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.723682    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-tls-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:54.723688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.723693    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-home\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:54.723932 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.723702    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqfgq\" (UniqueName: \"kubernetes.io/projected/f6a2eec7-9c7d-4486-aaef-b35672a4ad17-kube-api-access-qqfgq\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:21:54.760526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:54.760490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:55.381862 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.381827    2580 generic.go:356] "Generic (PLEG): container finished" podID="f6a2eec7-9c7d-4486-aaef-b35672a4ad17" containerID="ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47" exitCode=0
Sep 08 00:21:55.382015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.381890    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"
Sep 08 00:21:55.382015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.381911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm" event={"ID":"f6a2eec7-9c7d-4486-aaef-b35672a4ad17","Type":"ContainerDied","Data":"ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47"}
Sep 08 00:21:55.382015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.381956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm" event={"ID":"f6a2eec7-9c7d-4486-aaef-b35672a4ad17","Type":"ContainerDied","Data":"573ce305a1e6e5078da1c392c1dfa1ec34a979a2f62715ef694cea3f00508881"}
Sep 08 00:21:55.382015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.381973    2580 scope.go:117] "RemoveContainer" containerID="ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47"
Sep 08 00:21:55.390896 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.390878    2580 scope.go:117] "RemoveContainer" containerID="ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47"
Sep 08 00:21:55.391147 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:21:55.391125    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47\": container with ID starting with ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47 not found: ID does not exist" containerID="ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47"
Sep 08 00:21:55.391195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.391156    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47"} err="failed to get container status \"ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47\": rpc error: code = NotFound desc = could not find container \"ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47\": container with ID starting with ea9bb225bbd4d1d68fdd1d0a0f85eca0a70c66f89b11ab26feacf9916426db47 not found: ID does not exist"
Sep 08 00:21:55.401912 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.401882    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"]
Sep 08 00:21:55.407319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.407296    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4374d7/test-model-4374d7-kserve-945497ddc-c9dfm"]
Sep 08 00:21:55.927680 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:55.927646    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a2eec7-9c7d-4486-aaef-b35672a4ad17" path="/var/lib/kubelet/pods/f6a2eec7-9c7d-4486-aaef-b35672a4ad17/volumes"
Sep 08 00:21:56.084627 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:56.084579    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:56.185541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:56.185445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:56.300704 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:56.300674    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:58.388357 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.388304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:58.453521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.453485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:58.649052 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.649017    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:58.977134 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977053    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"]
Sep 08 00:21:58.977477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977464    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f8432bf-41aa-4d91-9142-58c2af0b2b87" containerName="main"
Sep 08 00:21:58.977521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977479    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8432bf-41aa-4d91-9142-58c2af0b2b87" containerName="main"
Sep 08 00:21:58.977521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977491    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a2eec7-9c7d-4486-aaef-b35672a4ad17" containerName="main"
Sep 08 00:21:58.977521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977497    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a2eec7-9c7d-4486-aaef-b35672a4ad17" containerName="main"
Sep 08 00:21:58.977521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977505    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcad275e-3729-4eac-a146-5bc8ed4eb66f" containerName="payload-processing"
Sep 08 00:21:58.977521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977511    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcad275e-3729-4eac-a146-5bc8ed4eb66f" containerName="payload-processing"
Sep 08 00:21:58.977521 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977521    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e0b2e9-8378-4fba-9630-febc82ade566" containerName="payload-pre-processing"
Sep 08 00:21:58.977711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977526    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e0b2e9-8378-4fba-9630-febc82ade566" containerName="payload-pre-processing"
Sep 08 00:21:58.977711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977581    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e0b2e9-8378-4fba-9630-febc82ade566" containerName="payload-pre-processing"
Sep 08 00:21:58.977711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977590    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f8432bf-41aa-4d91-9142-58c2af0b2b87" containerName="main"
Sep 08 00:21:58.977711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977612    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a2eec7-9c7d-4486-aaef-b35672a4ad17" containerName="main"
Sep 08 00:21:58.977711 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.977619    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcad275e-3729-4eac-a146-5bc8ed4eb66f" containerName="payload-processing"
Sep 08 00:21:58.982085 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.982064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"
Sep 08 00:21:58.984153 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.984127    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:21:58.986393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:58.986366    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"]
Sep 08 00:21:59.068769 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:59.068732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e65515-709d-43f3-8b13-0af81d971f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt\" (UID: \"83e65515-709d-43f3-8b13-0af81d971f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"
Sep 08 00:21:59.071736 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:59.071713    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:21:59.169702 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:59.169670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e65515-709d-43f3-8b13-0af81d971f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt\" (UID: \"83e65515-709d-43f3-8b13-0af81d971f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"
Sep 08 00:21:59.170270 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:59.170250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e65515-709d-43f3-8b13-0af81d971f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt\" (UID: \"83e65515-709d-43f3-8b13-0af81d971f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"
Sep 08 00:21:59.296435 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:59.296338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"
Sep 08 00:21:59.563538 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:59.563512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"]
Sep 08 00:21:59.565736 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:21:59.565707    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e65515_709d_43f3_8b13_0af81d971f41.slice/crio-3a38f6a7652e016016bd47594db53957669ad070e751a43e24ba9157d69d6d81 WatchSource:0}: Error finding container 3a38f6a7652e016016bd47594db53957669ad070e751a43e24ba9157d69d6d81: Status 404 returned error can't find the container with id 3a38f6a7652e016016bd47594db53957669ad070e751a43e24ba9157d69d6d81
Sep 08 00:21:59.568062 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:21:59.568039    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:22:00.409775 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:00.409729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt" event={"ID":"83e65515-709d-43f3-8b13-0af81d971f41","Type":"ContainerStarted","Data":"3a38f6a7652e016016bd47594db53957669ad070e751a43e24ba9157d69d6d81"}
Sep 08 00:22:00.617997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:00.617965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:03.427227 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:03.427191    2580 generic.go:356] "Generic (PLEG): container finished" podID="83e65515-709d-43f3-8b13-0af81d971f41" containerID="2ce4a0e28d5746792c2d90b79d0fc2ffc83f28802ad551f1f36b0039dc2ad146" exitCode=0
Sep 08 00:22:03.427641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:03.427250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt" event={"ID":"83e65515-709d-43f3-8b13-0af81d971f41","Type":"ContainerDied","Data":"2ce4a0e28d5746792c2d90b79d0fc2ffc83f28802ad551f1f36b0039dc2ad146"}
Sep 08 00:22:03.533749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:03.533715    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:04.135136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:04.135100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:04.234409 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:04.234376    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:04.529053 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:04.529001    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:04.570386 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:04.570358    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"
Sep 08 00:22:04.729712 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:04.729623    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e65515-709d-43f3-8b13-0af81d971f41-maas-api-service-ca\") pod \"83e65515-709d-43f3-8b13-0af81d971f41\" (UID: \"83e65515-709d-43f3-8b13-0af81d971f41\") "
Sep 08 00:22:04.730014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:04.729991    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e65515-709d-43f3-8b13-0af81d971f41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "83e65515-709d-43f3-8b13-0af81d971f41" (UID: "83e65515-709d-43f3-8b13-0af81d971f41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:04.830281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:04.830240    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e65515-709d-43f3-8b13-0af81d971f41-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:05.439064 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:05.439031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt" event={"ID":"83e65515-709d-43f3-8b13-0af81d971f41","Type":"ContainerDied","Data":"3a38f6a7652e016016bd47594db53957669ad070e751a43e24ba9157d69d6d81"}
Sep 08 00:22:05.439064 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:05.439066    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"
Sep 08 00:22:05.439278 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:05.439080    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a38f6a7652e016016bd47594db53957669ad070e751a43e24ba9157d69d6d81"
Sep 08 00:22:06.780171 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.780119    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"]
Sep 08 00:22:06.780636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.780620    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e65515-709d-43f3-8b13-0af81d971f41" containerName="revoke-keys"
Sep 08 00:22:06.780636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.780637    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e65515-709d-43f3-8b13-0af81d971f41" containerName="revoke-keys"
Sep 08 00:22:06.780739 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.780701    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e65515-709d-43f3-8b13-0af81d971f41" containerName="revoke-keys"
Sep 08 00:22:06.784297 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.784276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:06.786108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.786073    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-12bd69\"/\"kube-root-ca.crt\""
Sep 08 00:22:06.786322 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.786298    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-12bd69\"/\"openshift-service-ca.crt\""
Sep 08 00:22:06.786826 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.786801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-12bd69\"/\"noten-model-12bd69-kserve-self-signed-certs\""
Sep 08 00:22:06.786916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.786845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-12bd69\"/\"default-dockercfg-25mnk\""
Sep 08 00:22:06.792982 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.792960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"]
Sep 08 00:22:06.805983 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.805952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:06.948273 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.948227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f9lh\" (UniqueName: \"kubernetes.io/projected/f4a16453-0182-4348-9950-ddcea7a3ff22-kube-api-access-4f9lh\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:06.948273 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.948284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a16453-0182-4348-9950-ddcea7a3ff22-tls-certs\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:06.948602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.948325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-tmp-dir\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:06.948602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.948424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-home\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:06.948602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.948506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-dshm\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:06.948602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:06.948571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-model-cache\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049225 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-model-cache\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049225 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f9lh\" (UniqueName: \"kubernetes.io/projected/f4a16453-0182-4348-9950-ddcea7a3ff22-kube-api-access-4f9lh\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049517 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a16453-0182-4348-9950-ddcea7a3ff22-tls-certs\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049517 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-tmp-dir\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049634 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-home\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049698 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-model-cache\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049741 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-tmp-dir\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049783 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-dshm\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.049877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.049858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-home\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.051750 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.051727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-dshm\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.051889 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.051871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a16453-0182-4348-9950-ddcea7a3ff22-tls-certs\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.055793 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.055774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f9lh\" (UniqueName: \"kubernetes.io/projected/f4a16453-0182-4348-9950-ddcea7a3ff22-kube-api-access-4f9lh\") pod \"noten-model-12bd69-kserve-6df9ff555-qpdtg\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") " pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.094988 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.094960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:07.365048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.365025    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"]
Sep 08 00:22:07.367856 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:22:07.367829    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4a16453_0182_4348_9950_ddcea7a3ff22.slice/crio-96f5edcfd41cac87d98bca4f6f5086cc4d72c2d6d4fd7860e6b0034e9ddb5cac WatchSource:0}: Error finding container 96f5edcfd41cac87d98bca4f6f5086cc4d72c2d6d4fd7860e6b0034e9ddb5cac: Status 404 returned error can't find the container with id 96f5edcfd41cac87d98bca4f6f5086cc4d72c2d6d4fd7860e6b0034e9ddb5cac
Sep 08 00:22:07.450979 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.450948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg" event={"ID":"f4a16453-0182-4348-9950-ddcea7a3ff22","Type":"ContainerStarted","Data":"e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c"}
Sep 08 00:22:07.451131 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.450991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg" event={"ID":"f4a16453-0182-4348-9950-ddcea7a3ff22","Type":"ContainerStarted","Data":"96f5edcfd41cac87d98bca4f6f5086cc4d72c2d6d4fd7860e6b0034e9ddb5cac"}
Sep 08 00:22:07.466330 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:07.466274    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg" podStartSLOduration=1.466259016 podStartE2EDuration="1.466259016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:07.463479142 +0000 UTC m=+1167.948907749" watchObservedRunningTime="2026-09-08 00:22:07.466259016 +0000 UTC m=+1167.951687623"
Sep 08 00:22:08.662325 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:08.662294    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"]
Sep 08 00:22:08.678127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:08.678082    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:08.791011 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:08.790976    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:08.998232 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:08.998134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:09.099723 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.099684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:09.200305 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.200263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:09.759281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.759241    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:09.781414 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.781383    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"]
Sep 08 00:22:09.781649 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.781623    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9" podUID="b082d56c-9183-4b64-855a-df788e05defc" containerName="payload-processing" containerID="cri-o://d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd" gracePeriod=30
Sep 08 00:22:09.789001 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.788970    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"]
Sep 08 00:22:09.789208 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.789183    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk" podUID="2b8d86c5-4db3-4de8-87d1-80ad510ac89b" containerName="payload-pre-processing" containerID="cri-o://7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c" gracePeriod=30
Sep 08 00:22:09.825301 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.825261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:09.884641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.884608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:09.958639 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.958586    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"]
Sep 08 00:22:09.960974 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.960949    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c4541b-5b9vt"]
Sep 08 00:22:09.961882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:09.961851    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:10.017982 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.017887    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:10.072816 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.072786    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:22:10.075773 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.075755    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:22:10.178576 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.178550    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-plugins-config-volume\") pod \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") "
Sep 08 00:22:10.178576 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.178580    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzkff\" (UniqueName: \"kubernetes.io/projected/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-kube-api-access-xzkff\") pod \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\" (UID: \"2b8d86c5-4db3-4de8-87d1-80ad510ac89b\") "
Sep 08 00:22:10.178830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.178625    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b082d56c-9183-4b64-855a-df788e05defc-plugins-config-volume\") pod \"b082d56c-9183-4b64-855a-df788e05defc\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") "
Sep 08 00:22:10.178830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.178645    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7zzm\" (UniqueName: \"kubernetes.io/projected/b082d56c-9183-4b64-855a-df788e05defc-kube-api-access-h7zzm\") pod \"b082d56c-9183-4b64-855a-df788e05defc\" (UID: \"b082d56c-9183-4b64-855a-df788e05defc\") "
Sep 08 00:22:10.179005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.178970    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b8d86c5-4db3-4de8-87d1-80ad510ac89b" (UID: "2b8d86c5-4db3-4de8-87d1-80ad510ac89b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:10.179123 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.179099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b082d56c-9183-4b64-855a-df788e05defc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b082d56c-9183-4b64-855a-df788e05defc" (UID: "b082d56c-9183-4b64-855a-df788e05defc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:10.181196 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.181170    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b082d56c-9183-4b64-855a-df788e05defc-kube-api-access-h7zzm" (OuterVolumeSpecName: "kube-api-access-h7zzm") pod "b082d56c-9183-4b64-855a-df788e05defc" (UID: "b082d56c-9183-4b64-855a-df788e05defc"). InnerVolumeSpecName "kube-api-access-h7zzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:10.181326 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.181196    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-kube-api-access-xzkff" (OuterVolumeSpecName: "kube-api-access-xzkff") pod "2b8d86c5-4db3-4de8-87d1-80ad510ac89b" (UID: "2b8d86c5-4db3-4de8-87d1-80ad510ac89b"). InnerVolumeSpecName "kube-api-access-xzkff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:10.280103 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.280022    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:10.280103 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.280048    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzkff\" (UniqueName: \"kubernetes.io/projected/2b8d86c5-4db3-4de8-87d1-80ad510ac89b-kube-api-access-xzkff\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:10.280103 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.280058    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b082d56c-9183-4b64-855a-df788e05defc-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:10.280103 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.280067    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7zzm\" (UniqueName: \"kubernetes.io/projected/b082d56c-9183-4b64-855a-df788e05defc-kube-api-access-h7zzm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:10.304999 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.304968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:10.467195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.467152    2580 generic.go:356] "Generic (PLEG): container finished" podID="b082d56c-9183-4b64-855a-df788e05defc" containerID="d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd" exitCode=0
Sep 08 00:22:10.467195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.467200    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"
Sep 08 00:22:10.467500 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.467244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9" event={"ID":"b082d56c-9183-4b64-855a-df788e05defc","Type":"ContainerDied","Data":"d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd"}
Sep 08 00:22:10.467500 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.467306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9" event={"ID":"b082d56c-9183-4b64-855a-df788e05defc","Type":"ContainerDied","Data":"f02028e1b925320113eaf3111ca0a6aa51993f761032c09c0d7654d925d19fa2"}
Sep 08 00:22:10.467500 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.467371    2580 scope.go:117] "RemoveContainer" containerID="d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd"
Sep 08 00:22:10.468702 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.468671    2580 generic.go:356] "Generic (PLEG): container finished" podID="2b8d86c5-4db3-4de8-87d1-80ad510ac89b" containerID="7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c" exitCode=0
Sep 08 00:22:10.468838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.468714    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"
Sep 08 00:22:10.468838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.468754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk" event={"ID":"2b8d86c5-4db3-4de8-87d1-80ad510ac89b","Type":"ContainerDied","Data":"7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c"}
Sep 08 00:22:10.468838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.468796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk" event={"ID":"2b8d86c5-4db3-4de8-87d1-80ad510ac89b","Type":"ContainerDied","Data":"6210a6f76b7362fe2934a8696d704d5fc54c0d9e37a30019e59dfae3539817a8"}
Sep 08 00:22:10.477573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.477555    2580 scope.go:117] "RemoveContainer" containerID="d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd"
Sep 08 00:22:10.477857 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:22:10.477837    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd\": container with ID starting with d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd not found: ID does not exist" containerID="d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd"
Sep 08 00:22:10.477908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.477866    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd"} err="failed to get container status \"d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd\": rpc error: code = NotFound desc = could not find container \"d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd\": container with ID starting with d883dc8bff89d9f3a28f44f0e69fb7a3a4938a1f2865de69728afdf0c0b17bcd not found: ID does not exist"
Sep 08 00:22:10.477908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.477884    2580 scope.go:117] "RemoveContainer" containerID="7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c"
Sep 08 00:22:10.486608 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.486590    2580 scope.go:117] "RemoveContainer" containerID="7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c"
Sep 08 00:22:10.486920 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:22:10.486900    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c\": container with ID starting with 7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c not found: ID does not exist" containerID="7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c"
Sep 08 00:22:10.486980 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.486932    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c"} err="failed to get container status \"7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c\": rpc error: code = NotFound desc = could not find container \"7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c\": container with ID starting with 7283fdd4b0a55d2228fd86be7147c083d9de9fc2f551cec3cd3b5ab826b0563c not found: ID does not exist"
Sep 08 00:22:10.491382 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.491359    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"]
Sep 08 00:22:10.495441 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.495416    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c4541b-67b88b6566-w66vk"]
Sep 08 00:22:10.504468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.504433    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"]
Sep 08 00:22:10.506199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.506178    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c4541b-786584c645-2vjm9"]
Sep 08 00:22:10.902232 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:10.902202    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:11.219862 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.219780    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"]
Sep 08 00:22:11.220390 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.220372    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b082d56c-9183-4b64-855a-df788e05defc" containerName="payload-processing"
Sep 08 00:22:11.220438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.220393    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b082d56c-9183-4b64-855a-df788e05defc" containerName="payload-processing"
Sep 08 00:22:11.220438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.220405    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8d86c5-4db3-4de8-87d1-80ad510ac89b" containerName="payload-pre-processing"
Sep 08 00:22:11.220438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.220410    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8d86c5-4db3-4de8-87d1-80ad510ac89b" containerName="payload-pre-processing"
Sep 08 00:22:11.220564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.220492    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b8d86c5-4db3-4de8-87d1-80ad510ac89b" containerName="payload-pre-processing"
Sep 08 00:22:11.220564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.220502    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b082d56c-9183-4b64-855a-df788e05defc" containerName="payload-processing"
Sep 08 00:22:11.223459 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.223438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"
Sep 08 00:22:11.225636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.225611    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:22:11.228281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.228256    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"]
Sep 08 00:22:11.392139 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.392104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5aea865-74d1-434e-ba1a-2069f3f32ca5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz\" (UID: \"a5aea865-74d1-434e-ba1a-2069f3f32ca5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"
Sep 08 00:22:11.493463 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.493380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5aea865-74d1-434e-ba1a-2069f3f32ca5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz\" (UID: \"a5aea865-74d1-434e-ba1a-2069f3f32ca5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"
Sep 08 00:22:11.493985 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.493968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5aea865-74d1-434e-ba1a-2069f3f32ca5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz\" (UID: \"a5aea865-74d1-434e-ba1a-2069f3f32ca5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"
Sep 08 00:22:11.536048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.536022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"
Sep 08 00:22:11.802459 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.802376    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"]
Sep 08 00:22:11.806817 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:22:11.806786    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5aea865_74d1_434e_ba1a_2069f3f32ca5.slice/crio-05411ac245130613f723490ccb242c249629cc85abf347aa5a7f19abdbc08046 WatchSource:0}: Error finding container 05411ac245130613f723490ccb242c249629cc85abf347aa5a7f19abdbc08046: Status 404 returned error can't find the container with id 05411ac245130613f723490ccb242c249629cc85abf347aa5a7f19abdbc08046
Sep 08 00:22:11.927947 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.927916    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b8d86c5-4db3-4de8-87d1-80ad510ac89b" path="/var/lib/kubelet/pods/2b8d86c5-4db3-4de8-87d1-80ad510ac89b/volumes"
Sep 08 00:22:11.928309 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.928252    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83e65515-709d-43f3-8b13-0af81d971f41" path="/var/lib/kubelet/pods/83e65515-709d-43f3-8b13-0af81d971f41/volumes"
Sep 08 00:22:11.928606 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.928591    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b082d56c-9183-4b64-855a-df788e05defc" path="/var/lib/kubelet/pods/b082d56c-9183-4b64-855a-df788e05defc/volumes"
Sep 08 00:22:11.996838 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:11.996814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:12.048055 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:12.048021    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:12.483241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:12.483197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz" event={"ID":"a5aea865-74d1-434e-ba1a-2069f3f32ca5","Type":"ContainerStarted","Data":"2f422d216d7b17fd4319ee6522a54fb5ed8ddb20fcc932085f6036bb49e7e9a7"}
Sep 08 00:22:12.483434 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:12.483274    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz" event={"ID":"a5aea865-74d1-434e-ba1a-2069f3f32ca5","Type":"ContainerStarted","Data":"05411ac245130613f723490ccb242c249629cc85abf347aa5a7f19abdbc08046"}
Sep 08 00:22:12.496847 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:12.496797    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz" podStartSLOduration=1.496778526 podStartE2EDuration="1.496778526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:12.4953942 +0000 UTC m=+1172.980822810" watchObservedRunningTime="2026-09-08 00:22:12.496778526 +0000 UTC m=+1172.982207135"
Sep 08 00:22:13.489703 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:13.489661    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5aea865-74d1-434e-ba1a-2069f3f32ca5" containerID="2f422d216d7b17fd4319ee6522a54fb5ed8ddb20fcc932085f6036bb49e7e9a7" exitCode=0
Sep 08 00:22:13.489703 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:13.489707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz" event={"ID":"a5aea865-74d1-434e-ba1a-2069f3f32ca5","Type":"ContainerDied","Data":"2f422d216d7b17fd4319ee6522a54fb5ed8ddb20fcc932085f6036bb49e7e9a7"}
Sep 08 00:22:14.137662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:14.137624    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:14.626641 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:14.626615    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"
Sep 08 00:22:14.724837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:14.724802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5aea865-74d1-434e-ba1a-2069f3f32ca5-maas-api-service-ca\") pod \"a5aea865-74d1-434e-ba1a-2069f3f32ca5\" (UID: \"a5aea865-74d1-434e-ba1a-2069f3f32ca5\") "
Sep 08 00:22:14.725193 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:14.725168    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5aea865-74d1-434e-ba1a-2069f3f32ca5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5aea865-74d1-434e-ba1a-2069f3f32ca5" (UID: "a5aea865-74d1-434e-ba1a-2069f3f32ca5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:14.825714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:14.825613    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5aea865-74d1-434e-ba1a-2069f3f32ca5-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:15.500674 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:15.500645    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"
Sep 08 00:22:15.500818 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:15.500673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz" event={"ID":"a5aea865-74d1-434e-ba1a-2069f3f32ca5","Type":"ContainerDied","Data":"05411ac245130613f723490ccb242c249629cc85abf347aa5a7f19abdbc08046"}
Sep 08 00:22:15.500818 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:15.500715    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05411ac245130613f723490ccb242c249629cc85abf347aa5a7f19abdbc08046"
Sep 08 00:22:16.080066 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:16.080033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:16.181052 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:16.181014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:16.306837 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:16.306785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:16.829400 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:16.829338    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:17.095915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:17.095823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:17.112019 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:17.111983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:18.010125 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:18.010090    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:19.814303 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:19.814267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:19.907824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:19.907792    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.060437 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.060407    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.162705 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.162656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.388174 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.388075    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.520457 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.520418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.582308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.582270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.633638 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.633607    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"]
Sep 08 00:22:21.634025 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.634013    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5aea865-74d1-434e-ba1a-2069f3f32ca5" containerName="revoke-keys"
Sep 08 00:22:21.634067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.634027    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5aea865-74d1-434e-ba1a-2069f3f32ca5" containerName="revoke-keys"
Sep 08 00:22:21.634103 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.634084    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5aea865-74d1-434e-ba1a-2069f3f32ca5" containerName="revoke-keys"
Sep 08 00:22:21.637305 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.637285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.639241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.639184    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-8978e7-dockercfg-rsz6v\""
Sep 08 00:22:21.639241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.639224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-8978e7\""
Sep 08 00:22:21.645386 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.645366    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"]
Sep 08 00:22:21.654152 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.654130    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"]
Sep 08 00:22:21.657522 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.657508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.667250 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.667228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"]
Sep 08 00:22:21.692703 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.692668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be930aa2-f30c-4c64-a90e-502e0a06c100-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.692839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.692738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6cmj\" (UniqueName: \"kubernetes.io/projected/be930aa2-f30c-4c64-a90e-502e0a06c100-kube-api-access-z6cmj\") pod \"payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.692898 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.692835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba85970b-ea6b-452d-b08b-6050a8e1ae32-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.692898 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.692869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gqsw\" (UniqueName: \"kubernetes.io/projected/ba85970b-ea6b-452d-b08b-6050a8e1ae32-kube-api-access-9gqsw\") pod \"payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.794392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.794355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba85970b-ea6b-452d-b08b-6050a8e1ae32-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.794575 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.794405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gqsw\" (UniqueName: \"kubernetes.io/projected/ba85970b-ea6b-452d-b08b-6050a8e1ae32-kube-api-access-9gqsw\") pod \"payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.794575 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.794444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be930aa2-f30c-4c64-a90e-502e0a06c100-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.794575 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.794511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6cmj\" (UniqueName: \"kubernetes.io/projected/be930aa2-f30c-4c64-a90e-502e0a06c100-kube-api-access-z6cmj\") pod \"payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.795390 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.795205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba85970b-ea6b-452d-b08b-6050a8e1ae32-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.795528 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.795495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be930aa2-f30c-4c64-a90e-502e0a06c100-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.808953 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.808920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6cmj\" (UniqueName: \"kubernetes.io/projected/be930aa2-f30c-4c64-a90e-502e0a06c100-kube-api-access-z6cmj\") pod \"payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.809097 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.808970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gqsw\" (UniqueName: \"kubernetes.io/projected/ba85970b-ea6b-452d-b08b-6050a8e1ae32-kube-api-access-9gqsw\") pod \"payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.824370 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.824327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.855903 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.855873    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"]
Sep 08 00:22:21.856123 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.856097    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg" podUID="812f7fd3-7b29-4583-8cb3-0bddedfa2299" containerName="payload-pre-processing" containerID="cri-o://6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69" gracePeriod=30
Sep 08 00:22:21.924483 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.924454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:21.948749 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.948719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:21.967498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.967469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:21.988698 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:21.988615    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:22.021398 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.017982    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"]
Sep 08 00:22:22.021398 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.021285    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e250ebf1-s47lz"]
Sep 08 00:22:22.046040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.045561    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:22.142222 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.142197    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:22:22.201157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.201073    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/812f7fd3-7b29-4583-8cb3-0bddedfa2299-plugins-config-volume\") pod \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") "
Sep 08 00:22:22.201157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.201124    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77xsh\" (UniqueName: \"kubernetes.io/projected/812f7fd3-7b29-4583-8cb3-0bddedfa2299-kube-api-access-77xsh\") pod \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\" (UID: \"812f7fd3-7b29-4583-8cb3-0bddedfa2299\") "
Sep 08 00:22:22.201574 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.201537    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812f7fd3-7b29-4583-8cb3-0bddedfa2299-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "812f7fd3-7b29-4583-8cb3-0bddedfa2299" (UID: "812f7fd3-7b29-4583-8cb3-0bddedfa2299"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:22.203366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.203324    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812f7fd3-7b29-4583-8cb3-0bddedfa2299-kube-api-access-77xsh" (OuterVolumeSpecName: "kube-api-access-77xsh") pod "812f7fd3-7b29-4583-8cb3-0bddedfa2299" (UID: "812f7fd3-7b29-4583-8cb3-0bddedfa2299"). InnerVolumeSpecName "kube-api-access-77xsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:22.225984 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.225960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"]
Sep 08 00:22:22.228384 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:22:22.228337    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe930aa2_f30c_4c64_a90e_502e0a06c100.slice/crio-6fb4b33d99cd8b60d96871afc4effbc29ee1f0a978f50284aa791653ce30e619 WatchSource:0}: Error finding container 6fb4b33d99cd8b60d96871afc4effbc29ee1f0a978f50284aa791653ce30e619: Status 404 returned error can't find the container with id 6fb4b33d99cd8b60d96871afc4effbc29ee1f0a978f50284aa791653ce30e619
Sep 08 00:22:22.258362 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.258308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"]
Sep 08 00:22:22.262825 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:22:22.262787    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba85970b_ea6b_452d_b08b_6050a8e1ae32.slice/crio-9621c62a00cfb2e626b0db2c6fd2a229a17652624528d7993bf61959d2bd9a9e WatchSource:0}: Error finding container 9621c62a00cfb2e626b0db2c6fd2a229a17652624528d7993bf61959d2bd9a9e: Status 404 returned error can't find the container with id 9621c62a00cfb2e626b0db2c6fd2a229a17652624528d7993bf61959d2bd9a9e
Sep 08 00:22:22.301943 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.301921    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/812f7fd3-7b29-4583-8cb3-0bddedfa2299-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:22.301943 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.301944    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77xsh\" (UniqueName: \"kubernetes.io/projected/812f7fd3-7b29-4583-8cb3-0bddedfa2299-kube-api-access-77xsh\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:22.351663 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.351624    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:22.536018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.535911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj" event={"ID":"be930aa2-f30c-4c64-a90e-502e0a06c100","Type":"ContainerStarted","Data":"8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71"}
Sep 08 00:22:22.536018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.535969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj" event={"ID":"be930aa2-f30c-4c64-a90e-502e0a06c100","Type":"ContainerStarted","Data":"6fb4b33d99cd8b60d96871afc4effbc29ee1f0a978f50284aa791653ce30e619"}
Sep 08 00:22:22.536018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.536011    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:22.537474 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.537450    2580 generic.go:356] "Generic (PLEG): container finished" podID="812f7fd3-7b29-4583-8cb3-0bddedfa2299" containerID="6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69" exitCode=0
Sep 08 00:22:22.537579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.537485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg" event={"ID":"812f7fd3-7b29-4583-8cb3-0bddedfa2299","Type":"ContainerDied","Data":"6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69"}
Sep 08 00:22:22.537579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.537505    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"
Sep 08 00:22:22.537579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.537542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg" event={"ID":"812f7fd3-7b29-4583-8cb3-0bddedfa2299","Type":"ContainerDied","Data":"768514c6b9c3faea772f3b51e1dbfda61cbfeab1c34bffe4a9969c4f2e50c5e2"}
Sep 08 00:22:22.537579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.537574    2580 scope.go:117] "RemoveContainer" containerID="6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69"
Sep 08 00:22:22.539649 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.539618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt" event={"ID":"ba85970b-ea6b-452d-b08b-6050a8e1ae32","Type":"ContainerStarted","Data":"cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c"}
Sep 08 00:22:22.539780 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.539678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt" event={"ID":"ba85970b-ea6b-452d-b08b-6050a8e1ae32","Type":"ContainerStarted","Data":"9621c62a00cfb2e626b0db2c6fd2a229a17652624528d7993bf61959d2bd9a9e"}
Sep 08 00:22:22.539780 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.539712    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:22.547666 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.547642    2580 scope.go:117] "RemoveContainer" containerID="6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69"
Sep 08 00:22:22.548029 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:22:22.548008    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69\": container with ID starting with 6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69 not found: ID does not exist" containerID="6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69"
Sep 08 00:22:22.548087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.548040    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69"} err="failed to get container status \"6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69\": rpc error: code = NotFound desc = could not find container \"6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69\": container with ID starting with 6bf4b025560713a95c355a189423954d4bb8b5aeeb2b2ba9851dc5512e8a0d69 not found: ID does not exist"
Sep 08 00:22:22.551188 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.551138    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj" podStartSLOduration=1.551120254 podStartE2EDuration="1.551120254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:22.54887623 +0000 UTC m=+1183.034304851" watchObservedRunningTime="2026-09-08 00:22:22.551120254 +0000 UTC m=+1183.036548906"
Sep 08 00:22:22.564814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.564758    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt" podStartSLOduration=1.5647398510000001 podStartE2EDuration="1.564739851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:22.562898778 +0000 UTC m=+1183.048327413" watchObservedRunningTime="2026-09-08 00:22:22.564739851 +0000 UTC m=+1183.050168460"
Sep 08 00:22:22.575823 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.575790    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"]
Sep 08 00:22:22.579015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:22.578988    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e250ebf1-779969d7f8-j7kzg"]
Sep 08 00:22:23.933511 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:23.933474    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="812f7fd3-7b29-4583-8cb3-0bddedfa2299" path="/var/lib/kubelet/pods/812f7fd3-7b29-4583-8cb3-0bddedfa2299/volumes"
Sep 08 00:22:23.934830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:23.934796    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5aea865-74d1-434e-ba1a-2069f3f32ca5" path="/var/lib/kubelet/pods/a5aea865-74d1-434e-ba1a-2069f3f32ca5/volumes"
Sep 08 00:22:24.481602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.481539    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg" podUID="f4a16453-0182-4348-9950-ddcea7a3ff22" containerName="main" containerID="cri-o://e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c" gracePeriod=45
Sep 08 00:22:24.740879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.740808    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:24.827432 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827398    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-home\") pod \"f4a16453-0182-4348-9950-ddcea7a3ff22\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") "
Sep 08 00:22:24.827432 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827437    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f9lh\" (UniqueName: \"kubernetes.io/projected/f4a16453-0182-4348-9950-ddcea7a3ff22-kube-api-access-4f9lh\") pod \"f4a16453-0182-4348-9950-ddcea7a3ff22\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") "
Sep 08 00:22:24.827648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827463    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-dshm\") pod \"f4a16453-0182-4348-9950-ddcea7a3ff22\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") "
Sep 08 00:22:24.827648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827507    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-model-cache\") pod \"f4a16453-0182-4348-9950-ddcea7a3ff22\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") "
Sep 08 00:22:24.827648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a16453-0182-4348-9950-ddcea7a3ff22-tls-certs\") pod \"f4a16453-0182-4348-9950-ddcea7a3ff22\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") "
Sep 08 00:22:24.827648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827628    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-tmp-dir\") pod \"f4a16453-0182-4348-9950-ddcea7a3ff22\" (UID: \"f4a16453-0182-4348-9950-ddcea7a3ff22\") "
Sep 08 00:22:24.827855 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-home" (OuterVolumeSpecName: "home") pod "f4a16453-0182-4348-9950-ddcea7a3ff22" (UID: "f4a16453-0182-4348-9950-ddcea7a3ff22"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:24.827855 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827783    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4a16453-0182-4348-9950-ddcea7a3ff22" (UID: "f4a16453-0182-4348-9950-ddcea7a3ff22"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:24.827967 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827932    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4a16453-0182-4348-9950-ddcea7a3ff22" (UID: "f4a16453-0182-4348-9950-ddcea7a3ff22"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:24.828022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827974    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-home\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:24.828022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.827994    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-model-cache\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:24.829728 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.829701    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-dshm" (OuterVolumeSpecName: "dshm") pod "f4a16453-0182-4348-9950-ddcea7a3ff22" (UID: "f4a16453-0182-4348-9950-ddcea7a3ff22"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:24.829832 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.829792    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4a16453-0182-4348-9950-ddcea7a3ff22-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4a16453-0182-4348-9950-ddcea7a3ff22" (UID: "f4a16453-0182-4348-9950-ddcea7a3ff22"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:22:24.829885 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.829838    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a16453-0182-4348-9950-ddcea7a3ff22-kube-api-access-4f9lh" (OuterVolumeSpecName: "kube-api-access-4f9lh") pod "f4a16453-0182-4348-9950-ddcea7a3ff22" (UID: "f4a16453-0182-4348-9950-ddcea7a3ff22"). InnerVolumeSpecName "kube-api-access-4f9lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:24.929316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.929274    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a16453-0182-4348-9950-ddcea7a3ff22-tls-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:24.929491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.929333    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-tmp-dir\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:24.929491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.929354    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f9lh\" (UniqueName: \"kubernetes.io/projected/f4a16453-0182-4348-9950-ddcea7a3ff22-kube-api-access-4f9lh\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:24.929491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:24.929364    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4a16453-0182-4348-9950-ddcea7a3ff22-dshm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:22:25.559453 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.559413    2580 generic.go:356] "Generic (PLEG): container finished" podID="f4a16453-0182-4348-9950-ddcea7a3ff22" containerID="e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c" exitCode=0
Sep 08 00:22:25.559453 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.559458    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"
Sep 08 00:22:25.559942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.559456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg" event={"ID":"f4a16453-0182-4348-9950-ddcea7a3ff22","Type":"ContainerDied","Data":"e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c"}
Sep 08 00:22:25.559942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.559575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg" event={"ID":"f4a16453-0182-4348-9950-ddcea7a3ff22","Type":"ContainerDied","Data":"96f5edcfd41cac87d98bca4f6f5086cc4d72c2d6d4fd7860e6b0034e9ddb5cac"}
Sep 08 00:22:25.559942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.559595    2580 scope.go:117] "RemoveContainer" containerID="e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c"
Sep 08 00:22:25.569774 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.569754    2580 scope.go:117] "RemoveContainer" containerID="e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c"
Sep 08 00:22:25.570056 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:22:25.570033    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c\": container with ID starting with e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c not found: ID does not exist" containerID="e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c"
Sep 08 00:22:25.570140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.570071    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c"} err="failed to get container status \"e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c\": rpc error: code = NotFound desc = could not find container \"e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c\": container with ID starting with e802a6766546434e9639774d7c1cee474acd9fe7dac726903e3275a1ba58f91c not found: ID does not exist"
Sep 08 00:22:25.580734 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.580704    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"]
Sep 08 00:22:25.582565 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.582543    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-12bd69/noten-model-12bd69-kserve-6df9ff555-qpdtg"]
Sep 08 00:22:25.928005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:25.927975    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4a16453-0182-4348-9950-ddcea7a3ff22" path="/var/lib/kubelet/pods/f4a16453-0182-4348-9950-ddcea7a3ff22/volumes"
Sep 08 00:22:27.980078 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:27.980042    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:28.080475 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:28.080439    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:28.225853 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:28.225797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:28.564892 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:28.564852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:28.664997 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:28.664960    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:28.766316 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:28.766282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:33.547986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:33.547957    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:22:33.548395 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:33.548018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:22:34.502775 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:34.502742    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:34.560684 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:34.560650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:34.644538 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:34.644498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:34.743930 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:34.743886    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:34.851114 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:34.851018    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:40.500307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:40.500263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:40.561543 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:40.561509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:41.477216 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:41.477178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:41.784073 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:41.783986    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:41.990935 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:41.990902    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:44.779225 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:44.779189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:45.045306 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:45.045209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:45.146868 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:45.146832    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:45.865216 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:45.865183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:45.918402 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:45.918375    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:46.275932 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.275893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:46.330986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.330950    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:46.669561 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.669526    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:46.792368 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.792310    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:46.876860 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.876810    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:46.921815 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.921709    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"]
Sep 08 00:22:46.922180 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.922167    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812f7fd3-7b29-4583-8cb3-0bddedfa2299" containerName="payload-pre-processing"
Sep 08 00:22:46.922226 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.922183    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="812f7fd3-7b29-4583-8cb3-0bddedfa2299" containerName="payload-pre-processing"
Sep 08 00:22:46.922226 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.922192    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a16453-0182-4348-9950-ddcea7a3ff22" containerName="main"
Sep 08 00:22:46.922226 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.922198    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a16453-0182-4348-9950-ddcea7a3ff22" containerName="main"
Sep 08 00:22:46.922323 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.922275    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="812f7fd3-7b29-4583-8cb3-0bddedfa2299" containerName="payload-pre-processing"
Sep 08 00:22:46.922323 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.922284    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a16453-0182-4348-9950-ddcea7a3ff22" containerName="main"
Sep 08 00:22:46.924541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.924520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:46.926517 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.926501    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-c6a703\""
Sep 08 00:22:46.926777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.926764    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-c6a703-dockercfg-7rmx2\""
Sep 08 00:22:46.934073 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:46.934054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"]
Sep 08 00:22:47.025485 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.025450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.025657 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.025493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b6kp\" (UniqueName: \"kubernetes.io/projected/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-kube-api-access-9b6kp\") pod \"payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.126218 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.126181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.126218 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.126229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b6kp\" (UniqueName: \"kubernetes.io/projected/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-kube-api-access-9b6kp\") pod \"payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.126996 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.126975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.133850 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.133823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b6kp\" (UniqueName: \"kubernetes.io/projected/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-kube-api-access-9b6kp\") pod \"payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.235579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.235497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.503798 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.503772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"]
Sep 08 00:22:47.506401 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:22:47.506374    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd8dc4b_2fb3_4de3_bbd7_10c5bba7dec0.slice/crio-2d491032b5d0632632455c06b1457d8f30a605871f7c28dabfb499632950adf6 WatchSource:0}: Error finding container 2d491032b5d0632632455c06b1457d8f30a605871f7c28dabfb499632950adf6: Status 404 returned error can't find the container with id 2d491032b5d0632632455c06b1457d8f30a605871f7c28dabfb499632950adf6
Sep 08 00:22:47.676676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.676634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr" event={"ID":"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0","Type":"ContainerStarted","Data":"11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a"}
Sep 08 00:22:47.676869 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.676700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr" event={"ID":"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0","Type":"ContainerStarted","Data":"2d491032b5d0632632455c06b1457d8f30a605871f7c28dabfb499632950adf6"}
Sep 08 00:22:47.676869 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.676822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:22:47.690798 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:47.690748    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr" podStartSLOduration=1.690733346 podStartE2EDuration="1.690733346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:47.689430918 +0000 UTC m=+1208.174859526" watchObservedRunningTime="2026-09-08 00:22:47.690733346 +0000 UTC m=+1208.176161953"
Sep 08 00:22:48.181841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:48.181804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:48.263099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:48.263066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:49.303574 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.303536    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:49.404808 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.404780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:49.504157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.504129    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:49.780740 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.780710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:49.865571 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.865537    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:49.872745 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.872719    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"]
Sep 08 00:22:49.875212 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.875198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:49.877262 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.877245    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-b8c8cd\""
Sep 08 00:22:49.886811 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.886789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"]
Sep 08 00:22:49.951310 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.951279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hf2t\" (UniqueName: \"kubernetes.io/projected/ef933a2c-27d2-4278-9997-bee3c683ca32-kube-api-access-8hf2t\") pod \"payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:49.951479 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:49.951403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef933a2c-27d2-4278-9997-bee3c683ca32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:50.052877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.052781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef933a2c-27d2-4278-9997-bee3c683ca32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:50.053041 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.052893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hf2t\" (UniqueName: \"kubernetes.io/projected/ef933a2c-27d2-4278-9997-bee3c683ca32-kube-api-access-8hf2t\") pod \"payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:50.053629 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.053606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef933a2c-27d2-4278-9997-bee3c683ca32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:50.060057 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.060034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hf2t\" (UniqueName: \"kubernetes.io/projected/ef933a2c-27d2-4278-9997-bee3c683ca32-kube-api-access-8hf2t\") pod \"payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:50.185701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.185655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:50.460588 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.460455    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"]
Sep 08 00:22:50.463594 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:22:50.463567    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef933a2c_27d2_4278_9997_bee3c683ca32.slice/crio-435e0cf91897d24ac452df1339fa7df86c16acb3185acba23c1eb86b9bddc623 WatchSource:0}: Error finding container 435e0cf91897d24ac452df1339fa7df86c16acb3185acba23c1eb86b9bddc623: Status 404 returned error can't find the container with id 435e0cf91897d24ac452df1339fa7df86c16acb3185acba23c1eb86b9bddc623
Sep 08 00:22:50.693549 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.693507    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz" event={"ID":"ef933a2c-27d2-4278-9997-bee3c683ca32","Type":"ContainerStarted","Data":"bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c"}
Sep 08 00:22:50.693717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.693570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz" event={"ID":"ef933a2c-27d2-4278-9997-bee3c683ca32","Type":"ContainerStarted","Data":"435e0cf91897d24ac452df1339fa7df86c16acb3185acba23c1eb86b9bddc623"}
Sep 08 00:22:50.693717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.693598    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:22:50.708075 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.708021    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz" podStartSLOduration=1.7080042039999999 podStartE2EDuration="1.708004204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:50.706813725 +0000 UTC m=+1211.192242334" watchObservedRunningTime="2026-09-08 00:22:50.708004204 +0000 UTC m=+1211.193432812"
Sep 08 00:22:50.997354 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:50.997307    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:52.641982 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:52.641939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:22:58.683526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:22:58.683494    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:23:01.701430 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:01.701395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:23:07.974270 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:07.974232    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:09.979190 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:09.979128    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:10.154562 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:10.154523    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:10.326201 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:10.326106    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:10.632057 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:10.631961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:10.729088 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:10.729039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:13.055297 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:13.055256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:13.237844 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:13.237809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:13.332403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:13.332305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:14.386713 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:14.386678    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:14.487171 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:14.487138    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:14.538858 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:14.538828    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:14.875199 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:14.875169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:14.939526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:14.939490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:15.006529 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.006493    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"]
Sep 08 00:23:15.008953 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.008936    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.011249 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.011228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-e1e91c\""
Sep 08 00:23:15.011830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.011810    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-e1e91c-dockercfg-2r5rr\""
Sep 08 00:23:15.022035 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.022013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"]
Sep 08 00:23:15.050895 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.050854    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"]
Sep 08 00:23:15.053990 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.053965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.057599 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.057573    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"]
Sep 08 00:23:15.100637 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.100610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39dd65e9-0783-4e11-9b7a-944ab15a728a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.100755 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.100660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x47qw\" (UniqueName: \"kubernetes.io/projected/39dd65e9-0783-4e11-9b7a-944ab15a728a-kube-api-access-x47qw\") pod \"payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.100755 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.100732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.100755 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.100748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvmgg\" (UniqueName: \"kubernetes.io/projected/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-kube-api-access-pvmgg\") pod \"payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.201462 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.201430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x47qw\" (UniqueName: \"kubernetes.io/projected/39dd65e9-0783-4e11-9b7a-944ab15a728a-kube-api-access-x47qw\") pod \"payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.201651 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.201542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.201724 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.201564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmgg\" (UniqueName: \"kubernetes.io/projected/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-kube-api-access-pvmgg\") pod \"payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.201819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.201735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39dd65e9-0783-4e11-9b7a-944ab15a728a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.202577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.202551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.202743 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.202663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39dd65e9-0783-4e11-9b7a-944ab15a728a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.208998 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.208976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x47qw\" (UniqueName: \"kubernetes.io/projected/39dd65e9-0783-4e11-9b7a-944ab15a728a-kube-api-access-x47qw\") pod \"payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.209096 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.209038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvmgg\" (UniqueName: \"kubernetes.io/projected/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-kube-api-access-pvmgg\") pod \"payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.319194 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.319164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.368515 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.368431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.590079 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.590054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"]
Sep 08 00:23:15.592827 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:23:15.592799    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dd65e9_0783_4e11_9b7a_944ab15a728a.slice/crio-607cd2842b0b6c93f125119e677926f1c62bf66af15ddb97f4753cbb27d0f22d WatchSource:0}: Error finding container 607cd2842b0b6c93f125119e677926f1c62bf66af15ddb97f4753cbb27d0f22d: Status 404 returned error can't find the container with id 607cd2842b0b6c93f125119e677926f1c62bf66af15ddb97f4753cbb27d0f22d
Sep 08 00:23:15.657582 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.657552    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"]
Sep 08 00:23:15.658636 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:23:15.658612    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce723bf4_b8fd_411c_9676_d0edb8ca80bf.slice/crio-dfc9d091e4240b7c1ce8d5b8449dacc0d8d0595caf4def9a4b31f4462326dd94 WatchSource:0}: Error finding container dfc9d091e4240b7c1ce8d5b8449dacc0d8d0595caf4def9a4b31f4462326dd94: Status 404 returned error can't find the container with id dfc9d091e4240b7c1ce8d5b8449dacc0d8d0595caf4def9a4b31f4462326dd94
Sep 08 00:23:15.823787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.823739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw" event={"ID":"ce723bf4-b8fd-411c-9676-d0edb8ca80bf","Type":"ContainerStarted","Data":"3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4"}
Sep 08 00:23:15.823977 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.823799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw" event={"ID":"ce723bf4-b8fd-411c-9676-d0edb8ca80bf","Type":"ContainerStarted","Data":"dfc9d091e4240b7c1ce8d5b8449dacc0d8d0595caf4def9a4b31f4462326dd94"}
Sep 08 00:23:15.823977 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.823919    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:15.825623 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.825595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w" event={"ID":"39dd65e9-0783-4e11-9b7a-944ab15a728a","Type":"ContainerStarted","Data":"78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002"}
Sep 08 00:23:15.825739 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.825647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w" event={"ID":"39dd65e9-0783-4e11-9b7a-944ab15a728a","Type":"ContainerStarted","Data":"607cd2842b0b6c93f125119e677926f1c62bf66af15ddb97f4753cbb27d0f22d"}
Sep 08 00:23:15.825739 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.825675    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:15.838866 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.838722    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw" podStartSLOduration=0.838705651 podStartE2EDuration="838.705651ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:23:15.838689175 +0000 UTC m=+1236.324117786" watchObservedRunningTime="2026-09-08 00:23:15.838705651 +0000 UTC m=+1236.324134260"
Sep 08 00:23:15.852513 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:15.852422    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w" podStartSLOduration=1.852407989 podStartE2EDuration="1.852407989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:23:15.851145743 +0000 UTC m=+1236.336574350" watchObservedRunningTime="2026-09-08 00:23:15.852407989 +0000 UTC m=+1236.337836600"
Sep 08 00:23:26.832395 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:26.832359    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:23:26.832830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:26.832444    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:23:37.310640 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:37.310550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:38.219175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:38.219137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:51.433936 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:51.433899    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:51.722399 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:51.722289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:51.855230 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:51.855196    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:54.615777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:54.615742    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:54.717124 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:54.717081    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:55.755383 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:55.755299    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:55.816904 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:55.816853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:56.136606 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.136521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:56.250575 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.250544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:56.338315 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.338276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:56.339404 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.339384    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"]
Sep 08 00:23:56.343227 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.343212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.345164 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.345139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b1c04f8f\""
Sep 08 00:23:56.354137 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.354114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"]
Sep 08 00:23:56.372647 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.372600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vb7n\" (UniqueName: \"kubernetes.io/projected/cac334b1-aa5b-4db1-9b54-0b05d30da213-kube-api-access-6vb7n\") pod \"payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.372924 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.372692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac334b1-aa5b-4db1-9b54-0b05d30da213-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.375604 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.375574    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"]
Sep 08 00:23:56.379288 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.379270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.381604 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.381578    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b1c04f8f-dockercfg-zswkv\""
Sep 08 00:23:56.393681 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.393614    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"]
Sep 08 00:23:56.473571 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.473540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4pqq\" (UniqueName: \"kubernetes.io/projected/11225d29-6699-4471-9f23-62cd2194626b-kube-api-access-h4pqq\") pod \"payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") " pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.473773 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.473676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vb7n\" (UniqueName: \"kubernetes.io/projected/cac334b1-aa5b-4db1-9b54-0b05d30da213-kube-api-access-6vb7n\") pod \"payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.473773 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.473709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11225d29-6699-4471-9f23-62cd2194626b-plugins-config-volume\") pod \"payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") " pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.473890 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.473773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac334b1-aa5b-4db1-9b54-0b05d30da213-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.474604 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.474581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac334b1-aa5b-4db1-9b54-0b05d30da213-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.481949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.481923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vb7n\" (UniqueName: \"kubernetes.io/projected/cac334b1-aa5b-4db1-9b54-0b05d30da213-kube-api-access-6vb7n\") pod \"payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.575112 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.575060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pqq\" (UniqueName: \"kubernetes.io/projected/11225d29-6699-4471-9f23-62cd2194626b-kube-api-access-h4pqq\") pod \"payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") " pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.575297 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.575190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11225d29-6699-4471-9f23-62cd2194626b-plugins-config-volume\") pod \"payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") " pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.576136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.576111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11225d29-6699-4471-9f23-62cd2194626b-plugins-config-volume\") pod \"payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") " pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.586698 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.586670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pqq\" (UniqueName: \"kubernetes.io/projected/11225d29-6699-4471-9f23-62cd2194626b-kube-api-access-h4pqq\") pod \"payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") " pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.654825 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.654773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:56.689427 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.689370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:23:56.933182 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.933142    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"]
Sep 08 00:23:56.935521 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:23:56.935491    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac334b1_aa5b_4db1_9b54_0b05d30da213.slice/crio-4f5f1b8887492c0b14857959e3dfec21392d06fe2b68b5e53c6c927ca24c6990 WatchSource:0}: Error finding container 4f5f1b8887492c0b14857959e3dfec21392d06fe2b68b5e53c6c927ca24c6990: Status 404 returned error can't find the container with id 4f5f1b8887492c0b14857959e3dfec21392d06fe2b68b5e53c6c927ca24c6990
Sep 08 00:23:56.971625 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:56.971603    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"]
Sep 08 00:23:56.974564 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:23:56.974529    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11225d29_6699_4471_9f23_62cd2194626b.slice/crio-3534aad69cfa80c4a1b8096c9caf0e9531cb8c587ec40de2d2a03859539eb16b WatchSource:0}: Error finding container 3534aad69cfa80c4a1b8096c9caf0e9531cb8c587ec40de2d2a03859539eb16b: Status 404 returned error can't find the container with id 3534aad69cfa80c4a1b8096c9caf0e9531cb8c587ec40de2d2a03859539eb16b
Sep 08 00:23:57.050613 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:57.050566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s" event={"ID":"11225d29-6699-4471-9f23-62cd2194626b","Type":"ContainerStarted","Data":"3534aad69cfa80c4a1b8096c9caf0e9531cb8c587ec40de2d2a03859539eb16b"}
Sep 08 00:23:57.052552 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:57.052522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6" event={"ID":"cac334b1-aa5b-4db1-9b54-0b05d30da213","Type":"ContainerStarted","Data":"d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2"}
Sep 08 00:23:57.052649 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:57.052582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6" event={"ID":"cac334b1-aa5b-4db1-9b54-0b05d30da213","Type":"ContainerStarted","Data":"4f5f1b8887492c0b14857959e3dfec21392d06fe2b68b5e53c6c927ca24c6990"}
Sep 08 00:23:57.052757 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:57.052738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:23:57.069308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:57.069244    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6" podStartSLOduration=1.069221138 podStartE2EDuration="1.069221138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:23:57.065915227 +0000 UTC m=+1277.551343846" watchObservedRunningTime="2026-09-08 00:23:57.069221138 +0000 UTC m=+1277.554649747"
Sep 08 00:23:57.953865 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:57.953816    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:23:58.059568 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:58.059529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s" event={"ID":"11225d29-6699-4471-9f23-62cd2194626b","Type":"ContainerStarted","Data":"bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1"}
Sep 08 00:23:58.073709 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:58.073662    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s" podStartSLOduration=2.073647095 podStartE2EDuration="2.073647095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:23:58.072625427 +0000 UTC m=+1278.558054060" watchObservedRunningTime="2026-09-08 00:23:58.073647095 +0000 UTC m=+1278.559075733"
Sep 08 00:23:59.064812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:23:59.064783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:24:08.061531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:08.061493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:24:10.072022 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:10.071986    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:24:16.618211 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:16.618165    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:24:19.543490 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:19.543452    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:24:26.499841 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:26.499799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:24:33.383797 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.383759    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"]
Sep 08 00:24:33.387735 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.387715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.390112 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.390080    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b1c04f8f\"/\"default-dockercfg-584wl\""
Sep 08 00:24:33.390112 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.390104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b1c04f8f\"/\"kube-root-ca.crt\""
Sep 08 00:24:33.390283 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.390127    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b1c04f8f\"/\"e2e-lifecycle-model-b1c04f8f-kserve-self-signed-certs\""
Sep 08 00:24:33.390283 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.390104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b1c04f8f\"/\"openshift-service-ca.crt\""
Sep 08 00:24:33.401748 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.401721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"]
Sep 08 00:24:33.411438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.411185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-home\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.411438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.411222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e45772-9849-4340-9da1-296c9fa44279-tls-certs\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.411438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.411271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-model-cache\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.411438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.411312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpgsb\" (UniqueName: \"kubernetes.io/projected/d1e45772-9849-4340-9da1-296c9fa44279-kube-api-access-bpgsb\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.411438 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.411361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-dshm\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.411770 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.411466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-tmp-dir\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.477098 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.476889    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:24:33.512020 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.511980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-home\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512168 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e45772-9849-4340-9da1-296c9fa44279-tls-certs\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512168 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-model-cache\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512168 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpgsb\" (UniqueName: \"kubernetes.io/projected/d1e45772-9849-4340-9da1-296c9fa44279-kube-api-access-bpgsb\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512293 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-dshm\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512293 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-tmp-dir\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512500 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-home\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512700 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-tmp-dir\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.512882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.512856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-model-cache\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.514619 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.514591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-dshm\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.515166 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.515146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e45772-9849-4340-9da1-296c9fa44279-tls-certs\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.518977 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.518953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpgsb\" (UniqueName: \"kubernetes.io/projected/d1e45772-9849-4340-9da1-296c9fa44279-kube-api-access-bpgsb\") pod \"e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") " pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.707113 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.707077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:33.978287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:33.978263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"]
Sep 08 00:24:33.980722 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:24:33.980693    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1e45772_9849_4340_9da1_296c9fa44279.slice/crio-8985ddaf95fdcc839df454dd34e146639cb8b862306eb72f872f3dd59822bab2 WatchSource:0}: Error finding container 8985ddaf95fdcc839df454dd34e146639cb8b862306eb72f872f3dd59822bab2: Status 404 returned error can't find the container with id 8985ddaf95fdcc839df454dd34e146639cb8b862306eb72f872f3dd59822bab2
Sep 08 00:24:34.252233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:34.252136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv" event={"ID":"d1e45772-9849-4340-9da1-296c9fa44279","Type":"ContainerStarted","Data":"8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab"}
Sep 08 00:24:34.252233 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:34.252185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv" event={"ID":"d1e45772-9849-4340-9da1-296c9fa44279","Type":"ContainerStarted","Data":"8985ddaf95fdcc839df454dd34e146639cb8b862306eb72f872f3dd59822bab2"}
Sep 08 00:24:34.266550 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:34.266506    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv" podStartSLOduration=1.26648976 podStartE2EDuration="1.26648976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:24:34.265540964 +0000 UTC m=+1314.750969573" watchObservedRunningTime="2026-09-08 00:24:34.26648976 +0000 UTC m=+1314.751918395"
Sep 08 00:24:43.707979 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:43.707940    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:43.708466 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:43.708027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:43.720532 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:43.720510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:24:44.314882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:24:44.314847    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:25:22.203559 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:22.203522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:25:24.492845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.492802    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:25:24.499659 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.499626    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"]
Sep 08 00:25:24.507099 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.507060    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"]
Sep 08 00:25:24.507335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.507306    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6" podUID="cac334b1-aa5b-4db1-9b54-0b05d30da213" containerName="payload-pre-processing" containerID="cri-o://d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2" gracePeriod=30
Sep 08 00:25:24.519633 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.519589    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s" podUID="11225d29-6699-4471-9f23-62cd2194626b" containerName="payload-processing" containerID="cri-o://bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1" gracePeriod=30
Sep 08 00:25:24.591076 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.591039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:25:24.669004 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.668962    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:25:24.720399 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.720339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:25:24.797642 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.797619    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:25:24.800751 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.800730    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:25:24.888651 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.888612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac334b1-aa5b-4db1-9b54-0b05d30da213-plugins-config-volume\") pod \"cac334b1-aa5b-4db1-9b54-0b05d30da213\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") "
Sep 08 00:25:24.888845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.888662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11225d29-6699-4471-9f23-62cd2194626b-plugins-config-volume\") pod \"11225d29-6699-4471-9f23-62cd2194626b\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") "
Sep 08 00:25:24.888845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.888710    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vb7n\" (UniqueName: \"kubernetes.io/projected/cac334b1-aa5b-4db1-9b54-0b05d30da213-kube-api-access-6vb7n\") pod \"cac334b1-aa5b-4db1-9b54-0b05d30da213\" (UID: \"cac334b1-aa5b-4db1-9b54-0b05d30da213\") "
Sep 08 00:25:24.888845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.888764    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4pqq\" (UniqueName: \"kubernetes.io/projected/11225d29-6699-4471-9f23-62cd2194626b-kube-api-access-h4pqq\") pod \"11225d29-6699-4471-9f23-62cd2194626b\" (UID: \"11225d29-6699-4471-9f23-62cd2194626b\") "
Sep 08 00:25:24.889038 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.889007    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cac334b1-aa5b-4db1-9b54-0b05d30da213-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cac334b1-aa5b-4db1-9b54-0b05d30da213" (UID: "cac334b1-aa5b-4db1-9b54-0b05d30da213"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:25:24.889133 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.889106    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11225d29-6699-4471-9f23-62cd2194626b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "11225d29-6699-4471-9f23-62cd2194626b" (UID: "11225d29-6699-4471-9f23-62cd2194626b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:25:24.890893 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.890872    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cac334b1-aa5b-4db1-9b54-0b05d30da213-kube-api-access-6vb7n" (OuterVolumeSpecName: "kube-api-access-6vb7n") pod "cac334b1-aa5b-4db1-9b54-0b05d30da213" (UID: "cac334b1-aa5b-4db1-9b54-0b05d30da213"). InnerVolumeSpecName "kube-api-access-6vb7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:25:24.890987 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.890964    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11225d29-6699-4471-9f23-62cd2194626b-kube-api-access-h4pqq" (OuterVolumeSpecName: "kube-api-access-h4pqq") pod "11225d29-6699-4471-9f23-62cd2194626b" (UID: "11225d29-6699-4471-9f23-62cd2194626b"). InnerVolumeSpecName "kube-api-access-h4pqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:25:24.989717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.989679    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac334b1-aa5b-4db1-9b54-0b05d30da213-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:24.989717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.989710    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11225d29-6699-4471-9f23-62cd2194626b-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:24.989717 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.989720    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vb7n\" (UniqueName: \"kubernetes.io/projected/cac334b1-aa5b-4db1-9b54-0b05d30da213-kube-api-access-6vb7n\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:24.990058 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:24.989731    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4pqq\" (UniqueName: \"kubernetes.io/projected/11225d29-6699-4471-9f23-62cd2194626b-kube-api-access-h4pqq\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:25.526393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.526332    2580 generic.go:356] "Generic (PLEG): container finished" podID="cac334b1-aa5b-4db1-9b54-0b05d30da213" containerID="d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2" exitCode=0
Sep 08 00:25:25.526393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.526391    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"
Sep 08 00:25:25.526851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.526409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6" event={"ID":"cac334b1-aa5b-4db1-9b54-0b05d30da213","Type":"ContainerDied","Data":"d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2"}
Sep 08 00:25:25.526851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.526475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6" event={"ID":"cac334b1-aa5b-4db1-9b54-0b05d30da213","Type":"ContainerDied","Data":"4f5f1b8887492c0b14857959e3dfec21392d06fe2b68b5e53c6c927ca24c6990"}
Sep 08 00:25:25.526851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.526505    2580 scope.go:117] "RemoveContainer" containerID="d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2"
Sep 08 00:25:25.528067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.528042    2580 generic.go:356] "Generic (PLEG): container finished" podID="11225d29-6699-4471-9f23-62cd2194626b" containerID="bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1" exitCode=0
Sep 08 00:25:25.528176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.528078    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"
Sep 08 00:25:25.528176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.528093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s" event={"ID":"11225d29-6699-4471-9f23-62cd2194626b","Type":"ContainerDied","Data":"bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1"}
Sep 08 00:25:25.528176 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.528143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s" event={"ID":"11225d29-6699-4471-9f23-62cd2194626b","Type":"ContainerDied","Data":"3534aad69cfa80c4a1b8096c9caf0e9531cb8c587ec40de2d2a03859539eb16b"}
Sep 08 00:25:25.537635 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.537620    2580 scope.go:117] "RemoveContainer" containerID="d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2"
Sep 08 00:25:25.537895 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:25:25.537873    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2\": container with ID starting with d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2 not found: ID does not exist" containerID="d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2"
Sep 08 00:25:25.538014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.537903    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2"} err="failed to get container status \"d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2\": rpc error: code = NotFound desc = could not find container \"d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2\": container with ID starting with d79f502287bd85291f028f3297202042ddef45ada1e324ae871c3eef2638edf2 not found: ID does not exist"
Sep 08 00:25:25.538014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.537919    2580 scope.go:117] "RemoveContainer" containerID="bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1"
Sep 08 00:25:25.545952 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.545932    2580 scope.go:117] "RemoveContainer" containerID="bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1"
Sep 08 00:25:25.546232 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:25:25.546213    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1\": container with ID starting with bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1 not found: ID does not exist" containerID="bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1"
Sep 08 00:25:25.546294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.546239    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1"} err="failed to get container status \"bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1\": rpc error: code = NotFound desc = could not find container \"bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1\": container with ID starting with bd5e71228efd9cd02df188aea50cdb683e2884178729ad6b3d7c45d16f0687d1 not found: ID does not exist"
Sep 08 00:25:25.547607 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.547564    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"]
Sep 08 00:25:25.549729 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.549707    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1c04f8f-5b7dc44d4b-cdkt6"]
Sep 08 00:25:25.558141 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.558119    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"]
Sep 08 00:25:25.562247 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.562225    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1c04f8f-786fdcbcfc-vql2s"]
Sep 08 00:25:25.927616 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.927587    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11225d29-6699-4471-9f23-62cd2194626b" path="/var/lib/kubelet/pods/11225d29-6699-4471-9f23-62cd2194626b/volumes"
Sep 08 00:25:25.927998 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:25.927984    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cac334b1-aa5b-4db1-9b54-0b05d30da213" path="/var/lib/kubelet/pods/cac334b1-aa5b-4db1-9b54-0b05d30da213/volumes"
Sep 08 00:25:27.620084 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:27.620049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:25:32.607474 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:32.607440    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"]
Sep 08 00:25:32.647624 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:32.647584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:25:47.628180 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.628114    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv" podUID="d1e45772-9849-4340-9da1-296c9fa44279" containerName="main" containerID="cri-o://8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab" gracePeriod=45
Sep 08 00:25:47.884938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.884884    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:25:47.999629 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.999601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-dshm\") pod \"d1e45772-9849-4340-9da1-296c9fa44279\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") "
Sep 08 00:25:47.999814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.999636    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpgsb\" (UniqueName: \"kubernetes.io/projected/d1e45772-9849-4340-9da1-296c9fa44279-kube-api-access-bpgsb\") pod \"d1e45772-9849-4340-9da1-296c9fa44279\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") "
Sep 08 00:25:47.999814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.999663    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-home\") pod \"d1e45772-9849-4340-9da1-296c9fa44279\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") "
Sep 08 00:25:47.999814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.999690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e45772-9849-4340-9da1-296c9fa44279-tls-certs\") pod \"d1e45772-9849-4340-9da1-296c9fa44279\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") "
Sep 08 00:25:47.999814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.999715    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-tmp-dir\") pod \"d1e45772-9849-4340-9da1-296c9fa44279\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") "
Sep 08 00:25:47.999814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:47.999766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-model-cache\") pod \"d1e45772-9849-4340-9da1-296c9fa44279\" (UID: \"d1e45772-9849-4340-9da1-296c9fa44279\") "
Sep 08 00:25:48.000108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.000048    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1e45772-9849-4340-9da1-296c9fa44279" (UID: "d1e45772-9849-4340-9da1-296c9fa44279"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:25:48.000108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.000091    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-home" (OuterVolumeSpecName: "home") pod "d1e45772-9849-4340-9da1-296c9fa44279" (UID: "d1e45772-9849-4340-9da1-296c9fa44279"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:25:48.000200 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.000110    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1e45772-9849-4340-9da1-296c9fa44279" (UID: "d1e45772-9849-4340-9da1-296c9fa44279"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:25:48.001961 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.001938    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1e45772-9849-4340-9da1-296c9fa44279-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1e45772-9849-4340-9da1-296c9fa44279" (UID: "d1e45772-9849-4340-9da1-296c9fa44279"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:25:48.002214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.002189    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-dshm" (OuterVolumeSpecName: "dshm") pod "d1e45772-9849-4340-9da1-296c9fa44279" (UID: "d1e45772-9849-4340-9da1-296c9fa44279"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:25:48.002214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.002194    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e45772-9849-4340-9da1-296c9fa44279-kube-api-access-bpgsb" (OuterVolumeSpecName: "kube-api-access-bpgsb") pod "d1e45772-9849-4340-9da1-296c9fa44279" (UID: "d1e45772-9849-4340-9da1-296c9fa44279"). InnerVolumeSpecName "kube-api-access-bpgsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:25:48.101005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.100968    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-dshm\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:48.101005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.101002    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpgsb\" (UniqueName: \"kubernetes.io/projected/d1e45772-9849-4340-9da1-296c9fa44279-kube-api-access-bpgsb\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:48.101005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.101011    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-home\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:48.101240 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.101020    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e45772-9849-4340-9da1-296c9fa44279-tls-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:48.101240 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.101030    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-tmp-dir\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:48.101240 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.101038    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e45772-9849-4340-9da1-296c9fa44279-model-cache\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:25:48.650170 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.650137    2580 generic.go:356] "Generic (PLEG): container finished" podID="d1e45772-9849-4340-9da1-296c9fa44279" containerID="8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab" exitCode=0
Sep 08 00:25:48.650647 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.650179    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"
Sep 08 00:25:48.650647 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.650208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv" event={"ID":"d1e45772-9849-4340-9da1-296c9fa44279","Type":"ContainerDied","Data":"8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab"}
Sep 08 00:25:48.650647 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.650241    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv" event={"ID":"d1e45772-9849-4340-9da1-296c9fa44279","Type":"ContainerDied","Data":"8985ddaf95fdcc839df454dd34e146639cb8b862306eb72f872f3dd59822bab2"}
Sep 08 00:25:48.650647 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.650259    2580 scope.go:117] "RemoveContainer" containerID="8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab"
Sep 08 00:25:48.660088 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.660070    2580 scope.go:117] "RemoveContainer" containerID="8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab"
Sep 08 00:25:48.660433 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:25:48.660409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab\": container with ID starting with 8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab not found: ID does not exist" containerID="8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab"
Sep 08 00:25:48.660519 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.660445    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab"} err="failed to get container status \"8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab\": rpc error: code = NotFound desc = could not find container \"8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab\": container with ID starting with 8d6194209cc079599cf070c85340ac76bca6ae672377f4874698b9357c661fab not found: ID does not exist"
Sep 08 00:25:48.670566 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.670541    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"]
Sep 08 00:25:48.674203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:48.674166    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b1c04f8f/e2e-lifecycle-model-b1c04f8f-kserve-6cfd488655-96tvv"]
Sep 08 00:25:49.928714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:25:49.928678    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e45772-9849-4340-9da1-296c9fa44279" path="/var/lib/kubelet/pods/d1e45772-9849-4340-9da1-296c9fa44279/volumes"
Sep 08 00:26:08.739254 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:08.739218    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:09.533720 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:09.533685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:14.881845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:14.881805    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:20.028659 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:20.028619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:20.077883 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:20.077854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:27.241386 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.241336    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7859-3288b5"]
Sep 08 00:26:27.241943 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.241921    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac334b1-aa5b-4db1-9b54-0b05d30da213" containerName="payload-pre-processing"
Sep 08 00:26:27.242030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.241947    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac334b1-aa5b-4db1-9b54-0b05d30da213" containerName="payload-pre-processing"
Sep 08 00:26:27.242030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.241964    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e45772-9849-4340-9da1-296c9fa44279" containerName="main"
Sep 08 00:26:27.242030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.241973    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e45772-9849-4340-9da1-296c9fa44279" containerName="main"
Sep 08 00:26:27.242030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.242006    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11225d29-6699-4471-9f23-62cd2194626b" containerName="payload-processing"
Sep 08 00:26:27.242030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.242015    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11225d29-6699-4471-9f23-62cd2194626b" containerName="payload-processing"
Sep 08 00:26:27.242283 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.242124    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e45772-9849-4340-9da1-296c9fa44279" containerName="main"
Sep 08 00:26:27.242283 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.242140    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="11225d29-6699-4471-9f23-62cd2194626b" containerName="payload-processing"
Sep 08 00:26:27.242283 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.242153    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac334b1-aa5b-4db1-9b54-0b05d30da213" containerName="payload-pre-processing"
Sep 08 00:26:27.245281 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.245261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:27.247096 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.247074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-79v5x\""
Sep 08 00:26:27.250762 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.250741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7859-3288b5"]
Sep 08 00:26:27.368863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.368827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkl8l\" (UniqueName: \"kubernetes.io/projected/54ed63e1-c97a-4b0c-8918-2454786bc98b-kube-api-access-mkl8l\") pod \"mt-curl-7859-3288b5\" (UID: \"54ed63e1-c97a-4b0c-8918-2454786bc98b\") " pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:27.470042 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.470001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkl8l\" (UniqueName: \"kubernetes.io/projected/54ed63e1-c97a-4b0c-8918-2454786bc98b-kube-api-access-mkl8l\") pod \"mt-curl-7859-3288b5\" (UID: \"54ed63e1-c97a-4b0c-8918-2454786bc98b\") " pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:27.476658 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.476635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkl8l\" (UniqueName: \"kubernetes.io/projected/54ed63e1-c97a-4b0c-8918-2454786bc98b-kube-api-access-mkl8l\") pod \"mt-curl-7859-3288b5\" (UID: \"54ed63e1-c97a-4b0c-8918-2454786bc98b\") " pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:27.556289 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.556233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:27.822898 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.822876    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7859-3288b5"]
Sep 08 00:26:27.825131 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:26:27.825106    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54ed63e1_c97a_4b0c_8918_2454786bc98b.slice/crio-5f23ea4af85094b03bbe79b4c08567fa4a1ffd18f8caabdb3b41cd7a63f39576 WatchSource:0}: Error finding container 5f23ea4af85094b03bbe79b4c08567fa4a1ffd18f8caabdb3b41cd7a63f39576: Status 404 returned error can't find the container with id 5f23ea4af85094b03bbe79b4c08567fa4a1ffd18f8caabdb3b41cd7a63f39576
Sep 08 00:26:27.861010 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:27.860986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7859-3288b5" event={"ID":"54ed63e1-c97a-4b0c-8918-2454786bc98b","Type":"ContainerStarted","Data":"5f23ea4af85094b03bbe79b4c08567fa4a1ffd18f8caabdb3b41cd7a63f39576"}
Sep 08 00:26:28.867540 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:28.867447    2580 generic.go:356] "Generic (PLEG): container finished" podID="54ed63e1-c97a-4b0c-8918-2454786bc98b" containerID="e66333fa40f51336a3f0fcb57a03a2f59bf2598f5c362eaf38c54ea6be3a837f" exitCode=0
Sep 08 00:26:28.867929 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:28.867545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7859-3288b5" event={"ID":"54ed63e1-c97a-4b0c-8918-2454786bc98b","Type":"ContainerDied","Data":"e66333fa40f51336a3f0fcb57a03a2f59bf2598f5c362eaf38c54ea6be3a837f"}
Sep 08 00:26:29.144625 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:29.144549    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:29.204798 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:29.204764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:29.382544 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:29.382509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:30.002942 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.002917    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:30.018819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.018799    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7859-3288b5_54ed63e1-c97a-4b0c-8918-2454786bc98b/mt-curl-7859-3288b5/0.log"
Sep 08 00:26:30.037851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.037809    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7859-3288b5"]
Sep 08 00:26:30.039915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.039887    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7859-3288b5"]
Sep 08 00:26:30.095295 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.095262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkl8l\" (UniqueName: \"kubernetes.io/projected/54ed63e1-c97a-4b0c-8918-2454786bc98b-kube-api-access-mkl8l\") pod \"54ed63e1-c97a-4b0c-8918-2454786bc98b\" (UID: \"54ed63e1-c97a-4b0c-8918-2454786bc98b\") "
Sep 08 00:26:30.097457 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.097432    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ed63e1-c97a-4b0c-8918-2454786bc98b-kube-api-access-mkl8l" (OuterVolumeSpecName: "kube-api-access-mkl8l") pod "54ed63e1-c97a-4b0c-8918-2454786bc98b" (UID: "54ed63e1-c97a-4b0c-8918-2454786bc98b"). InnerVolumeSpecName "kube-api-access-mkl8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:26:30.196877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.196841    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkl8l\" (UniqueName: \"kubernetes.io/projected/54ed63e1-c97a-4b0c-8918-2454786bc98b-kube-api-access-mkl8l\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:26:30.569914 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.569809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:30.669632 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.669597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:30.769629 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.769591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:30.879280 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.879194    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:30.879280 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:30.879211    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f23ea4af85094b03bbe79b4c08567fa4a1ffd18f8caabdb3b41cd7a63f39576"
Sep 08 00:26:30.889118 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:26:30.889085    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7859-3288b5\" is forbidden: User \"system:node:ip-10-0-136-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-92.ec2.internal' and this object" podUID="54ed63e1-c97a-4b0c-8918-2454786bc98b" pod="opendatahub/mt-curl-7859-3288b5"
Sep 08 00:26:31.358741 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:31.358701    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:31.430432 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:31.430398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:31.510571 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:31.510544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:31.927667 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:31.927632    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ed63e1-c97a-4b0c-8918-2454786bc98b" path="/var/lib/kubelet/pods/54ed63e1-c97a-4b0c-8918-2454786bc98b/volumes"
Sep 08 00:26:32.490200 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:32.490162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:32.743294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:32.743214    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:38.345307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:38.345269    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:38.445775 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:38.445722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:38.933842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:38.933800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:41.006604 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:41.006570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:44.681666 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:44.681626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:44.741024 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:44.740989    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:44.809393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:44.809354    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:44.903492 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:44.903460    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:55.404495 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:55.404454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:26:55.573587 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:26:55.573554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:17.189893 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:17.189852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:22.035602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:22.035566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:22.102079 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:22.102048    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:22.367021 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:22.366933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:22.646744 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:22.646655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:22.752269 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:22.752237    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:25.964833 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:25.964803    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:26.064034 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:26.063997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:27.201652 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.201611    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:27.301044 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.301013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:27.402339 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.402303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:27.713419 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.713384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:27.817308 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.816476    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:27.822364 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.822311    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"]
Sep 08 00:27:27.822743 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.822730    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ed63e1-c97a-4b0c-8918-2454786bc98b" containerName="mt-curl-7859-3288b5"
Sep 08 00:27:27.822792 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.822744    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ed63e1-c97a-4b0c-8918-2454786bc98b" containerName="mt-curl-7859-3288b5"
Sep 08 00:27:27.822834 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.822817    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ed63e1-c97a-4b0c-8918-2454786bc98b" containerName="mt-curl-7859-3288b5"
Sep 08 00:27:27.831090 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.831062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:27.833049 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.833027    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-93c8ee\""
Sep 08 00:27:27.833190 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.833129    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-93c8ee-dockercfg-t2b8q\""
Sep 08 00:27:27.836715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.836692    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"]
Sep 08 00:27:27.857187 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.857158    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"]
Sep 08 00:27:27.860765 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.860746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:27.870378 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.870339    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"]
Sep 08 00:27:27.929046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.929015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6961abd4-642b-4352-a1d1-36681da81b51-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:27.929212 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:27.929064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zchjb\" (UniqueName: \"kubernetes.io/projected/6961abd4-642b-4352-a1d1-36681da81b51-kube-api-access-zchjb\") pod \"payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:28.029988 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.029893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r65x9\" (UniqueName: \"kubernetes.io/projected/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-kube-api-access-r65x9\") pod \"payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") " pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:28.029988 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.029975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6961abd4-642b-4352-a1d1-36681da81b51-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:28.030235 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.030014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zchjb\" (UniqueName: \"kubernetes.io/projected/6961abd4-642b-4352-a1d1-36681da81b51-kube-api-access-zchjb\") pod \"payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:28.030235 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.030067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") " pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:28.030799 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.030777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6961abd4-642b-4352-a1d1-36681da81b51-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:28.039400 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.039372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zchjb\" (UniqueName: \"kubernetes.io/projected/6961abd4-642b-4352-a1d1-36681da81b51-kube-api-access-zchjb\") pod \"payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:28.130806 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.130774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r65x9\" (UniqueName: \"kubernetes.io/projected/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-kube-api-access-r65x9\") pod \"payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") " pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:28.130938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.130834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") " pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:28.131509 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.131476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") " pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:28.137481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.137460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r65x9\" (UniqueName: \"kubernetes.io/projected/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-kube-api-access-r65x9\") pod \"payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") " pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:28.143275 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.143254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:28.171586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.171553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:28.415715 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.415685    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"]
Sep 08 00:27:28.417811 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:27:28.417781    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6961abd4_642b_4352_a1d1_36681da81b51.slice/crio-e691ec6cf364afc972fb4b80359ee8a5a115f4c45cc98f0952ff9cce4c7d8826 WatchSource:0}: Error finding container e691ec6cf364afc972fb4b80359ee8a5a115f4c45cc98f0952ff9cce4c7d8826: Status 404 returned error can't find the container with id e691ec6cf364afc972fb4b80359ee8a5a115f4c45cc98f0952ff9cce4c7d8826
Sep 08 00:27:28.451244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:28.451221    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"]
Sep 08 00:27:28.452851 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:27:28.452826    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1571c5_4cef_4fbe_a3ac_d19a69792b7c.slice/crio-d91c4bb9e78c9de7dd9dded83d730c5c04f92654f13f3ebde20350156e43e010 WatchSource:0}: Error finding container d91c4bb9e78c9de7dd9dded83d730c5c04f92654f13f3ebde20350156e43e010: Status 404 returned error can't find the container with id d91c4bb9e78c9de7dd9dded83d730c5c04f92654f13f3ebde20350156e43e010
Sep 08 00:27:29.185842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.185801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8" event={"ID":"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c","Type":"ContainerStarted","Data":"1c7c5223884b83000a767097df64133e870e8f54543622b41b897216b6205e50"}
Sep 08 00:27:29.186125 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.186101    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:29.186271 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.186135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8" event={"ID":"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c","Type":"ContainerStarted","Data":"d91c4bb9e78c9de7dd9dded83d730c5c04f92654f13f3ebde20350156e43e010"}
Sep 08 00:27:29.187635 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.187612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd" event={"ID":"6961abd4-642b-4352-a1d1-36681da81b51","Type":"ContainerStarted","Data":"a2261e5155c05dea8d2fafe2c700f974937b5b1b15a637b5f218b1b1f7414bdc"}
Sep 08 00:27:29.187750 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.187655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd" event={"ID":"6961abd4-642b-4352-a1d1-36681da81b51","Type":"ContainerStarted","Data":"e691ec6cf364afc972fb4b80359ee8a5a115f4c45cc98f0952ff9cce4c7d8826"}
Sep 08 00:27:29.187867 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.187848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:29.200310 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.200258    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8" podStartSLOduration=2.200244404 podStartE2EDuration="2.200244404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:27:29.198689899 +0000 UTC m=+1489.684118512" watchObservedRunningTime="2026-09-08 00:27:29.200244404 +0000 UTC m=+1489.685673062"
Sep 08 00:27:29.213327 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:29.213281    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd" podStartSLOduration=2.213266069 podStartE2EDuration="2.213266069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:27:29.211608229 +0000 UTC m=+1489.697036859" watchObservedRunningTime="2026-09-08 00:27:29.213266069 +0000 UTC m=+1489.698694677"
Sep 08 00:27:33.906782 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:33.906746    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:40.194853 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:40.194816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:27:40.195220 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:40.194939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:27:42.475021 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:42.474982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:48.872182 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:48.872142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:50.921879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:50.921842    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:51.357404 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:51.357314    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:51.630969 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:51.630887    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:51.817503 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:51.817470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:54.191292 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:54.191246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:54.289402 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:54.289335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:55.426192 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.426157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:55.526787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.526750    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:55.851496 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.851416    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:55.949395 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.949337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:55.976429 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.976394    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"]
Sep 08 00:27:55.980147 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.980127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:55.982106 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.982083    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5d0042\""
Sep 08 00:27:55.982226 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.982084    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-5d0042-dockercfg-v5hzs\""
Sep 08 00:27:55.993768 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:55.993733    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"]
Sep 08 00:27:56.016565 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.016532    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"]
Sep 08 00:27:56.020107 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.020088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.031722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.031700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"]
Sep 08 00:27:56.033908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.033886    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:27:56.086381 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.086331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91387e87-b9db-4389-8970-4f03ff4c8488-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:56.086542 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.086386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvhhb\" (UniqueName: \"kubernetes.io/projected/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-kube-api-access-rvhhb\") pod \"payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.086613 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.086535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.086671 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.086636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sjq4\" (UniqueName: \"kubernetes.io/projected/91387e87-b9db-4389-8970-4f03ff4c8488-kube-api-access-7sjq4\") pod \"payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:56.188097 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.188065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sjq4\" (UniqueName: \"kubernetes.io/projected/91387e87-b9db-4389-8970-4f03ff4c8488-kube-api-access-7sjq4\") pod \"payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:56.188279 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.188110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91387e87-b9db-4389-8970-4f03ff4c8488-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:56.188279 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.188130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvhhb\" (UniqueName: \"kubernetes.io/projected/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-kube-api-access-rvhhb\") pod \"payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.188405 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.188328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.188937 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.188918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91387e87-b9db-4389-8970-4f03ff4c8488-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:56.189035 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.189016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.195186 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.195156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sjq4\" (UniqueName: \"kubernetes.io/projected/91387e87-b9db-4389-8970-4f03ff4c8488-kube-api-access-7sjq4\") pod \"payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:56.195385 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.195364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvhhb\" (UniqueName: \"kubernetes.io/projected/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-kube-api-access-rvhhb\") pod \"payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.290754 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.290720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:56.332029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.331994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:56.565542 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.565515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"]
Sep 08 00:27:56.567869 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:27:56.567838    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91387e87_b9db_4389_8970_4f03ff4c8488.slice/crio-10d24a167c48afc34c056dd85f0c6558a020b1841d535c5885f634bbca5645e0 WatchSource:0}: Error finding container 10d24a167c48afc34c056dd85f0c6558a020b1841d535c5885f634bbca5645e0: Status 404 returned error can't find the container with id 10d24a167c48afc34c056dd85f0c6558a020b1841d535c5885f634bbca5645e0
Sep 08 00:27:56.613531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:56.613504    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"]
Sep 08 00:27:56.623744 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:27:56.623715    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35247b69_2f9d_4c7a_b4c8_6b8aafe539c3.slice/crio-2cc7f40b36c0ca9fb4e7f0b18f2aab5a61d01a78dd89f31a11ab4c96ca55e56a WatchSource:0}: Error finding container 2cc7f40b36c0ca9fb4e7f0b18f2aab5a61d01a78dd89f31a11ab4c96ca55e56a: Status 404 returned error can't find the container with id 2cc7f40b36c0ca9fb4e7f0b18f2aab5a61d01a78dd89f31a11ab4c96ca55e56a
Sep 08 00:27:57.335027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.334991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw" event={"ID":"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3","Type":"ContainerStarted","Data":"e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6"}
Sep 08 00:27:57.335207 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.335044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw" event={"ID":"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3","Type":"ContainerStarted","Data":"2cc7f40b36c0ca9fb4e7f0b18f2aab5a61d01a78dd89f31a11ab4c96ca55e56a"}
Sep 08 00:27:57.335207 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.335183    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:27:57.336807 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.336777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v" event={"ID":"91387e87-b9db-4389-8970-4f03ff4c8488","Type":"ContainerStarted","Data":"49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5"}
Sep 08 00:27:57.336937 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.336826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v" event={"ID":"91387e87-b9db-4389-8970-4f03ff4c8488","Type":"ContainerStarted","Data":"10d24a167c48afc34c056dd85f0c6558a020b1841d535c5885f634bbca5645e0"}
Sep 08 00:27:57.336937 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.336857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:27:57.352195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.352146    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw" podStartSLOduration=2.352129158 podStartE2EDuration="2.352129158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:27:57.34942339 +0000 UTC m=+1517.834852002" watchObservedRunningTime="2026-09-08 00:27:57.352129158 +0000 UTC m=+1517.837557761"
Sep 08 00:27:57.364076 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:27:57.364030    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v" podStartSLOduration=2.364015774 podStartE2EDuration="2.364015774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:27:57.362522883 +0000 UTC m=+1517.847951490" watchObservedRunningTime="2026-09-08 00:27:57.364015774 +0000 UTC m=+1517.849444385"
Sep 08 00:28:08.344404 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:08.344296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:28:08.344404 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:08.344395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:28:08.620370 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:08.620259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:11.056339 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:11.056299    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:16.270141 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:16.270102    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:19.077688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:19.077653    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:21.856027 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:21.855990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:25.601958 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:25.601912    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:26.576902 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:26.576863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:33.713999 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:33.713962    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:35.752127 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:35.752091    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:36.288272 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:36.288233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:37.216741 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.216709    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:37.286762 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.286728    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"]
Sep 08 00:28:37.286973 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.286947    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8" podUID="8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" containerName="payload-processing" containerID="cri-o://1c7c5223884b83000a767097df64133e870e8f54543622b41b897216b6205e50" gracePeriod=30
Sep 08 00:28:37.306487 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.306454    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"]
Sep 08 00:28:37.306659 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.306639    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd" podUID="6961abd4-642b-4352-a1d1-36681da81b51" containerName="payload-pre-processing" containerID="cri-o://a2261e5155c05dea8d2fafe2c700f974937b5b1b15a637b5f218b1b1f7414bdc" gracePeriod=30
Sep 08 00:28:37.344949 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.344908    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:37.448304 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.448267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:37.502478 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.502446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:37.551826 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.551736    2580 generic.go:356] "Generic (PLEG): container finished" podID="6961abd4-642b-4352-a1d1-36681da81b51" containerID="a2261e5155c05dea8d2fafe2c700f974937b5b1b15a637b5f218b1b1f7414bdc" exitCode=0
Sep 08 00:28:37.551992 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.551858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd" event={"ID":"6961abd4-642b-4352-a1d1-36681da81b51","Type":"ContainerDied","Data":"a2261e5155c05dea8d2fafe2c700f974937b5b1b15a637b5f218b1b1f7414bdc"}
Sep 08 00:28:37.557217 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.557183    2580 generic.go:356] "Generic (PLEG): container finished" podID="8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" containerID="1c7c5223884b83000a767097df64133e870e8f54543622b41b897216b6205e50" exitCode=0
Sep 08 00:28:37.557393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.557321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8" event={"ID":"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c","Type":"ContainerDied","Data":"1c7c5223884b83000a767097df64133e870e8f54543622b41b897216b6205e50"}
Sep 08 00:28:37.581131 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.581106    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:28:37.583884 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.583863    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:28:37.673107 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673064    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6961abd4-642b-4352-a1d1-36681da81b51-plugins-config-volume\") pod \"6961abd4-642b-4352-a1d1-36681da81b51\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") "
Sep 08 00:28:37.673284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673124    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r65x9\" (UniqueName: \"kubernetes.io/projected/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-kube-api-access-r65x9\") pod \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") "
Sep 08 00:28:37.673284 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673229    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-plugins-config-volume\") pod \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\" (UID: \"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c\") "
Sep 08 00:28:37.673393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zchjb\" (UniqueName: \"kubernetes.io/projected/6961abd4-642b-4352-a1d1-36681da81b51-kube-api-access-zchjb\") pod \"6961abd4-642b-4352-a1d1-36681da81b51\" (UID: \"6961abd4-642b-4352-a1d1-36681da81b51\") "
Sep 08 00:28:37.673579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673551    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6961abd4-642b-4352-a1d1-36681da81b51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6961abd4-642b-4352-a1d1-36681da81b51" (UID: "6961abd4-642b-4352-a1d1-36681da81b51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:28:37.673651 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673598    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" (UID: "8a1571c5-4cef-4fbe-a3ac-d19a69792b7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:28:37.673706 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673685    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:28:37.673706 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.673701    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6961abd4-642b-4352-a1d1-36681da81b51-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:28:37.675300 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.675271    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6961abd4-642b-4352-a1d1-36681da81b51-kube-api-access-zchjb" (OuterVolumeSpecName: "kube-api-access-zchjb") pod "6961abd4-642b-4352-a1d1-36681da81b51" (UID: "6961abd4-642b-4352-a1d1-36681da81b51"). InnerVolumeSpecName "kube-api-access-zchjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:37.675444 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.675280    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-kube-api-access-r65x9" (OuterVolumeSpecName: "kube-api-access-r65x9") pod "8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" (UID: "8a1571c5-4cef-4fbe-a3ac-d19a69792b7c"). InnerVolumeSpecName "kube-api-access-r65x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:37.774957 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.774871    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r65x9\" (UniqueName: \"kubernetes.io/projected/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c-kube-api-access-r65x9\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:28:37.774957 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.774900    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zchjb\" (UniqueName: \"kubernetes.io/projected/6961abd4-642b-4352-a1d1-36681da81b51-kube-api-access-zchjb\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:28:37.803727 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:37.803696    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:38.564107 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.564072    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"
Sep 08 00:28:38.564589 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.564075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd" event={"ID":"6961abd4-642b-4352-a1d1-36681da81b51","Type":"ContainerDied","Data":"e691ec6cf364afc972fb4b80359ee8a5a115f4c45cc98f0952ff9cce4c7d8826"}
Sep 08 00:28:38.564589 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.564223    2580 scope.go:117] "RemoveContainer" containerID="a2261e5155c05dea8d2fafe2c700f974937b5b1b15a637b5f218b1b1f7414bdc"
Sep 08 00:28:38.565775 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.565710    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"
Sep 08 00:28:38.565775 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.565711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8" event={"ID":"8a1571c5-4cef-4fbe-a3ac-d19a69792b7c","Type":"ContainerDied","Data":"d91c4bb9e78c9de7dd9dded83d730c5c04f92654f13f3ebde20350156e43e010"}
Sep 08 00:28:38.574592 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.574572    2580 scope.go:117] "RemoveContainer" containerID="1c7c5223884b83000a767097df64133e870e8f54543622b41b897216b6205e50"
Sep 08 00:28:38.580964 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.580940    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"]
Sep 08 00:28:38.586245 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.586219    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-93c8ee-5976fb477-q6nk8"]
Sep 08 00:28:38.595451 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.595426    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"]
Sep 08 00:28:38.599325 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:38.599302    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-93c8ee-9f8687c46-654rd"]
Sep 08 00:28:39.929105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:39.929072    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6961abd4-642b-4352-a1d1-36681da81b51" path="/var/lib/kubelet/pods/6961abd4-642b-4352-a1d1-36681da81b51/volumes"
Sep 08 00:28:39.929496 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:39.929446    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" path="/var/lib/kubelet/pods/8a1571c5-4cef-4fbe-a3ac-d19a69792b7c/volumes"
Sep 08 00:28:40.128694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:40.128660    2580 scope.go:117] "RemoveContainer" containerID="2f422d216d7b17fd4319ee6522a54fb5ed8ddb20fcc932085f6036bb49e7e9a7"
Sep 08 00:28:40.137319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:40.137302    2580 scope.go:117] "RemoveContainer" containerID="2ce4a0e28d5746792c2d90b79d0fc2ffc83f28802ad551f1f36b0039dc2ad146"
Sep 08 00:28:43.727936 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:43.727893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:43.828421 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:43.828385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:43.974548 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:43.974496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:44.424597 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:44.424561    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:58.738664 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:58.738629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:59.787489 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.787458    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:59.816393 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.816340    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"]
Sep 08 00:28:59.816603 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.816572    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw" podUID="35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" containerName="payload-processing" containerID="cri-o://e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6" gracePeriod=30
Sep 08 00:28:59.823298 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.823275    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"]
Sep 08 00:28:59.823540 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.823513    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v" podUID="91387e87-b9db-4389-8970-4f03ff4c8488" containerName="payload-pre-processing" containerID="cri-o://49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5" gracePeriod=30
Sep 08 00:28:59.854153 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.854127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:59.909839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.909780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:28:59.974545 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:28:59.974511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:00.035242 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.035202    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:00.093992 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.093965    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:29:00.097149 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.097129    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:29:00.195701 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.195661    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvhhb\" (UniqueName: \"kubernetes.io/projected/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-kube-api-access-rvhhb\") pod \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") "
Sep 08 00:29:00.195874 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.195773    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sjq4\" (UniqueName: \"kubernetes.io/projected/91387e87-b9db-4389-8970-4f03ff4c8488-kube-api-access-7sjq4\") pod \"91387e87-b9db-4389-8970-4f03ff4c8488\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") "
Sep 08 00:29:00.195874 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.195834    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91387e87-b9db-4389-8970-4f03ff4c8488-plugins-config-volume\") pod \"91387e87-b9db-4389-8970-4f03ff4c8488\" (UID: \"91387e87-b9db-4389-8970-4f03ff4c8488\") "
Sep 08 00:29:00.195955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.195871    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-plugins-config-volume\") pod \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\" (UID: \"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3\") "
Sep 08 00:29:00.196236 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.196202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" (UID: "35247b69-2f9d-4c7a-b4c8-6b8aafe539c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:00.196394 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.196232    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91387e87-b9db-4389-8970-4f03ff4c8488-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91387e87-b9db-4389-8970-4f03ff4c8488" (UID: "91387e87-b9db-4389-8970-4f03ff4c8488"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:00.197858 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.197828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-kube-api-access-rvhhb" (OuterVolumeSpecName: "kube-api-access-rvhhb") pod "35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" (UID: "35247b69-2f9d-4c7a-b4c8-6b8aafe539c3"). InnerVolumeSpecName "kube-api-access-rvhhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:00.197858 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.197839    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91387e87-b9db-4389-8970-4f03ff4c8488-kube-api-access-7sjq4" (OuterVolumeSpecName: "kube-api-access-7sjq4") pod "91387e87-b9db-4389-8970-4f03ff4c8488" (UID: "91387e87-b9db-4389-8970-4f03ff4c8488"). InnerVolumeSpecName "kube-api-access-7sjq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:00.297132 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.297101    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvhhb\" (UniqueName: \"kubernetes.io/projected/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-kube-api-access-rvhhb\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:00.297132 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.297129    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sjq4\" (UniqueName: \"kubernetes.io/projected/91387e87-b9db-4389-8970-4f03ff4c8488-kube-api-access-7sjq4\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:00.297132 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.297139    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91387e87-b9db-4389-8970-4f03ff4c8488-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:00.297386 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.297149    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:00.345614 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.345543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:00.680935 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.680899    2580 generic.go:356] "Generic (PLEG): container finished" podID="91387e87-b9db-4389-8970-4f03ff4c8488" containerID="49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5" exitCode=0
Sep 08 00:29:00.681086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.680948    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"
Sep 08 00:29:00.681086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.680987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v" event={"ID":"91387e87-b9db-4389-8970-4f03ff4c8488","Type":"ContainerDied","Data":"49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5"}
Sep 08 00:29:00.681086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.681044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v" event={"ID":"91387e87-b9db-4389-8970-4f03ff4c8488","Type":"ContainerDied","Data":"10d24a167c48afc34c056dd85f0c6558a020b1841d535c5885f634bbca5645e0"}
Sep 08 00:29:00.681086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.681074    2580 scope.go:117] "RemoveContainer" containerID="49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5"
Sep 08 00:29:00.686525 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.686496    2580 generic.go:356] "Generic (PLEG): container finished" podID="35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" containerID="e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6" exitCode=0
Sep 08 00:29:00.686662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.686547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw" event={"ID":"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3","Type":"ContainerDied","Data":"e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6"}
Sep 08 00:29:00.686662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.686588    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"
Sep 08 00:29:00.686662 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.686596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw" event={"ID":"35247b69-2f9d-4c7a-b4c8-6b8aafe539c3","Type":"ContainerDied","Data":"2cc7f40b36c0ca9fb4e7f0b18f2aab5a61d01a78dd89f31a11ab4c96ca55e56a"}
Sep 08 00:29:00.692835 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.692819    2580 scope.go:117] "RemoveContainer" containerID="49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5"
Sep 08 00:29:00.693186 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:29:00.693167    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5\": container with ID starting with 49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5 not found: ID does not exist" containerID="49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5"
Sep 08 00:29:00.693243 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.693194    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5"} err="failed to get container status \"49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5\": rpc error: code = NotFound desc = could not find container \"49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5\": container with ID starting with 49fdf2750ffee4ca4133b37e73fe4e14fef41467aaedbeddc4796cc720ea09d5 not found: ID does not exist"
Sep 08 00:29:00.693243 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.693209    2580 scope.go:117] "RemoveContainer" containerID="e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6"
Sep 08 00:29:00.710536 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.703721    2580 scope.go:117] "RemoveContainer" containerID="e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6"
Sep 08 00:29:00.710536 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:29:00.704660    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6\": container with ID starting with e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6 not found: ID does not exist" containerID="e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6"
Sep 08 00:29:00.710536 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.704703    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6"} err="failed to get container status \"e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6\": rpc error: code = NotFound desc = could not find container \"e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6\": container with ID starting with e8b59dfc8b31b6902941894c3f35d89b1fe1b10846a8de4136ac840f73faa8c6 not found: ID does not exist"
Sep 08 00:29:00.710536 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.704753    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"]
Sep 08 00:29:00.710536 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.708562    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5d0042-b59fb6bc8-6874v"]
Sep 08 00:29:00.715388 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.715362    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"]
Sep 08 00:29:00.718787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:00.718761    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5d0042-9b784f6d7-nvffw"]
Sep 08 00:29:01.679977 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:01.679944    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:01.928483 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:01.928454    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" path="/var/lib/kubelet/pods/35247b69-2f9d-4c7a-b4c8-6b8aafe539c3/volumes"
Sep 08 00:29:01.928828 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:01.928815    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91387e87-b9db-4389-8970-4f03ff4c8488" path="/var/lib/kubelet/pods/91387e87-b9db-4389-8970-4f03ff4c8488/volumes"
Sep 08 00:29:06.079080 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.079043    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:06.146031 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.145998    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:06.324533 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.324497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:06.632877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.632841    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"]
Sep 08 00:29:06.633321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633307    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" containerName="payload-processing"
Sep 08 00:29:06.633392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633323    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" containerName="payload-processing"
Sep 08 00:29:06.633392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633336    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91387e87-b9db-4389-8970-4f03ff4c8488" containerName="payload-pre-processing"
Sep 08 00:29:06.633392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633355    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="91387e87-b9db-4389-8970-4f03ff4c8488" containerName="payload-pre-processing"
Sep 08 00:29:06.633392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633367    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6961abd4-642b-4352-a1d1-36681da81b51" containerName="payload-pre-processing"
Sep 08 00:29:06.633392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633373    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6961abd4-642b-4352-a1d1-36681da81b51" containerName="payload-pre-processing"
Sep 08 00:29:06.633392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633382    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" containerName="payload-processing"
Sep 08 00:29:06.633392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633387    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" containerName="payload-processing"
Sep 08 00:29:06.633612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633462    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6961abd4-642b-4352-a1d1-36681da81b51" containerName="payload-pre-processing"
Sep 08 00:29:06.633612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633470    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1571c5-4cef-4fbe-a3ac-d19a69792b7c" containerName="payload-processing"
Sep 08 00:29:06.633612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633483    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35247b69-2f9d-4c7a-b4c8-6b8aafe539c3" containerName="payload-processing"
Sep 08 00:29:06.633612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.633489    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="91387e87-b9db-4389-8970-4f03ff4c8488" containerName="payload-pre-processing"
Sep 08 00:29:06.638177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.638158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"
Sep 08 00:29:06.640153 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.640131    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:29:06.642087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.642060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"]
Sep 08 00:29:06.654842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.654812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8dd957-a27c-44e2-bbed-6fbe4f8626d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj\" (UID: \"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"
Sep 08 00:29:06.755879 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.755842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8dd957-a27c-44e2-bbed-6fbe4f8626d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj\" (UID: \"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"
Sep 08 00:29:06.756588 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.756565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8dd957-a27c-44e2-bbed-6fbe4f8626d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj\" (UID: \"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"
Sep 08 00:29:06.757234 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.757208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:06.951460 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:06.951424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"
Sep 08 00:29:07.220388 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:07.220216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"]
Sep 08 00:29:07.223300 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:29:07.223265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8dd957_a27c_44e2_bbed_6fbe4f8626d6.slice/crio-e030efcb8f565ca1c0e42ecf10bd374e103f98b33c59ec84468f93b17723f21f WatchSource:0}: Error finding container e030efcb8f565ca1c0e42ecf10bd374e103f98b33c59ec84468f93b17723f21f: Status 404 returned error can't find the container with id e030efcb8f565ca1c0e42ecf10bd374e103f98b33c59ec84468f93b17723f21f
Sep 08 00:29:07.726901 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:07.726864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj" event={"ID":"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6","Type":"ContainerStarted","Data":"0b146a11af811d1215641c2ef2659f2abd842fb408becb96d0ff7a66ee5c1da9"}
Sep 08 00:29:07.727074 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:07.726991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj" event={"ID":"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6","Type":"ContainerStarted","Data":"e030efcb8f565ca1c0e42ecf10bd374e103f98b33c59ec84468f93b17723f21f"}
Sep 08 00:29:07.741625 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:07.741527    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj" podStartSLOduration=1.7415111589999999 podStartE2EDuration="1.741511159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:29:07.739990791 +0000 UTC m=+1588.225419400" watchObservedRunningTime="2026-09-08 00:29:07.741511159 +0000 UTC m=+1588.226939767"
Sep 08 00:29:08.734360 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:08.734315    2580 generic.go:356] "Generic (PLEG): container finished" podID="8c8dd957-a27c-44e2-bbed-6fbe4f8626d6" containerID="0b146a11af811d1215641c2ef2659f2abd842fb408becb96d0ff7a66ee5c1da9" exitCode=0
Sep 08 00:29:08.734802 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:08.734407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj" event={"ID":"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6","Type":"ContainerDied","Data":"0b146a11af811d1215641c2ef2659f2abd842fb408becb96d0ff7a66ee5c1da9"}
Sep 08 00:29:09.872823 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:09.872800    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"
Sep 08 00:29:09.878519 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:09.878498    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8dd957-a27c-44e2-bbed-6fbe4f8626d6-maas-api-service-ca\") pod \"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6\" (UID: \"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6\") "
Sep 08 00:29:09.878817 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:09.878797    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c8dd957-a27c-44e2-bbed-6fbe4f8626d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c8dd957-a27c-44e2-bbed-6fbe4f8626d6" (UID: "8c8dd957-a27c-44e2-bbed-6fbe4f8626d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:09.979775 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:09.979735    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8dd957-a27c-44e2-bbed-6fbe4f8626d6-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:10.747105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:10.747079    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"
Sep 08 00:29:10.747290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:10.747069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj" event={"ID":"8c8dd957-a27c-44e2-bbed-6fbe4f8626d6","Type":"ContainerDied","Data":"e030efcb8f565ca1c0e42ecf10bd374e103f98b33c59ec84468f93b17723f21f"}
Sep 08 00:29:10.747290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:10.747202    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e030efcb8f565ca1c0e42ecf10bd374e103f98b33c59ec84468f93b17723f21f"
Sep 08 00:29:17.064453 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.064412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:17.085296 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.085266    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"]
Sep 08 00:29:17.085547 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.085521    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr" podUID="0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" containerName="payload-processing" containerID="cri-o://11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a" gracePeriod=30
Sep 08 00:29:17.165515 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.165478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:17.237216 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.237179    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"]
Sep 08 00:29:17.241602 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.241572    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-c6a703-lcxtj"]
Sep 08 00:29:17.316422 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.316303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:17.341613 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.341592    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:29:17.371356 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.371323    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:17.449081 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.449053    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b6kp\" (UniqueName: \"kubernetes.io/projected/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-kube-api-access-9b6kp\") pod \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") "
Sep 08 00:29:17.449195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.449096    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-plugins-config-volume\") pod \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\" (UID: \"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0\") "
Sep 08 00:29:17.449520 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.449500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" (UID: "0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:17.451095 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.451069    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-kube-api-access-9b6kp" (OuterVolumeSpecName: "kube-api-access-9b6kp") pod "0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" (UID: "0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0"). InnerVolumeSpecName "kube-api-access-9b6kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:17.549916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.549883    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b6kp\" (UniqueName: \"kubernetes.io/projected/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-kube-api-access-9b6kp\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:17.549916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.549909    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:17.590861 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.590763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:17.786287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.786246    2580 generic.go:356] "Generic (PLEG): container finished" podID="0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" containerID="11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a" exitCode=0
Sep 08 00:29:17.786479 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.786297    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"
Sep 08 00:29:17.786479 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.786336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr" event={"ID":"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0","Type":"ContainerDied","Data":"11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a"}
Sep 08 00:29:17.786479 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.786440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr" event={"ID":"0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0","Type":"ContainerDied","Data":"2d491032b5d0632632455c06b1457d8f30a605871f7c28dabfb499632950adf6"}
Sep 08 00:29:17.786479 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.786465    2580 scope.go:117] "RemoveContainer" containerID="11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a"
Sep 08 00:29:17.797906 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.797883    2580 scope.go:117] "RemoveContainer" containerID="11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a"
Sep 08 00:29:17.798391 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:29:17.798365    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a\": container with ID starting with 11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a not found: ID does not exist" containerID="11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a"
Sep 08 00:29:17.798491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.798398    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a"} err="failed to get container status \"11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a\": rpc error: code = NotFound desc = could not find container \"11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a\": container with ID starting with 11ca6de462a48b32f58c3b4d54beb8e8ced05aad64436fdc35f92f384489658a not found: ID does not exist"
Sep 08 00:29:17.806787 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.806768    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"]
Sep 08 00:29:17.810272 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.810253    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c6a703-747b69c865-4plxr"]
Sep 08 00:29:17.927088 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.927061    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" path="/var/lib/kubelet/pods/0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0/volumes"
Sep 08 00:29:17.927411 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:17.927396    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c8dd957-a27c-44e2-bbed-6fbe4f8626d6" path="/var/lib/kubelet/pods/8c8dd957-a27c-44e2-bbed-6fbe4f8626d6/volumes"
Sep 08 00:29:23.127774 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.127732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:23.184202 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.184167    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:23.374157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.374126    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:23.727514 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.727480    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"]
Sep 08 00:29:23.727960 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.727946    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" containerName="payload-processing"
Sep 08 00:29:23.728002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.727965    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" containerName="payload-processing"
Sep 08 00:29:23.728002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.727990    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8dd957-a27c-44e2-bbed-6fbe4f8626d6" containerName="revoke-keys"
Sep 08 00:29:23.728002 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.727995    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8dd957-a27c-44e2-bbed-6fbe4f8626d6" containerName="revoke-keys"
Sep 08 00:29:23.728110 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.728070    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd8dc4b-2fb3-4de3-bbd7-10c5bba7dec0" containerName="payload-processing"
Sep 08 00:29:23.728110 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.728079    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c8dd957-a27c-44e2-bbed-6fbe4f8626d6" containerName="revoke-keys"
Sep 08 00:29:23.732557 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.732539    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"
Sep 08 00:29:23.735008 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.734981    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:29:23.737498 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.737476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"]
Sep 08 00:29:23.803846 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.803810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50a5700e-fd28-4185-add2-950f935c3cb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5\" (UID: \"50a5700e-fd28-4185-add2-950f935c3cb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"
Sep 08 00:29:23.904632 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.904594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50a5700e-fd28-4185-add2-950f935c3cb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5\" (UID: \"50a5700e-fd28-4185-add2-950f935c3cb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"
Sep 08 00:29:23.905282 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:23.905262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50a5700e-fd28-4185-add2-950f935c3cb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5\" (UID: \"50a5700e-fd28-4185-add2-950f935c3cb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"
Sep 08 00:29:24.045609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:24.045526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"
Sep 08 00:29:24.051930 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:24.051879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:24.316740 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:24.316661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"]
Sep 08 00:29:24.321008 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:29:24.320973    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a5700e_fd28_4185_add2_950f935c3cb3.slice/crio-0890cb08dae4b99c0dd362e08618db6eabf73b35189dd1c683235ba2470e5e56 WatchSource:0}: Error finding container 0890cb08dae4b99c0dd362e08618db6eabf73b35189dd1c683235ba2470e5e56: Status 404 returned error can't find the container with id 0890cb08dae4b99c0dd362e08618db6eabf73b35189dd1c683235ba2470e5e56
Sep 08 00:29:24.826014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:24.825964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5" event={"ID":"50a5700e-fd28-4185-add2-950f935c3cb3","Type":"ContainerStarted","Data":"f2bedf4725ecfbc6b1966d7307c51d26ee9634491dd1a9fb82f2c8e95f06f233"}
Sep 08 00:29:24.826204 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:24.826035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5" event={"ID":"50a5700e-fd28-4185-add2-950f935c3cb3","Type":"ContainerStarted","Data":"0890cb08dae4b99c0dd362e08618db6eabf73b35189dd1c683235ba2470e5e56"}
Sep 08 00:29:24.838252 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:24.837648    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5" podStartSLOduration=1.837625896 podStartE2EDuration="1.837625896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:29:24.837401753 +0000 UTC m=+1605.322830362" watchObservedRunningTime="2026-09-08 00:29:24.837625896 +0000 UTC m=+1605.323054505"
Sep 08 00:29:25.832661 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:25.832627    2580 generic.go:356] "Generic (PLEG): container finished" podID="50a5700e-fd28-4185-add2-950f935c3cb3" containerID="f2bedf4725ecfbc6b1966d7307c51d26ee9634491dd1a9fb82f2c8e95f06f233" exitCode=0
Sep 08 00:29:25.833069 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:25.832716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5" event={"ID":"50a5700e-fd28-4185-add2-950f935c3cb3","Type":"ContainerDied","Data":"f2bedf4725ecfbc6b1966d7307c51d26ee9634491dd1a9fb82f2c8e95f06f233"}
Sep 08 00:29:26.969991 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:26.969961    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"
Sep 08 00:29:27.031880 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:27.031849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50a5700e-fd28-4185-add2-950f935c3cb3-maas-api-service-ca\") pod \"50a5700e-fd28-4185-add2-950f935c3cb3\" (UID: \"50a5700e-fd28-4185-add2-950f935c3cb3\") "
Sep 08 00:29:27.032238 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:27.032213    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50a5700e-fd28-4185-add2-950f935c3cb3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50a5700e-fd28-4185-add2-950f935c3cb3" (UID: "50a5700e-fd28-4185-add2-950f935c3cb3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:27.135430 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:27.133691    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50a5700e-fd28-4185-add2-950f935c3cb3-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:27.844005 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:27.843974    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"
Sep 08 00:29:27.844206 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:27.844017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5" event={"ID":"50a5700e-fd28-4185-add2-950f935c3cb3","Type":"ContainerDied","Data":"0890cb08dae4b99c0dd362e08618db6eabf73b35189dd1c683235ba2470e5e56"}
Sep 08 00:29:27.844206 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:27.844105    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0890cb08dae4b99c0dd362e08618db6eabf73b35189dd1c683235ba2470e5e56"
Sep 08 00:29:34.267335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.267241    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:34.290479 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.290444    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"]
Sep 08 00:29:34.290714 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.290687    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w" podUID="39dd65e9-0783-4e11-9b7a-944ab15a728a" containerName="payload-processing" containerID="cri-o://78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002" gracePeriod=30
Sep 08 00:29:34.299179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.298812    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"]
Sep 08 00:29:34.299179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.299088    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw" podUID="ce723bf4-b8fd-411c-9676-d0edb8ca80bf" containerName="payload-pre-processing" containerID="cri-o://3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4" gracePeriod=30
Sep 08 00:29:34.442335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.442296    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"]
Sep 08 00:29:34.445416 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.445373    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-e1e91c-pfrz5"]
Sep 08 00:29:34.535262 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.535162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:34.567177 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.567153    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:29:34.584967 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.584938    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:29:34.606520 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.606483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:34.702408 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.702337    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-plugins-config-volume\") pod \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") "
Sep 08 00:29:34.702408 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.702416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvmgg\" (UniqueName: \"kubernetes.io/projected/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-kube-api-access-pvmgg\") pod \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\" (UID: \"ce723bf4-b8fd-411c-9676-d0edb8ca80bf\") "
Sep 08 00:29:34.702683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.702438    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x47qw\" (UniqueName: \"kubernetes.io/projected/39dd65e9-0783-4e11-9b7a-944ab15a728a-kube-api-access-x47qw\") pod \"39dd65e9-0783-4e11-9b7a-944ab15a728a\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") "
Sep 08 00:29:34.702683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.702456    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39dd65e9-0783-4e11-9b7a-944ab15a728a-plugins-config-volume\") pod \"39dd65e9-0783-4e11-9b7a-944ab15a728a\" (UID: \"39dd65e9-0783-4e11-9b7a-944ab15a728a\") "
Sep 08 00:29:34.702846 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.702818    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce723bf4-b8fd-411c-9676-d0edb8ca80bf" (UID: "ce723bf4-b8fd-411c-9676-d0edb8ca80bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:34.702946 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.702914    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39dd65e9-0783-4e11-9b7a-944ab15a728a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39dd65e9-0783-4e11-9b7a-944ab15a728a" (UID: "39dd65e9-0783-4e11-9b7a-944ab15a728a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:34.704791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.704766    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-kube-api-access-pvmgg" (OuterVolumeSpecName: "kube-api-access-pvmgg") pod "ce723bf4-b8fd-411c-9676-d0edb8ca80bf" (UID: "ce723bf4-b8fd-411c-9676-d0edb8ca80bf"). InnerVolumeSpecName "kube-api-access-pvmgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:34.704894 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.704799    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39dd65e9-0783-4e11-9b7a-944ab15a728a-kube-api-access-x47qw" (OuterVolumeSpecName: "kube-api-access-x47qw") pod "39dd65e9-0783-4e11-9b7a-944ab15a728a" (UID: "39dd65e9-0783-4e11-9b7a-944ab15a728a"). InnerVolumeSpecName "kube-api-access-x47qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:34.786677 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.786585    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:34.803875 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.803845    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:34.803875 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.803874    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvmgg\" (UniqueName: \"kubernetes.io/projected/ce723bf4-b8fd-411c-9676-d0edb8ca80bf-kube-api-access-pvmgg\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:34.804047 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.803884    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x47qw\" (UniqueName: \"kubernetes.io/projected/39dd65e9-0783-4e11-9b7a-944ab15a728a-kube-api-access-x47qw\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:34.804047 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.803893    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39dd65e9-0783-4e11-9b7a-944ab15a728a-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:29:34.880577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.880542    2580 generic.go:356] "Generic (PLEG): container finished" podID="39dd65e9-0783-4e11-9b7a-944ab15a728a" containerID="78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002" exitCode=0
Sep 08 00:29:34.880778 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.880604    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"
Sep 08 00:29:34.880778 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.880633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w" event={"ID":"39dd65e9-0783-4e11-9b7a-944ab15a728a","Type":"ContainerDied","Data":"78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002"}
Sep 08 00:29:34.880778 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.880686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w" event={"ID":"39dd65e9-0783-4e11-9b7a-944ab15a728a","Type":"ContainerDied","Data":"607cd2842b0b6c93f125119e677926f1c62bf66af15ddb97f4753cbb27d0f22d"}
Sep 08 00:29:34.880778 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.880713    2580 scope.go:117] "RemoveContainer" containerID="78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002"
Sep 08 00:29:34.882065 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.882042    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce723bf4-b8fd-411c-9676-d0edb8ca80bf" containerID="3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4" exitCode=0
Sep 08 00:29:34.882196 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.882107    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw" event={"ID":"ce723bf4-b8fd-411c-9676-d0edb8ca80bf","Type":"ContainerDied","Data":"3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4"}
Sep 08 00:29:34.882196 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.882144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw" event={"ID":"ce723bf4-b8fd-411c-9676-d0edb8ca80bf","Type":"ContainerDied","Data":"dfc9d091e4240b7c1ce8d5b8449dacc0d8d0595caf4def9a4b31f4462326dd94"}
Sep 08 00:29:34.882196 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.882159    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"
Sep 08 00:29:34.890274 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.890251    2580 scope.go:117] "RemoveContainer" containerID="78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002"
Sep 08 00:29:34.890596 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:29:34.890575    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002\": container with ID starting with 78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002 not found: ID does not exist" containerID="78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002"
Sep 08 00:29:34.890667 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.890604    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002"} err="failed to get container status \"78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002\": rpc error: code = NotFound desc = could not find container \"78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002\": container with ID starting with 78bedc72c2237646368c01f7efeb510aa1e9be679c4bdb2b787ab4b3622e0002 not found: ID does not exist"
Sep 08 00:29:34.890667 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.890622    2580 scope.go:117] "RemoveContainer" containerID="3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4"
Sep 08 00:29:34.898979 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.898960    2580 scope.go:117] "RemoveContainer" containerID="3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4"
Sep 08 00:29:34.899254 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:29:34.899239    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4\": container with ID starting with 3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4 not found: ID does not exist" containerID="3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4"
Sep 08 00:29:34.899305 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.899261    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4"} err="failed to get container status \"3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4\": rpc error: code = NotFound desc = could not find container \"3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4\": container with ID starting with 3440beb3a16bae285d34c4b545a3017494f25a213226a0073699d9113df7c5f4 not found: ID does not exist"
Sep 08 00:29:34.904028 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.904004    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"]
Sep 08 00:29:34.907851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.907829    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e1e91c-f5dcf4555-pgg9w"]
Sep 08 00:29:34.916647 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.916625    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"]
Sep 08 00:29:34.918319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:34.918297    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e1e91c-7c8458dfd6-mjlnw"]
Sep 08 00:29:35.927849 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:35.927812    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39dd65e9-0783-4e11-9b7a-944ab15a728a" path="/var/lib/kubelet/pods/39dd65e9-0783-4e11-9b7a-944ab15a728a/volumes"
Sep 08 00:29:35.928250 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:35.928143    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50a5700e-fd28-4185-add2-950f935c3cb3" path="/var/lib/kubelet/pods/50a5700e-fd28-4185-add2-950f935c3cb3/volumes"
Sep 08 00:29:35.928502 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:35.928487    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce723bf4-b8fd-411c-9676-d0edb8ca80bf" path="/var/lib/kubelet/pods/ce723bf4-b8fd-411c-9676-d0edb8ca80bf/volumes"
Sep 08 00:29:40.546539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:40.546444    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:40.648362 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:40.648313    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:40.777175 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:40.777133    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:58.175055 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:58.175023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:59.176427 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:59.176388    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:59.609273 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:59.609174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:29:59.894849 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:29:59.894770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:00.074339 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.074310    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:00.128010 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.127978    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"]
Sep 08 00:30:00.128380 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128367    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39dd65e9-0783-4e11-9b7a-944ab15a728a" containerName="payload-processing"
Sep 08 00:30:00.128380 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128381    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39dd65e9-0783-4e11-9b7a-944ab15a728a" containerName="payload-processing"
Sep 08 00:30:00.128477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128392    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a5700e-fd28-4185-add2-950f935c3cb3" containerName="revoke-keys"
Sep 08 00:30:00.128477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128398    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a5700e-fd28-4185-add2-950f935c3cb3" containerName="revoke-keys"
Sep 08 00:30:00.128477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128415    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce723bf4-b8fd-411c-9676-d0edb8ca80bf" containerName="payload-pre-processing"
Sep 08 00:30:00.128477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128430    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce723bf4-b8fd-411c-9676-d0edb8ca80bf" containerName="payload-pre-processing"
Sep 08 00:30:00.128612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128490    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="39dd65e9-0783-4e11-9b7a-944ab15a728a" containerName="payload-processing"
Sep 08 00:30:00.128612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128499    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50a5700e-fd28-4185-add2-950f935c3cb3" containerName="revoke-keys"
Sep 08 00:30:00.128612 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.128505    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce723bf4-b8fd-411c-9676-d0edb8ca80bf" containerName="payload-pre-processing"
Sep 08 00:30:00.131919 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.131898    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz"]
Sep 08 00:30:00.132032 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.132016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"
Sep 08 00:30:00.133810 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.133789    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:30:00.135275 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.135262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz"
Sep 08 00:30:00.138577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.138553    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"]
Sep 08 00:30:00.141774 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.141755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz"]
Sep 08 00:30:00.145625 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.145576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"
Sep 08 00:30:00.153024 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.153003    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz"
Sep 08 00:30:00.445067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.445036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"]
Sep 08 00:30:00.448205 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:30:00.448178    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96575612_cb7f_4d3d_9336_c0bdd804a935.slice/crio-3b3ad0dbea40a644b265de0be19d122f67d2dbcbd440729fc842fb22ab7753eb WatchSource:0}: Error finding container 3b3ad0dbea40a644b265de0be19d122f67d2dbcbd440729fc842fb22ab7753eb: Status 404 returned error can't find the container with id 3b3ad0dbea40a644b265de0be19d122f67d2dbcbd440729fc842fb22ab7753eb
Sep 08 00:30:00.465195 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:00.465173    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz"]
Sep 08 00:30:00.467245 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:30:00.467215    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2db476b_6ad0_4eb8_a6be_eeee47513ba0.slice/crio-8b52b5ed8b396a7d1a9f63c1d958e9b164f23a0113729d4ac66982a7a1c07b6a WatchSource:0}: Error finding container 8b52b5ed8b396a7d1a9f63c1d958e9b164f23a0113729d4ac66982a7a1c07b6a: Status 404 returned error can't find the container with id 8b52b5ed8b396a7d1a9f63c1d958e9b164f23a0113729d4ac66982a7a1c07b6a
Sep 08 00:30:01.022735 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:01.022699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz" event={"ID":"a2db476b-6ad0-4eb8-a6be-eeee47513ba0","Type":"ContainerStarted","Data":"98e707b94721eb1129d521f6bc6c506648999dc3039c6467ed939d628662290c"}
Sep 08 00:30:01.022939 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:01.022763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz" event={"ID":"a2db476b-6ad0-4eb8-a6be-eeee47513ba0","Type":"ContainerStarted","Data":"8b52b5ed8b396a7d1a9f63c1d958e9b164f23a0113729d4ac66982a7a1c07b6a"}
Sep 08 00:30:01.024413 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:01.024385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm" event={"ID":"96575612-cb7f-4d3d-9336-c0bdd804a935","Type":"ContainerStarted","Data":"99a8fdd9be47a11b7273c77604a48a5b0e972424ada4fbcf9da0e756c4716328"}
Sep 08 00:30:01.024539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:01.024435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm" event={"ID":"96575612-cb7f-4d3d-9336-c0bdd804a935","Type":"ContainerStarted","Data":"3b3ad0dbea40a644b265de0be19d122f67d2dbcbd440729fc842fb22ab7753eb"}
Sep 08 00:30:01.037909 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:01.037815    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz" podStartSLOduration=1.037800471 podStartE2EDuration="1.037800471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:01.035829617 +0000 UTC m=+1641.521258225" watchObservedRunningTime="2026-09-08 00:30:01.037800471 +0000 UTC m=+1641.523229079"
Sep 08 00:30:01.049578 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:01.049530    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm" podStartSLOduration=1.049515829 podStartE2EDuration="1.049515829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:01.047668591 +0000 UTC m=+1641.533097204" watchObservedRunningTime="2026-09-08 00:30:01.049515829 +0000 UTC m=+1641.534944437"
Sep 08 00:30:02.030796 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:02.030759    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2db476b-6ad0-4eb8-a6be-eeee47513ba0" containerID="98e707b94721eb1129d521f6bc6c506648999dc3039c6467ed939d628662290c" exitCode=0
Sep 08 00:30:02.031241 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:02.030846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz" event={"ID":"a2db476b-6ad0-4eb8-a6be-eeee47513ba0","Type":"ContainerDied","Data":"98e707b94721eb1129d521f6bc6c506648999dc3039c6467ed939d628662290c"}
Sep 08 00:30:02.032449 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:02.032419    2580 generic.go:356] "Generic (PLEG): container finished" podID="96575612-cb7f-4d3d-9336-c0bdd804a935" containerID="99a8fdd9be47a11b7273c77604a48a5b0e972424ada4fbcf9da0e756c4716328" exitCode=0
Sep 08 00:30:02.032582 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:02.032450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm" event={"ID":"96575612-cb7f-4d3d-9336-c0bdd804a935","Type":"ContainerDied","Data":"99a8fdd9be47a11b7273c77604a48a5b0e972424ada4fbcf9da0e756c4716328"}
Sep 08 00:30:03.112071 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:03.112023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:03.177050 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:03.177022    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"
Sep 08 00:30:03.217923 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:03.217897    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz"
Sep 08 00:30:03.459577 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:03.459546    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:04.043637 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.043607    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz"
Sep 08 00:30:04.043784 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.043634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813790-q8dsz" event={"ID":"a2db476b-6ad0-4eb8-a6be-eeee47513ba0","Type":"ContainerDied","Data":"8b52b5ed8b396a7d1a9f63c1d958e9b164f23a0113729d4ac66982a7a1c07b6a"}
Sep 08 00:30:04.043784 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.043682    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b52b5ed8b396a7d1a9f63c1d958e9b164f23a0113729d4ac66982a7a1c07b6a"
Sep 08 00:30:04.044976 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.044958    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"
Sep 08 00:30:04.045077 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.044954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm" event={"ID":"96575612-cb7f-4d3d-9336-c0bdd804a935","Type":"ContainerDied","Data":"3b3ad0dbea40a644b265de0be19d122f67d2dbcbd440729fc842fb22ab7753eb"}
Sep 08 00:30:04.045136 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.045096    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b3ad0dbea40a644b265de0be19d122f67d2dbcbd440729fc842fb22ab7753eb"
Sep 08 00:30:04.704220 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.704135    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:04.807665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.807625    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:04.896613 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.896575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:04.897108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.897087    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"]
Sep 08 00:30:04.897560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.897544    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96575612-cb7f-4d3d-9336-c0bdd804a935" containerName="cleanup"
Sep 08 00:30:04.897560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.897561    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="96575612-cb7f-4d3d-9336-c0bdd804a935" containerName="cleanup"
Sep 08 00:30:04.897665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.897572    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2db476b-6ad0-4eb8-a6be-eeee47513ba0" containerName="cleanup"
Sep 08 00:30:04.897665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.897577    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2db476b-6ad0-4eb8-a6be-eeee47513ba0" containerName="cleanup"
Sep 08 00:30:04.897665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.897633    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="96575612-cb7f-4d3d-9336-c0bdd804a935" containerName="cleanup"
Sep 08 00:30:04.897665 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.897646    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2db476b-6ad0-4eb8-a6be-eeee47513ba0" containerName="cleanup"
Sep 08 00:30:04.900891 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.900871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:04.902866 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.902844    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-8098ed\""
Sep 08 00:30:04.902866 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.902853    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-8098ed-dockercfg-nkr27\""
Sep 08 00:30:04.907869 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.907846    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"]
Sep 08 00:30:04.933039 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.933002    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"]
Sep 08 00:30:04.936654 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.936631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:04.946390 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.946365    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"]
Sep 08 00:30:04.965151 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.965066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:04.969254 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.969234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c87gx\" (UniqueName: \"kubernetes.io/projected/e6791f9c-66f0-4bbc-8798-e5dfba08e819-kube-api-access-c87gx\") pod \"payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:04.969356 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.969332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6791f9c-66f0-4bbc-8798-e5dfba08e819-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:04.969430 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.969398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpctx\" (UniqueName: \"kubernetes.io/projected/25a61ace-1428-4edf-a6ab-19366628f47e-kube-api-access-dpctx\") pod \"payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:04.969430 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:04.969420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a61ace-1428-4edf-a6ab-19366628f47e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:05.070110 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.070068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a61ace-1428-4edf-a6ab-19366628f47e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:05.070307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.070163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87gx\" (UniqueName: \"kubernetes.io/projected/e6791f9c-66f0-4bbc-8798-e5dfba08e819-kube-api-access-c87gx\") pod \"payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:05.070307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.070278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6791f9c-66f0-4bbc-8798-e5dfba08e819-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:05.070522 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.070323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpctx\" (UniqueName: \"kubernetes.io/projected/25a61ace-1428-4edf-a6ab-19366628f47e-kube-api-access-dpctx\") pod \"payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:05.070956 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.070931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a61ace-1428-4edf-a6ab-19366628f47e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:05.071061 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.071036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6791f9c-66f0-4bbc-8798-e5dfba08e819-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:05.077358 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.077315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87gx\" (UniqueName: \"kubernetes.io/projected/e6791f9c-66f0-4bbc-8798-e5dfba08e819-kube-api-access-c87gx\") pod \"payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:05.077492 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.077441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpctx\" (UniqueName: \"kubernetes.io/projected/25a61ace-1428-4edf-a6ab-19366628f47e-kube-api-access-dpctx\") pod \"payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:05.214155 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.214122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:05.248601 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.248569    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:05.486154 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.486129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"]
Sep 08 00:30:05.489236 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:30:05.489208    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a61ace_1428_4edf_a6ab_19366628f47e.slice/crio-657dff7e3cd3d025f20c92d78d5a3b3c1dd90cbc2854e35c900ad19d34bad201 WatchSource:0}: Error finding container 657dff7e3cd3d025f20c92d78d5a3b3c1dd90cbc2854e35c900ad19d34bad201: Status 404 returned error can't find the container with id 657dff7e3cd3d025f20c92d78d5a3b3c1dd90cbc2854e35c900ad19d34bad201
Sep 08 00:30:05.530519 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:05.530490    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"]
Sep 08 00:30:05.532289 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:30:05.532265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6791f9c_66f0_4bbc_8798_e5dfba08e819.slice/crio-fdcad11eab31c07ff70401c6719be1ab97a7e795b0dc6e4e908beebbb4c5763b WatchSource:0}: Error finding container fdcad11eab31c07ff70401c6719be1ab97a7e795b0dc6e4e908beebbb4c5763b: Status 404 returned error can't find the container with id fdcad11eab31c07ff70401c6719be1ab97a7e795b0dc6e4e908beebbb4c5763b
Sep 08 00:30:06.057785 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.057748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682" event={"ID":"e6791f9c-66f0-4bbc-8798-e5dfba08e819","Type":"ContainerStarted","Data":"c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2"}
Sep 08 00:30:06.058269 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.057808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682" event={"ID":"e6791f9c-66f0-4bbc-8798-e5dfba08e819","Type":"ContainerStarted","Data":"fdcad11eab31c07ff70401c6719be1ab97a7e795b0dc6e4e908beebbb4c5763b"}
Sep 08 00:30:06.058269 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.057840    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:06.059568 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.059533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2" event={"ID":"25a61ace-1428-4edf-a6ab-19366628f47e","Type":"ContainerStarted","Data":"c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5"}
Sep 08 00:30:06.059708 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.059572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2" event={"ID":"25a61ace-1428-4edf-a6ab-19366628f47e","Type":"ContainerStarted","Data":"657dff7e3cd3d025f20c92d78d5a3b3c1dd90cbc2854e35c900ad19d34bad201"}
Sep 08 00:30:06.059708 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.059602    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:06.071334 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.071279    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682" podStartSLOduration=2.071262126 podStartE2EDuration="2.071262126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:06.070615947 +0000 UTC m=+1646.556044555" watchObservedRunningTime="2026-09-08 00:30:06.071262126 +0000 UTC m=+1646.556690737"
Sep 08 00:30:06.084933 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:06.084891    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2" podStartSLOduration=2.084876752 podStartE2EDuration="2.084876752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:06.083117406 +0000 UTC m=+1646.568546015" watchObservedRunningTime="2026-09-08 00:30:06.084876752 +0000 UTC m=+1646.570305416"
Sep 08 00:30:17.067279 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:17.067243    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:30:17.067720 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:17.067389    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:30:28.101544 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:28.101510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:28.756411 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:28.756328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:29.074835 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:29.074737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:29.271846 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:29.271811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:32.366622 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:32.366575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:32.465814 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:32.465779    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:33.529678 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:33.529641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:33.648163 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:33.648117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:33.767822 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:33.767792    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:34.034748 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.034668    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:34.127721 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.127684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:30:34.177321 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.177284    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"]
Sep 08 00:30:34.181080 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.181058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.183014 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.182994    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-4d2f00\""
Sep 08 00:30:34.183138 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.183015    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-4d2f00-dockercfg-g8m4k\""
Sep 08 00:30:34.191157 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.191133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"]
Sep 08 00:30:34.338448 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.338337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcw9h\" (UniqueName: \"kubernetes.io/projected/394cf27b-4504-472c-b091-e514f4ec9989-kube-api-access-tcw9h\") pod \"payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.338623 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.338466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/394cf27b-4504-472c-b091-e514f4ec9989-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.439605 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.439565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcw9h\" (UniqueName: \"kubernetes.io/projected/394cf27b-4504-472c-b091-e514f4ec9989-kube-api-access-tcw9h\") pod \"payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.439805 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.439660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/394cf27b-4504-472c-b091-e514f4ec9989-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.440371 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.440331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/394cf27b-4504-472c-b091-e514f4ec9989-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.449863 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.449827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcw9h\" (UniqueName: \"kubernetes.io/projected/394cf27b-4504-472c-b091-e514f4ec9989-kube-api-access-tcw9h\") pod \"payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.492106 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.492068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:34.768381 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:34.768288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"]
Sep 08 00:30:34.770812 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:30:34.770782    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394cf27b_4504_472c_b091_e514f4ec9989.slice/crio-5328dc0ddea46c9fe94413a7dea5bf4e6bd800df677bb5979e70dd3c8a66944b WatchSource:0}: Error finding container 5328dc0ddea46c9fe94413a7dea5bf4e6bd800df677bb5979e70dd3c8a66944b: Status 404 returned error can't find the container with id 5328dc0ddea46c9fe94413a7dea5bf4e6bd800df677bb5979e70dd3c8a66944b
Sep 08 00:30:35.216748 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:35.216700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj" event={"ID":"394cf27b-4504-472c-b091-e514f4ec9989","Type":"ContainerStarted","Data":"a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1"}
Sep 08 00:30:35.216931 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:35.216760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj" event={"ID":"394cf27b-4504-472c-b091-e514f4ec9989","Type":"ContainerStarted","Data":"5328dc0ddea46c9fe94413a7dea5bf4e6bd800df677bb5979e70dd3c8a66944b"}
Sep 08 00:30:35.216931 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:35.216786    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:35.234192 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:35.234139    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj" podStartSLOduration=1.234122589 podStartE2EDuration="1.234122589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:30:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:35.232050992 +0000 UTC m=+1675.717479612" watchObservedRunningTime="2026-09-08 00:30:35.234122589 +0000 UTC m=+1675.719551199"
Sep 08 00:30:46.225207 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:46.225171    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:30:57.418086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:30:57.418049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:02.442938 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:02.442853    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5fvdg_ce919e3c-7796-4faa-81b8-578bdbba2dd4/payload-processing/0.log"
Sep 08 00:31:02.559102 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:02.559068    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj_394cf27b-4504-472c-b091-e514f4ec9989/payload-processing/0.log"
Sep 08 00:31:08.323529 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:08.323495    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:15.770610 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:15.770555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:37.332558 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:37.332525    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682_e6791f9c-66f0-4bbc-8798-e5dfba08e819/payload-processing/0.log"
Sep 08 00:31:37.454040 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:37.454011    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5fvdg_ce919e3c-7796-4faa-81b8-578bdbba2dd4/payload-processing/0.log"
Sep 08 00:31:37.565592 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:37.565565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj_394cf27b-4504-472c-b091-e514f4ec9989/payload-processing/0.log"
Sep 08 00:31:37.852776 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:37.852743    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:38.154580 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:38.154547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:38.812917 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:38.812884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:40.898576 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:40.898536    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:40.984020 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:40.983978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:42.094598 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.094558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:42.197554 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.197519    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:42.656409 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.656368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:42.751956 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.751914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:42.789062 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.789023    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"]
Sep 08 00:31:42.792514 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.792483    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:42.797135 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.797115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-3d0f11-dockercfg-6mjn5\""
Sep 08 00:31:42.797555 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.797540    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-3d0f11\""
Sep 08 00:31:42.804986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.804963    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"]
Sep 08 00:31:42.850403 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.850312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzx65\" (UniqueName: \"kubernetes.io/projected/256f782e-03ad-43ea-a571-546da094aad5-kube-api-access-hzx65\") pod \"payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:42.850581 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.850532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256f782e-03ad-43ea-a571-546da094aad5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:42.952108 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.951999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256f782e-03ad-43ea-a571-546da094aad5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:42.952301 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.952149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzx65\" (UniqueName: \"kubernetes.io/projected/256f782e-03ad-43ea-a571-546da094aad5-kube-api-access-hzx65\") pod \"payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:42.953323 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.953295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256f782e-03ad-43ea-a571-546da094aad5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:42.960095 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:42.960066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzx65\" (UniqueName: \"kubernetes.io/projected/256f782e-03ad-43ea-a571-546da094aad5-kube-api-access-hzx65\") pod \"payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:43.103666 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:43.103629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:43.375402 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:43.375376    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"]
Sep 08 00:31:43.377126 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:31:43.377095    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256f782e_03ad_43ea_a571_546da094aad5.slice/crio-871f588b55fb4c71f795f3a626fd9043d77fe877fc24b4c442ce8128e7291e00 WatchSource:0}: Error finding container 871f588b55fb4c71f795f3a626fd9043d77fe877fc24b4c442ce8128e7291e00: Status 404 returned error can't find the container with id 871f588b55fb4c71f795f3a626fd9043d77fe877fc24b4c442ce8128e7291e00
Sep 08 00:31:43.575688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:43.575634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7" event={"ID":"256f782e-03ad-43ea-a571-546da094aad5","Type":"ContainerStarted","Data":"9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c"}
Sep 08 00:31:43.575882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:43.575757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:31:43.575882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:43.575793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7" event={"ID":"256f782e-03ad-43ea-a571-546da094aad5","Type":"ContainerStarted","Data":"871f588b55fb4c71f795f3a626fd9043d77fe877fc24b4c442ce8128e7291e00"}
Sep 08 00:31:43.595614 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:43.595552    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7" podStartSLOduration=1.5955345699999999 podStartE2EDuration="1.59553457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:31:43.594738969 +0000 UTC m=+1744.080167578" watchObservedRunningTime="2026-09-08 00:31:43.59553457 +0000 UTC m=+1744.080963179"
Sep 08 00:31:53.956648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:53.956609    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:54.014778 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:54.014745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:54.395188 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:54.395093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:54.496012 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:54.495977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:31:54.583228 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:31:54.583194    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:32:05.891722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:05.891679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:06.572962 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.572924    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"]
Sep 08 00:32:06.576899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.576878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"
Sep 08 00:32:06.578821 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.578800    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:32:06.582830 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.582800    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"]
Sep 08 00:32:06.672480 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.672443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36aca3e2-29e1-45f4-9d6f-f770210c66d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx\" (UID: \"36aca3e2-29e1-45f4-9d6f-f770210c66d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"
Sep 08 00:32:06.773029 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.772988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36aca3e2-29e1-45f4-9d6f-f770210c66d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx\" (UID: \"36aca3e2-29e1-45f4-9d6f-f770210c66d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"
Sep 08 00:32:06.773633 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.773613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36aca3e2-29e1-45f4-9d6f-f770210c66d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx\" (UID: \"36aca3e2-29e1-45f4-9d6f-f770210c66d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"
Sep 08 00:32:06.891135 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:06.891050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"
Sep 08 00:32:07.162294 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:07.162265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"]
Sep 08 00:32:07.164731 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:32:07.164703    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36aca3e2_29e1_45f4_9d6f_f770210c66d7.slice/crio-5b39c98ff3024f1b3c797d008fd600b749b0fa74de46ba820a2a1cfbe33de43c WatchSource:0}: Error finding container 5b39c98ff3024f1b3c797d008fd600b749b0fa74de46ba820a2a1cfbe33de43c: Status 404 returned error can't find the container with id 5b39c98ff3024f1b3c797d008fd600b749b0fa74de46ba820a2a1cfbe33de43c
Sep 08 00:32:07.703098 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:07.703064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx" event={"ID":"36aca3e2-29e1-45f4-9d6f-f770210c66d7","Type":"ContainerStarted","Data":"ba43b60d8baf993ba00c168a91c7518d5bd9f1d038769149e790de4cf152d43f"}
Sep 08 00:32:07.703278 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:07.703118    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx" event={"ID":"36aca3e2-29e1-45f4-9d6f-f770210c66d7","Type":"ContainerStarted","Data":"5b39c98ff3024f1b3c797d008fd600b749b0fa74de46ba820a2a1cfbe33de43c"}
Sep 08 00:32:07.717560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:07.717514    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx" podStartSLOduration=1.7174986570000002 podStartE2EDuration="1.717498657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:32:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:32:07.716574417 +0000 UTC m=+1768.202003049" watchObservedRunningTime="2026-09-08 00:32:07.717498657 +0000 UTC m=+1768.202927302"
Sep 08 00:32:08.710054 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:08.710014    2580 generic.go:356] "Generic (PLEG): container finished" podID="36aca3e2-29e1-45f4-9d6f-f770210c66d7" containerID="ba43b60d8baf993ba00c168a91c7518d5bd9f1d038769149e790de4cf152d43f" exitCode=0
Sep 08 00:32:08.710467 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:08.710100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx" event={"ID":"36aca3e2-29e1-45f4-9d6f-f770210c66d7","Type":"ContainerDied","Data":"ba43b60d8baf993ba00c168a91c7518d5bd9f1d038769149e790de4cf152d43f"}
Sep 08 00:32:09.848122 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:09.848099    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"
Sep 08 00:32:10.004320 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:10.004235    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36aca3e2-29e1-45f4-9d6f-f770210c66d7-maas-api-service-ca\") pod \"36aca3e2-29e1-45f4-9d6f-f770210c66d7\" (UID: \"36aca3e2-29e1-45f4-9d6f-f770210c66d7\") "
Sep 08 00:32:10.004654 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:10.004625    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36aca3e2-29e1-45f4-9d6f-f770210c66d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36aca3e2-29e1-45f4-9d6f-f770210c66d7" (UID: "36aca3e2-29e1-45f4-9d6f-f770210c66d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:32:10.105050 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:10.105011    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36aca3e2-29e1-45f4-9d6f-f770210c66d7-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:10.722510 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:10.722473    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"
Sep 08 00:32:10.722510 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:10.722499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx" event={"ID":"36aca3e2-29e1-45f4-9d6f-f770210c66d7","Type":"ContainerDied","Data":"5b39c98ff3024f1b3c797d008fd600b749b0fa74de46ba820a2a1cfbe33de43c"}
Sep 08 00:32:10.722744 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:10.722550    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b39c98ff3024f1b3c797d008fd600b749b0fa74de46ba820a2a1cfbe33de43c"
Sep 08 00:32:12.819796 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:12.819762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:12.849183 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:12.849148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"]
Sep 08 00:32:12.849473 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:12.849439    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7" podUID="256f782e-03ad-43ea-a571-546da094aad5" containerName="payload-processing" containerID="cri-o://9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c" gracePeriod=30
Sep 08 00:32:12.920020 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:12.919991    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:13.021625 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.021578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:13.025719 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.025688    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"]
Sep 08 00:32:13.031883 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.031650    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3d0f11-5s4lx"]
Sep 08 00:32:13.097782 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.097755    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:13.100845 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.100821    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:32:13.235364 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.235326    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256f782e-03ad-43ea-a571-546da094aad5-plugins-config-volume\") pod \"256f782e-03ad-43ea-a571-546da094aad5\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") "
Sep 08 00:32:13.235563 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.235412    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzx65\" (UniqueName: \"kubernetes.io/projected/256f782e-03ad-43ea-a571-546da094aad5-kube-api-access-hzx65\") pod \"256f782e-03ad-43ea-a571-546da094aad5\" (UID: \"256f782e-03ad-43ea-a571-546da094aad5\") "
Sep 08 00:32:13.235694 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.235670    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/256f782e-03ad-43ea-a571-546da094aad5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "256f782e-03ad-43ea-a571-546da094aad5" (UID: "256f782e-03ad-43ea-a571-546da094aad5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:32:13.237557 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.237524    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256f782e-03ad-43ea-a571-546da094aad5-kube-api-access-hzx65" (OuterVolumeSpecName: "kube-api-access-hzx65") pod "256f782e-03ad-43ea-a571-546da094aad5" (UID: "256f782e-03ad-43ea-a571-546da094aad5"). InnerVolumeSpecName "kube-api-access-hzx65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:32:13.337009 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.336939    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256f782e-03ad-43ea-a571-546da094aad5-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:13.337009 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.336963    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzx65\" (UniqueName: \"kubernetes.io/projected/256f782e-03ad-43ea-a571-546da094aad5-kube-api-access-hzx65\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:13.403829 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.403799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:13.746258 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.746218    2580 generic.go:356] "Generic (PLEG): container finished" podID="256f782e-03ad-43ea-a571-546da094aad5" containerID="9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c" exitCode=0
Sep 08 00:32:13.746481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.746264    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"
Sep 08 00:32:13.746481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.746294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7" event={"ID":"256f782e-03ad-43ea-a571-546da094aad5","Type":"ContainerDied","Data":"9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c"}
Sep 08 00:32:13.746481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.746388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7" event={"ID":"256f782e-03ad-43ea-a571-546da094aad5","Type":"ContainerDied","Data":"871f588b55fb4c71f795f3a626fd9043d77fe877fc24b4c442ce8128e7291e00"}
Sep 08 00:32:13.746481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.746412    2580 scope.go:117] "RemoveContainer" containerID="9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c"
Sep 08 00:32:13.756298 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.756281    2580 scope.go:117] "RemoveContainer" containerID="9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c"
Sep 08 00:32:13.756587 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:32:13.756568    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c\": container with ID starting with 9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c not found: ID does not exist" containerID="9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c"
Sep 08 00:32:13.756640 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.756598    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c"} err="failed to get container status \"9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c\": rpc error: code = NotFound desc = could not find container \"9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c\": container with ID starting with 9a9373c1c117beeb93cda8b8804861d25bb0f07b0c849fb0f9f673ae633d286c not found: ID does not exist"
Sep 08 00:32:13.770808 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.770785    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"]
Sep 08 00:32:13.777135 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.777112    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3d0f11-7dc48559d5-7tfg7"]
Sep 08 00:32:13.928582 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.928546    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256f782e-03ad-43ea-a571-546da094aad5" path="/var/lib/kubelet/pods/256f782e-03ad-43ea-a571-546da094aad5/volumes"
Sep 08 00:32:13.928951 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:13.928881    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36aca3e2-29e1-45f4-9d6f-f770210c66d7" path="/var/lib/kubelet/pods/36aca3e2-29e1-45f4-9d6f-f770210c66d7/volumes"
Sep 08 00:32:19.250767 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:19.250732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:19.350680 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:19.350648    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:19.598864 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:19.598777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:23.246361 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.246316    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"]
Sep 08 00:32:23.246824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.246737    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256f782e-03ad-43ea-a571-546da094aad5" containerName="payload-processing"
Sep 08 00:32:23.246824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.246750    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="256f782e-03ad-43ea-a571-546da094aad5" containerName="payload-processing"
Sep 08 00:32:23.246824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.246773    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36aca3e2-29e1-45f4-9d6f-f770210c66d7" containerName="revoke-keys"
Sep 08 00:32:23.246824 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.246778    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36aca3e2-29e1-45f4-9d6f-f770210c66d7" containerName="revoke-keys"
Sep 08 00:32:23.247079 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.246835    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="256f782e-03ad-43ea-a571-546da094aad5" containerName="payload-processing"
Sep 08 00:32:23.247079 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.246849    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36aca3e2-29e1-45f4-9d6f-f770210c66d7" containerName="revoke-keys"
Sep 08 00:32:23.251117 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.251093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"
Sep 08 00:32:23.254133 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.254112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:32:23.259286 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.259265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"]
Sep 08 00:32:23.319381 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.319328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdb5188-01c4-4bfa-8e12-96b815a437d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v\" (UID: \"6fdb5188-01c4-4bfa-8e12-96b815a437d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"
Sep 08 00:32:23.372433 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.372403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:23.420189 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.420160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdb5188-01c4-4bfa-8e12-96b815a437d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v\" (UID: \"6fdb5188-01c4-4bfa-8e12-96b815a437d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"
Sep 08 00:32:23.420752 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.420735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdb5188-01c4-4bfa-8e12-96b815a437d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v\" (UID: \"6fdb5188-01c4-4bfa-8e12-96b815a437d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"
Sep 08 00:32:23.562482 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.562406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"
Sep 08 00:32:23.834504 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:23.834473    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"]
Sep 08 00:32:23.836649 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:32:23.836622    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdb5188_01c4_4bfa_8e12_96b815a437d3.slice/crio-e64b1ea2a7bed1366d239711818583480bb3ee0b6c053d9e2387ab9c0f23fa99 WatchSource:0}: Error finding container e64b1ea2a7bed1366d239711818583480bb3ee0b6c053d9e2387ab9c0f23fa99: Status 404 returned error can't find the container with id e64b1ea2a7bed1366d239711818583480bb3ee0b6c053d9e2387ab9c0f23fa99
Sep 08 00:32:24.807335 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:24.807287    2580 generic.go:356] "Generic (PLEG): container finished" podID="6fdb5188-01c4-4bfa-8e12-96b815a437d3" containerID="6d44819133e29a6f2bc377cd61f914c19a0eba9503440b5da556a7489d350460" exitCode=0
Sep 08 00:32:24.807955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:24.807385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v" event={"ID":"6fdb5188-01c4-4bfa-8e12-96b815a437d3","Type":"ContainerDied","Data":"6d44819133e29a6f2bc377cd61f914c19a0eba9503440b5da556a7489d350460"}
Sep 08 00:32:24.807955 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:24.807502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v" event={"ID":"6fdb5188-01c4-4bfa-8e12-96b815a437d3","Type":"ContainerStarted","Data":"e64b1ea2a7bed1366d239711818583480bb3ee0b6c053d9e2387ab9c0f23fa99"}
Sep 08 00:32:25.951143 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:25.951119    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"
Sep 08 00:32:26.040846 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:26.040808    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdb5188-01c4-4bfa-8e12-96b815a437d3-maas-api-service-ca\") pod \"6fdb5188-01c4-4bfa-8e12-96b815a437d3\" (UID: \"6fdb5188-01c4-4bfa-8e12-96b815a437d3\") "
Sep 08 00:32:26.041216 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:26.041192    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fdb5188-01c4-4bfa-8e12-96b815a437d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6fdb5188-01c4-4bfa-8e12-96b815a437d3" (UID: "6fdb5188-01c4-4bfa-8e12-96b815a437d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:32:26.142232 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:26.142146    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdb5188-01c4-4bfa-8e12-96b815a437d3-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:26.819245 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:26.819214    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"
Sep 08 00:32:26.819489 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:26.819254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v" event={"ID":"6fdb5188-01c4-4bfa-8e12-96b815a437d3","Type":"ContainerDied","Data":"e64b1ea2a7bed1366d239711818583480bb3ee0b6c053d9e2387ab9c0f23fa99"}
Sep 08 00:32:26.819489 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:26.819306    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e64b1ea2a7bed1366d239711818583480bb3ee0b6c053d9e2387ab9c0f23fa99"
Sep 08 00:32:38.763210 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:38.763172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:38.788093 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:38.788055    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"]
Sep 08 00:32:38.788526 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:38.788307    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682" podUID="e6791f9c-66f0-4bbc-8798-e5dfba08e819" containerName="payload-processing" containerID="cri-o://c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2" gracePeriod=30
Sep 08 00:32:38.793930 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:38.793887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"]
Sep 08 00:32:38.794192 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:38.794165    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2" podUID="25a61ace-1428-4edf-a6ab-19366628f47e" containerName="payload-pre-processing" containerID="cri-o://c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5" gracePeriod=30
Sep 08 00:32:38.849262 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:32:38.849226    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6791f9c_66f0_4bbc_8798_e5dfba08e819.slice/crio-conmon-c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2.scope\": RecentStats: unable to find data in memory cache]"
Sep 08 00:32:38.865097 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:38.865069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:38.965039 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:38.964995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:39.040888 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.040808    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"]
Sep 08 00:32:39.050616 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.050584    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8098ed-h8h8v"]
Sep 08 00:32:39.066805 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.066778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:39.086260 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.086241    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:32:39.089194 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.089171    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:32:39.159380 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.159336    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpctx\" (UniqueName: \"kubernetes.io/projected/25a61ace-1428-4edf-a6ab-19366628f47e-kube-api-access-dpctx\") pod \"25a61ace-1428-4edf-a6ab-19366628f47e\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") "
Sep 08 00:32:39.159531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.159414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c87gx\" (UniqueName: \"kubernetes.io/projected/e6791f9c-66f0-4bbc-8798-e5dfba08e819-kube-api-access-c87gx\") pod \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") "
Sep 08 00:32:39.159531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.159443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a61ace-1428-4edf-a6ab-19366628f47e-plugins-config-volume\") pod \"25a61ace-1428-4edf-a6ab-19366628f47e\" (UID: \"25a61ace-1428-4edf-a6ab-19366628f47e\") "
Sep 08 00:32:39.159531 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.159461    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6791f9c-66f0-4bbc-8798-e5dfba08e819-plugins-config-volume\") pod \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\" (UID: \"e6791f9c-66f0-4bbc-8798-e5dfba08e819\") "
Sep 08 00:32:39.159855 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.159828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a61ace-1428-4edf-a6ab-19366628f47e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25a61ace-1428-4edf-a6ab-19366628f47e" (UID: "25a61ace-1428-4edf-a6ab-19366628f47e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:32:39.159922 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.159854    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6791f9c-66f0-4bbc-8798-e5dfba08e819-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e6791f9c-66f0-4bbc-8798-e5dfba08e819" (UID: "e6791f9c-66f0-4bbc-8798-e5dfba08e819"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:32:39.161429 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.161410    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a61ace-1428-4edf-a6ab-19366628f47e-kube-api-access-dpctx" (OuterVolumeSpecName: "kube-api-access-dpctx") pod "25a61ace-1428-4edf-a6ab-19366628f47e" (UID: "25a61ace-1428-4edf-a6ab-19366628f47e"). InnerVolumeSpecName "kube-api-access-dpctx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:32:39.161548 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.161531    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6791f9c-66f0-4bbc-8798-e5dfba08e819-kube-api-access-c87gx" (OuterVolumeSpecName: "kube-api-access-c87gx") pod "e6791f9c-66f0-4bbc-8798-e5dfba08e819" (UID: "e6791f9c-66f0-4bbc-8798-e5dfba08e819"). InnerVolumeSpecName "kube-api-access-c87gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:32:39.260908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.260879    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpctx\" (UniqueName: \"kubernetes.io/projected/25a61ace-1428-4edf-a6ab-19366628f47e-kube-api-access-dpctx\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:39.260908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.260906    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c87gx\" (UniqueName: \"kubernetes.io/projected/e6791f9c-66f0-4bbc-8798-e5dfba08e819-kube-api-access-c87gx\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:39.261066 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.260918    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a61ace-1428-4edf-a6ab-19366628f47e-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:39.261066 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.260926    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6791f9c-66f0-4bbc-8798-e5dfba08e819-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:32:39.445385 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.445329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:39.889203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.889112    2580 generic.go:356] "Generic (PLEG): container finished" podID="e6791f9c-66f0-4bbc-8798-e5dfba08e819" containerID="c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2" exitCode=0
Sep 08 00:32:39.889203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.889158    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"
Sep 08 00:32:39.889726 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.889201    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682" event={"ID":"e6791f9c-66f0-4bbc-8798-e5dfba08e819","Type":"ContainerDied","Data":"c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2"}
Sep 08 00:32:39.889726 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.889259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682" event={"ID":"e6791f9c-66f0-4bbc-8798-e5dfba08e819","Type":"ContainerDied","Data":"fdcad11eab31c07ff70401c6719be1ab97a7e795b0dc6e4e908beebbb4c5763b"}
Sep 08 00:32:39.889726 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.889286    2580 scope.go:117] "RemoveContainer" containerID="c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2"
Sep 08 00:32:39.890696 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.890677    2580 generic.go:356] "Generic (PLEG): container finished" podID="25a61ace-1428-4edf-a6ab-19366628f47e" containerID="c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5" exitCode=0
Sep 08 00:32:39.890772 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.890711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2" event={"ID":"25a61ace-1428-4edf-a6ab-19366628f47e","Type":"ContainerDied","Data":"c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5"}
Sep 08 00:32:39.890772 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.890716    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"
Sep 08 00:32:39.890772 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.890744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2" event={"ID":"25a61ace-1428-4edf-a6ab-19366628f47e","Type":"ContainerDied","Data":"657dff7e3cd3d025f20c92d78d5a3b3c1dd90cbc2854e35c900ad19d34bad201"}
Sep 08 00:32:39.900101 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.900087    2580 scope.go:117] "RemoveContainer" containerID="c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2"
Sep 08 00:32:39.900392 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:32:39.900335    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2\": container with ID starting with c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2 not found: ID does not exist" containerID="c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2"
Sep 08 00:32:39.900596 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.900401    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2"} err="failed to get container status \"c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2\": rpc error: code = NotFound desc = could not find container \"c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2\": container with ID starting with c1949b9eb237d4e19fc9b95d0f54956d11dbbdd95ee74c6b6fe72ee9016bc0e2 not found: ID does not exist"
Sep 08 00:32:39.900596 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.900431    2580 scope.go:117] "RemoveContainer" containerID="c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5"
Sep 08 00:32:39.908188 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.908170    2580 scope.go:117] "RemoveContainer" containerID="c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5"
Sep 08 00:32:39.908506 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:32:39.908488    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5\": container with ID starting with c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5 not found: ID does not exist" containerID="c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5"
Sep 08 00:32:39.908564 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.908512    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5"} err="failed to get container status \"c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5\": rpc error: code = NotFound desc = could not find container \"c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5\": container with ID starting with c3b62c001d79a7018c00e20a4bb5a1eaa25cd39a41f9f5e0f48db71a93d7b5c5 not found: ID does not exist"
Sep 08 00:32:39.931376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.931334    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fdb5188-01c4-4bfa-8e12-96b815a437d3" path="/var/lib/kubelet/pods/6fdb5188-01c4-4bfa-8e12-96b815a437d3/volumes"
Sep 08 00:32:39.931910 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.931890    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"]
Sep 08 00:32:39.932055 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.932043    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8098ed-558c668d5c-5v682"]
Sep 08 00:32:39.937082 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.937060    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"]
Sep 08 00:32:39.941696 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:39.941675    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8098ed-9f7b8d8f8-8l5b2"]
Sep 08 00:32:40.212019 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:40.211984    2580 scope.go:117] "RemoveContainer" containerID="e66333fa40f51336a3f0fcb57a03a2f59bf2598f5c362eaf38c54ea6be3a837f"
Sep 08 00:32:41.927107 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:41.927072    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25a61ace-1428-4edf-a6ab-19366628f47e" path="/var/lib/kubelet/pods/25a61ace-1428-4edf-a6ab-19366628f47e/volumes"
Sep 08 00:32:41.927499 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:41.927474    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6791f9c-66f0-4bbc-8798-e5dfba08e819" path="/var/lib/kubelet/pods/e6791f9c-66f0-4bbc-8798-e5dfba08e819/volumes"
Sep 08 00:32:43.267676 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:43.267641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:32:44.491896 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:32:44.491861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:08.697929 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:08.697887    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:11.750046 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:11.750013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:23.878851 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:23.878816    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:26.838481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:26.838440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:31.434700 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:31.434669    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:31.586152 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:31.586120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:31.821081 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:31.820996    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:32.462000 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:32.461960    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:43.286306 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.286264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:43.364315 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.364282    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"]
Sep 08 00:33:43.364586 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.364541    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj" podUID="394cf27b-4504-472c-b091-e514f4ec9989" containerName="payload-processing" containerID="cri-o://a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1" gracePeriod=30
Sep 08 00:33:43.480914 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.480883    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:43.622251 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.622226    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:33:43.755561 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.755528    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:43.759610 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.759589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcw9h\" (UniqueName: \"kubernetes.io/projected/394cf27b-4504-472c-b091-e514f4ec9989-kube-api-access-tcw9h\") pod \"394cf27b-4504-472c-b091-e514f4ec9989\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") "
Sep 08 00:33:43.759700 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.759642    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/394cf27b-4504-472c-b091-e514f4ec9989-plugins-config-volume\") pod \"394cf27b-4504-472c-b091-e514f4ec9989\" (UID: \"394cf27b-4504-472c-b091-e514f4ec9989\") "
Sep 08 00:33:43.760054 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.760033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/394cf27b-4504-472c-b091-e514f4ec9989-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "394cf27b-4504-472c-b091-e514f4ec9989" (UID: "394cf27b-4504-472c-b091-e514f4ec9989"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:33:43.761687 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.761658    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/394cf27b-4504-472c-b091-e514f4ec9989-kube-api-access-tcw9h" (OuterVolumeSpecName: "kube-api-access-tcw9h") pod "394cf27b-4504-472c-b091-e514f4ec9989" (UID: "394cf27b-4504-472c-b091-e514f4ec9989"). InnerVolumeSpecName "kube-api-access-tcw9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:33:43.860566 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.860490    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcw9h\" (UniqueName: \"kubernetes.io/projected/394cf27b-4504-472c-b091-e514f4ec9989-kube-api-access-tcw9h\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:33:43.860566 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:43.860514    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/394cf27b-4504-472c-b091-e514f4ec9989-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:33:44.107679 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.107642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:44.221995 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.221960    2580 generic.go:356] "Generic (PLEG): container finished" podID="394cf27b-4504-472c-b091-e514f4ec9989" containerID="a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1" exitCode=0
Sep 08 00:33:44.222184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.222009    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"
Sep 08 00:33:44.222184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.222052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj" event={"ID":"394cf27b-4504-472c-b091-e514f4ec9989","Type":"ContainerDied","Data":"a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1"}
Sep 08 00:33:44.222184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.222106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj" event={"ID":"394cf27b-4504-472c-b091-e514f4ec9989","Type":"ContainerDied","Data":"5328dc0ddea46c9fe94413a7dea5bf4e6bd800df677bb5979e70dd3c8a66944b"}
Sep 08 00:33:44.222184 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.222129    2580 scope.go:117] "RemoveContainer" containerID="a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1"
Sep 08 00:33:44.231267 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.231250    2580 scope.go:117] "RemoveContainer" containerID="a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1"
Sep 08 00:33:44.231558 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:33:44.231537    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1\": container with ID starting with a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1 not found: ID does not exist" containerID="a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1"
Sep 08 00:33:44.231638 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.231564    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1"} err="failed to get container status \"a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1\": rpc error: code = NotFound desc = could not find container \"a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1\": container with ID starting with a28dae13572662376e98862953bcd2a1b0a58baeb514ab493b0b30ee66022fd1 not found: ID does not exist"
Sep 08 00:33:44.269706 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.269683    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"]
Sep 08 00:33:44.273618 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.273597    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4d2f00-6dd748dcff-qp9tj"]
Sep 08 00:33:44.327508 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:44.327484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:45.928128 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:45.928091    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="394cf27b-4504-472c-b091-e514f4ec9989" path="/var/lib/kubelet/pods/394cf27b-4504-472c-b091-e514f4ec9989/volumes"
Sep 08 00:33:52.393179 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:52.393136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:52.694078 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:52.694038    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:53.017111 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.017024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:53.018523 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018502    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"]
Sep 08 00:33:53.018876 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018864    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fdb5188-01c4-4bfa-8e12-96b815a437d3" containerName="revoke-keys"
Sep 08 00:33:53.018915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018878    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fdb5188-01c4-4bfa-8e12-96b815a437d3" containerName="revoke-keys"
Sep 08 00:33:53.018915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018894    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6791f9c-66f0-4bbc-8798-e5dfba08e819" containerName="payload-processing"
Sep 08 00:33:53.018915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018900    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6791f9c-66f0-4bbc-8798-e5dfba08e819" containerName="payload-processing"
Sep 08 00:33:53.018915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018908    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a61ace-1428-4edf-a6ab-19366628f47e" containerName="payload-pre-processing"
Sep 08 00:33:53.018915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018914    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a61ace-1428-4edf-a6ab-19366628f47e" containerName="payload-pre-processing"
Sep 08 00:33:53.019070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018922    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394cf27b-4504-472c-b091-e514f4ec9989" containerName="payload-processing"
Sep 08 00:33:53.019070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018927    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="394cf27b-4504-472c-b091-e514f4ec9989" containerName="payload-processing"
Sep 08 00:33:53.019070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.018996    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="394cf27b-4504-472c-b091-e514f4ec9989" containerName="payload-processing"
Sep 08 00:33:53.019070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.019005    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6791f9c-66f0-4bbc-8798-e5dfba08e819" containerName="payload-processing"
Sep 08 00:33:53.019070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.019012    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a61ace-1428-4edf-a6ab-19366628f47e" containerName="payload-pre-processing"
Sep 08 00:33:53.019070 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.019019    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fdb5188-01c4-4bfa-8e12-96b815a437d3" containerName="revoke-keys"
Sep 08 00:33:53.023440 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.023423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"
Sep 08 00:33:53.031722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.031700    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:33:53.045372 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.045333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56aa2094-710b-49c6-a97c-498b506c1451-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2\" (UID: \"56aa2094-710b-49c6-a97c-498b506c1451\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"
Sep 08 00:33:53.066524 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.066485    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"]
Sep 08 00:33:53.145840 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.145804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56aa2094-710b-49c6-a97c-498b506c1451-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2\" (UID: \"56aa2094-710b-49c6-a97c-498b506c1451\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"
Sep 08 00:33:53.146407 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.146390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56aa2094-710b-49c6-a97c-498b506c1451-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2\" (UID: \"56aa2094-710b-49c6-a97c-498b506c1451\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"
Sep 08 00:33:53.255053 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.255013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:53.333589 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.333513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"
Sep 08 00:33:53.590579 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.590491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:53.691894 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:53.691863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"]
Sep 08 00:33:53.693839 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:33:53.693804    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56aa2094_710b_49c6_a97c_498b506c1451.slice/crio-ac11a09f855248ec17e3ee949ef0d489e2cb5abcc33feed3c372a4e34591e665 WatchSource:0}: Error finding container ac11a09f855248ec17e3ee949ef0d489e2cb5abcc33feed3c372a4e34591e665: Status 404 returned error can't find the container with id ac11a09f855248ec17e3ee949ef0d489e2cb5abcc33feed3c372a4e34591e665
Sep 08 00:33:54.274530 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:54.274487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2" event={"ID":"56aa2094-710b-49c6-a97c-498b506c1451","Type":"ContainerStarted","Data":"032cfafe548d773e4f833764a8ecd5e24eb02ae83be86eb1235a1a055963ceae"}
Sep 08 00:33:54.274690 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:54.274549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2" event={"ID":"56aa2094-710b-49c6-a97c-498b506c1451","Type":"ContainerStarted","Data":"ac11a09f855248ec17e3ee949ef0d489e2cb5abcc33feed3c372a4e34591e665"}
Sep 08 00:33:54.354532 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:54.354472    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2" podStartSLOduration=2.354456644 podStartE2EDuration="2.354456644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:33:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:54.352981627 +0000 UTC m=+1874.838410236" watchObservedRunningTime="2026-09-08 00:33:54.354456644 +0000 UTC m=+1874.839885253"
Sep 08 00:33:55.280805 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:55.280771    2580 generic.go:356] "Generic (PLEG): container finished" podID="56aa2094-710b-49c6-a97c-498b506c1451" containerID="032cfafe548d773e4f833764a8ecd5e24eb02ae83be86eb1235a1a055963ceae" exitCode=0
Sep 08 00:33:55.281173 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:55.280832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2" event={"ID":"56aa2094-710b-49c6-a97c-498b506c1451","Type":"ContainerDied","Data":"032cfafe548d773e4f833764a8ecd5e24eb02ae83be86eb1235a1a055963ceae"}
Sep 08 00:33:56.417937 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:56.417911    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"
Sep 08 00:33:56.469024 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:56.468992    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56aa2094-710b-49c6-a97c-498b506c1451-maas-api-service-ca\") pod \"56aa2094-710b-49c6-a97c-498b506c1451\" (UID: \"56aa2094-710b-49c6-a97c-498b506c1451\") "
Sep 08 00:33:56.469465 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:56.469437    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56aa2094-710b-49c6-a97c-498b506c1451-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "56aa2094-710b-49c6-a97c-498b506c1451" (UID: "56aa2094-710b-49c6-a97c-498b506c1451"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:33:56.570394 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:56.570263    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56aa2094-710b-49c6-a97c-498b506c1451-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:33:57.291675 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:57.291647    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"
Sep 08 00:33:57.291848 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:57.291695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2" event={"ID":"56aa2094-710b-49c6-a97c-498b506c1451","Type":"ContainerDied","Data":"ac11a09f855248ec17e3ee949ef0d489e2cb5abcc33feed3c372a4e34591e665"}
Sep 08 00:33:57.291848 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:57.291745    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac11a09f855248ec17e3ee949ef0d489e2cb5abcc33feed3c372a4e34591e665"
Sep 08 00:33:59.542129 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:33:59.542092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:03.219196 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:03.219119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.367018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.366983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.429214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.429175    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"]
Sep 08 00:34:04.448904 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.448869    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8978e7-29813790-7h6cm"]
Sep 08 00:34:04.499877 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.499841    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"]
Sep 08 00:34:04.500129 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.500101    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt" podUID="ba85970b-ea6b-452d-b08b-6050a8e1ae32" containerName="payload-processing" containerID="cri-o://cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c" gracePeriod=30
Sep 08 00:34:04.537506 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.537468    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"]
Sep 08 00:34:04.537709 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.537686    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj" podUID="be930aa2-f30c-4c64-a90e-502e0a06c100" containerName="payload-pre-processing" containerID="cri-o://8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71" gracePeriod=30
Sep 08 00:34:04.690319 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.690271    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.819244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.819212    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:34:04.822722 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.822687    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:34:04.840535 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.840506    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba85970b-ea6b-452d-b08b-6050a8e1ae32-plugins-config-volume\") pod \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") "
Sep 08 00:34:04.840695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.840559    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gqsw\" (UniqueName: \"kubernetes.io/projected/ba85970b-ea6b-452d-b08b-6050a8e1ae32-kube-api-access-9gqsw\") pod \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\" (UID: \"ba85970b-ea6b-452d-b08b-6050a8e1ae32\") "
Sep 08 00:34:04.840695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.840582    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6cmj\" (UniqueName: \"kubernetes.io/projected/be930aa2-f30c-4c64-a90e-502e0a06c100-kube-api-access-z6cmj\") pod \"be930aa2-f30c-4c64-a90e-502e0a06c100\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") "
Sep 08 00:34:04.840695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.840627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be930aa2-f30c-4c64-a90e-502e0a06c100-plugins-config-volume\") pod \"be930aa2-f30c-4c64-a90e-502e0a06c100\" (UID: \"be930aa2-f30c-4c64-a90e-502e0a06c100\") "
Sep 08 00:34:04.840999 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.840972    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba85970b-ea6b-452d-b08b-6050a8e1ae32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba85970b-ea6b-452d-b08b-6050a8e1ae32" (UID: "ba85970b-ea6b-452d-b08b-6050a8e1ae32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:34:04.841074 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.841051    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be930aa2-f30c-4c64-a90e-502e0a06c100-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be930aa2-f30c-4c64-a90e-502e0a06c100" (UID: "be930aa2-f30c-4c64-a90e-502e0a06c100"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:34:04.842821 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.842790    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be930aa2-f30c-4c64-a90e-502e0a06c100-kube-api-access-z6cmj" (OuterVolumeSpecName: "kube-api-access-z6cmj") pod "be930aa2-f30c-4c64-a90e-502e0a06c100" (UID: "be930aa2-f30c-4c64-a90e-502e0a06c100"). InnerVolumeSpecName "kube-api-access-z6cmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:04.842821 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.842795    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba85970b-ea6b-452d-b08b-6050a8e1ae32-kube-api-access-9gqsw" (OuterVolumeSpecName: "kube-api-access-9gqsw") pod "ba85970b-ea6b-452d-b08b-6050a8e1ae32" (UID: "ba85970b-ea6b-452d-b08b-6050a8e1ae32"). InnerVolumeSpecName "kube-api-access-9gqsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:04.915405 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.915371    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.941682 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.941641    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6cmj\" (UniqueName: \"kubernetes.io/projected/be930aa2-f30c-4c64-a90e-502e0a06c100-kube-api-access-z6cmj\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:04.941682 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.941672    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be930aa2-f30c-4c64-a90e-502e0a06c100-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:04.941682 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.941682    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba85970b-ea6b-452d-b08b-6050a8e1ae32-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:04.941682 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:04.941691    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gqsw\" (UniqueName: \"kubernetes.io/projected/ba85970b-ea6b-452d-b08b-6050a8e1ae32-kube-api-access-9gqsw\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:05.057658 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.057620    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"]
Sep 08 00:34:05.068683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.068651    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8978e7-58pb2"]
Sep 08 00:34:05.124629 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.124599    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:05.337306 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.337216    2580 generic.go:356] "Generic (PLEG): container finished" podID="be930aa2-f30c-4c64-a90e-502e0a06c100" containerID="8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71" exitCode=0
Sep 08 00:34:05.337306 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.337258    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"
Sep 08 00:34:05.337566 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.337303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj" event={"ID":"be930aa2-f30c-4c64-a90e-502e0a06c100","Type":"ContainerDied","Data":"8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71"}
Sep 08 00:34:05.337566 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.337375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj" event={"ID":"be930aa2-f30c-4c64-a90e-502e0a06c100","Type":"ContainerDied","Data":"6fb4b33d99cd8b60d96871afc4effbc29ee1f0a978f50284aa791653ce30e619"}
Sep 08 00:34:05.337566 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.337405    2580 scope.go:117] "RemoveContainer" containerID="8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71"
Sep 08 00:34:05.338828 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.338804    2580 generic.go:356] "Generic (PLEG): container finished" podID="ba85970b-ea6b-452d-b08b-6050a8e1ae32" containerID="cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c" exitCode=0
Sep 08 00:34:05.338915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.338840    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"
Sep 08 00:34:05.338915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.338845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt" event={"ID":"ba85970b-ea6b-452d-b08b-6050a8e1ae32","Type":"ContainerDied","Data":"cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c"}
Sep 08 00:34:05.338915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.338879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt" event={"ID":"ba85970b-ea6b-452d-b08b-6050a8e1ae32","Type":"ContainerDied","Data":"9621c62a00cfb2e626b0db2c6fd2a229a17652624528d7993bf61959d2bd9a9e"}
Sep 08 00:34:05.347271 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.347255    2580 scope.go:117] "RemoveContainer" containerID="8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71"
Sep 08 00:34:05.347603 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:34:05.347583    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71\": container with ID starting with 8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71 not found: ID does not exist" containerID="8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71"
Sep 08 00:34:05.347695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.347615    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71"} err="failed to get container status \"8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71\": rpc error: code = NotFound desc = could not find container \"8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71\": container with ID starting with 8bc8cc750b39cac5c40505bfe2eb141f64c28fece0bf6b59afb87df6a628ab71 not found: ID does not exist"
Sep 08 00:34:05.347695 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.347638    2580 scope.go:117] "RemoveContainer" containerID="cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c"
Sep 08 00:34:05.355481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.355455    2580 scope.go:117] "RemoveContainer" containerID="cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c"
Sep 08 00:34:05.355737 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:34:05.355718    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c\": container with ID starting with cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c not found: ID does not exist" containerID="cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c"
Sep 08 00:34:05.355793 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.355743    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c"} err="failed to get container status \"cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c\": rpc error: code = NotFound desc = could not find container \"cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c\": container with ID starting with cf20ef145e6929128b217059cda08547b88053eb2e33d0a3342114206a894a7c not found: ID does not exist"
Sep 08 00:34:05.390477 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.390453    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"]
Sep 08 00:34:05.402723 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.402692    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-8978e7-6b69589d5f-8g4kt"]
Sep 08 00:34:05.457986 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.457965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"]
Sep 08 00:34:05.465873 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.465847    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8978e7-6b4fd45746-5zpzj"]
Sep 08 00:34:05.530475 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.530447    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:05.928573 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.928541    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56aa2094-710b-49c6-a97c-498b506c1451" path="/var/lib/kubelet/pods/56aa2094-710b-49c6-a97c-498b506c1451/volumes"
Sep 08 00:34:05.928839 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.928827    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96575612-cb7f-4d3d-9336-c0bdd804a935" path="/var/lib/kubelet/pods/96575612-cb7f-4d3d-9336-c0bdd804a935/volumes"
Sep 08 00:34:05.929107 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.929096    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba85970b-ea6b-452d-b08b-6050a8e1ae32" path="/var/lib/kubelet/pods/ba85970b-ea6b-452d-b08b-6050a8e1ae32/volumes"
Sep 08 00:34:05.929431 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:05.929419    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be930aa2-f30c-4c64-a90e-502e0a06c100" path="/var/lib/kubelet/pods/be930aa2-f30c-4c64-a90e-502e0a06c100/volumes"
Sep 08 00:34:14.048765 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.048729    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:14.171048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.171011    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:14.491296 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.491256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:14.783739 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.783651    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"]
Sep 08 00:34:14.784061 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784049    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba85970b-ea6b-452d-b08b-6050a8e1ae32" containerName="payload-processing"
Sep 08 00:34:14.784105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784063    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba85970b-ea6b-452d-b08b-6050a8e1ae32" containerName="payload-processing"
Sep 08 00:34:14.784105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784075    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be930aa2-f30c-4c64-a90e-502e0a06c100" containerName="payload-pre-processing"
Sep 08 00:34:14.784105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784081    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="be930aa2-f30c-4c64-a90e-502e0a06c100" containerName="payload-pre-processing"
Sep 08 00:34:14.784105 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784101    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56aa2094-710b-49c6-a97c-498b506c1451" containerName="revoke-keys"
Sep 08 00:34:14.784230 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784107    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="56aa2094-710b-49c6-a97c-498b506c1451" containerName="revoke-keys"
Sep 08 00:34:14.784230 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784162    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="56aa2094-710b-49c6-a97c-498b506c1451" containerName="revoke-keys"
Sep 08 00:34:14.784230 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784171    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="be930aa2-f30c-4c64-a90e-502e0a06c100" containerName="payload-pre-processing"
Sep 08 00:34:14.784230 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.784180    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba85970b-ea6b-452d-b08b-6050a8e1ae32" containerName="payload-processing"
Sep 08 00:34:14.787049 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.787032    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"
Sep 08 00:34:14.790083 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.790055    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:34:14.799890 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.799866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"]
Sep 08 00:34:14.836770 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.836726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee0739b-6006-4071-8b7d-d3c5bcd13920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp\" (UID: \"7ee0739b-6006-4071-8b7d-d3c5bcd13920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"
Sep 08 00:34:14.937426 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.937387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee0739b-6006-4071-8b7d-d3c5bcd13920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp\" (UID: \"7ee0739b-6006-4071-8b7d-d3c5bcd13920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"
Sep 08 00:34:14.938048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:14.938026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee0739b-6006-4071-8b7d-d3c5bcd13920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp\" (UID: \"7ee0739b-6006-4071-8b7d-d3c5bcd13920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"
Sep 08 00:34:15.099862 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:15.099772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"
Sep 08 00:34:15.160636 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:15.160071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:15.404128 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:15.404093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"]
Sep 08 00:34:15.407310 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:34:15.407285    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee0739b_6006_4071_8b7d_d3c5bcd13920.slice/crio-12f3d10d25627cf1db8d66cac7f8061a47ab3e422089ce43dc9197d4222de460 WatchSource:0}: Error finding container 12f3d10d25627cf1db8d66cac7f8061a47ab3e422089ce43dc9197d4222de460: Status 404 returned error can't find the container with id 12f3d10d25627cf1db8d66cac7f8061a47ab3e422089ce43dc9197d4222de460
Sep 08 00:34:16.401260 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:16.401219    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ee0739b-6006-4071-8b7d-d3c5bcd13920" containerID="401eff8a1e00b9595b0ffe0087790725e260738c505cefb54181f1c743dd83a3" exitCode=0
Sep 08 00:34:16.401745 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:16.401310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp" event={"ID":"7ee0739b-6006-4071-8b7d-d3c5bcd13920","Type":"ContainerDied","Data":"401eff8a1e00b9595b0ffe0087790725e260738c505cefb54181f1c743dd83a3"}
Sep 08 00:34:16.401745 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:16.401388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp" event={"ID":"7ee0739b-6006-4071-8b7d-d3c5bcd13920","Type":"ContainerStarted","Data":"12f3d10d25627cf1db8d66cac7f8061a47ab3e422089ce43dc9197d4222de460"}
Sep 08 00:34:17.536169 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:17.536145    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"
Sep 08 00:34:17.663681 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:17.663593    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee0739b-6006-4071-8b7d-d3c5bcd13920-maas-api-service-ca\") pod \"7ee0739b-6006-4071-8b7d-d3c5bcd13920\" (UID: \"7ee0739b-6006-4071-8b7d-d3c5bcd13920\") "
Sep 08 00:34:17.663958 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:17.663937    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ee0739b-6006-4071-8b7d-d3c5bcd13920-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ee0739b-6006-4071-8b7d-d3c5bcd13920" (UID: "7ee0739b-6006-4071-8b7d-d3c5bcd13920"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:34:17.764982 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:17.764950    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee0739b-6006-4071-8b7d-d3c5bcd13920-maas-api-service-ca\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:18.413033 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:18.412999    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"
Sep 08 00:34:18.413033 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:18.413024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp" event={"ID":"7ee0739b-6006-4071-8b7d-d3c5bcd13920","Type":"ContainerDied","Data":"12f3d10d25627cf1db8d66cac7f8061a47ab3e422089ce43dc9197d4222de460"}
Sep 08 00:34:18.413286 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:18.413077    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12f3d10d25627cf1db8d66cac7f8061a47ab3e422089ce43dc9197d4222de460"
Sep 08 00:34:25.656411 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.656374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:25.698140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.698107    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"]
Sep 08 00:34:25.698384 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.698324    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz" podUID="ef933a2c-27d2-4278-9997-bee3c683ca32" containerName="payload-pre-processing" containerID="cri-o://bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c" gracePeriod=30
Sep 08 00:34:25.762539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.762505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:25.877995 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.877964    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:25.942307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.942278    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"]
Sep 08 00:34:25.944842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.944818    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b8c8cd-f9jdp"]
Sep 08 00:34:25.950999 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.950980    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:34:25.973688 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:25.973644    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:26.042118 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.042072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef933a2c-27d2-4278-9997-bee3c683ca32-plugins-config-volume\") pod \"ef933a2c-27d2-4278-9997-bee3c683ca32\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") "
Sep 08 00:34:26.042298 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.042140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hf2t\" (UniqueName: \"kubernetes.io/projected/ef933a2c-27d2-4278-9997-bee3c683ca32-kube-api-access-8hf2t\") pod \"ef933a2c-27d2-4278-9997-bee3c683ca32\" (UID: \"ef933a2c-27d2-4278-9997-bee3c683ca32\") "
Sep 08 00:34:26.042522 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.042494    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef933a2c-27d2-4278-9997-bee3c683ca32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef933a2c-27d2-4278-9997-bee3c683ca32" (UID: "ef933a2c-27d2-4278-9997-bee3c683ca32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:34:26.043015 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.042983    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef933a2c-27d2-4278-9997-bee3c683ca32-plugins-config-volume\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:26.044510 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.044486    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef933a2c-27d2-4278-9997-bee3c683ca32-kube-api-access-8hf2t" (OuterVolumeSpecName: "kube-api-access-8hf2t") pod "ef933a2c-27d2-4278-9997-bee3c683ca32" (UID: "ef933a2c-27d2-4278-9997-bee3c683ca32"). InnerVolumeSpecName "kube-api-access-8hf2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:26.144028 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.143992    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hf2t\" (UniqueName: \"kubernetes.io/projected/ef933a2c-27d2-4278-9997-bee3c683ca32-kube-api-access-8hf2t\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:26.361857 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.361770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:26.454882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.454847    2580 generic.go:356] "Generic (PLEG): container finished" podID="ef933a2c-27d2-4278-9997-bee3c683ca32" containerID="bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c" exitCode=0
Sep 08 00:34:26.455067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.454897    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"
Sep 08 00:34:26.455067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.454931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz" event={"ID":"ef933a2c-27d2-4278-9997-bee3c683ca32","Type":"ContainerDied","Data":"bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c"}
Sep 08 00:34:26.455067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.454988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz" event={"ID":"ef933a2c-27d2-4278-9997-bee3c683ca32","Type":"ContainerDied","Data":"435e0cf91897d24ac452df1339fa7df86c16acb3185acba23c1eb86b9bddc623"}
Sep 08 00:34:26.455067 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.455010    2580 scope.go:117] "RemoveContainer" containerID="bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c"
Sep 08 00:34:26.463983 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.463961    2580 scope.go:117] "RemoveContainer" containerID="bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c"
Sep 08 00:34:26.464238 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:34:26.464222    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c\": container with ID starting with bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c not found: ID does not exist" containerID="bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c"
Sep 08 00:34:26.464287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.464260    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c"} err="failed to get container status \"bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c\": rpc error: code = NotFound desc = could not find container \"bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c\": container with ID starting with bf991cf4f0b8de6fc6aad8660c1aa0f325941ac4f72ba68cee0a87909cba0b8c not found: ID does not exist"
Sep 08 00:34:26.477520 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.477496    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"]
Sep 08 00:34:26.482039 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:26.482016    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b8c8cd-67df6f4874-pmhhz"]
Sep 08 00:34:27.926895 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:27.926855    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ee0739b-6006-4071-8b7d-d3c5bcd13920" path="/var/lib/kubelet/pods/7ee0739b-6006-4071-8b7d-d3c5bcd13920/volumes"
Sep 08 00:34:27.927290 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:27.927224    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef933a2c-27d2-4278-9997-bee3c683ca32" path="/var/lib/kubelet/pods/ef933a2c-27d2-4278-9997-bee3c683ca32/volumes"
Sep 08 00:34:32.660667 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:32.660627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:32.762627 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:32.762595    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:32.925452 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:32.925364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:35.502211 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.502178    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8686947476-858wr"]
Sep 08 00:34:35.502689 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.502383    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8686947476-858wr" podUID="e0e83d67-0be6-4bb0-abbd-cd127ef5d179" containerName="manager" containerID="cri-o://ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7" gracePeriod=30
Sep 08 00:34:35.742601 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.742578    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:34:35.829496 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.829408    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-metrics-certs\") pod \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") "
Sep 08 00:34:35.829496 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.829470    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzdfq\" (UniqueName: \"kubernetes.io/projected/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-kube-api-access-rzdfq\") pod \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") "
Sep 08 00:34:35.829690 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.829570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert\") pod \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\" (UID: \"e0e83d67-0be6-4bb0-abbd-cd127ef5d179\") "
Sep 08 00:34:35.831571 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.831538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e0e83d67-0be6-4bb0-abbd-cd127ef5d179" (UID: "e0e83d67-0be6-4bb0-abbd-cd127ef5d179"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:34:35.832021 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.831987    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e0e83d67-0be6-4bb0-abbd-cd127ef5d179" (UID: "e0e83d67-0be6-4bb0-abbd-cd127ef5d179"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:34:35.832021 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.832001    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-kube-api-access-rzdfq" (OuterVolumeSpecName: "kube-api-access-rzdfq") pod "e0e83d67-0be6-4bb0-abbd-cd127ef5d179" (UID: "e0e83d67-0be6-4bb0-abbd-cd127ef5d179"). InnerVolumeSpecName "kube-api-access-rzdfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:35.930203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.930171    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-webhook-cert\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:35.930203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.930195    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-metrics-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:35.930203 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:35.930205    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzdfq\" (UniqueName: \"kubernetes.io/projected/e0e83d67-0be6-4bb0-abbd-cd127ef5d179-kube-api-access-rzdfq\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:34:36.507827 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.507792    2580 generic.go:356] "Generic (PLEG): container finished" podID="e0e83d67-0be6-4bb0-abbd-cd127ef5d179" containerID="ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7" exitCode=0
Sep 08 00:34:36.508263 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.507843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-858wr" event={"ID":"e0e83d67-0be6-4bb0-abbd-cd127ef5d179","Type":"ContainerDied","Data":"ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7"}
Sep 08 00:34:36.508263 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.507881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-858wr" event={"ID":"e0e83d67-0be6-4bb0-abbd-cd127ef5d179","Type":"ContainerDied","Data":"73da4273bf1b5473388d2d7dfb46d3be1b8ac23ef124cb9cde21b7f2831ecafb"}
Sep 08 00:34:36.508263 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.507903    2580 scope.go:117] "RemoveContainer" containerID="ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7"
Sep 08 00:34:36.508263 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.507842    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-858wr"
Sep 08 00:34:36.517794 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.517770    2580 scope.go:117] "RemoveContainer" containerID="ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7"
Sep 08 00:34:36.518133 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:34:36.518110    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7\": container with ID starting with ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7 not found: ID does not exist" containerID="ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7"
Sep 08 00:34:36.518188 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.518145    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7"} err="failed to get container status \"ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7\": rpc error: code = NotFound desc = could not find container \"ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7\": container with ID starting with ff05c96c2beafb6a57501b385feb48eaaca1cbe71a5f73dc9864e7d8ca1ed1f7 not found: ID does not exist"
Sep 08 00:34:36.526597 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.526563    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8686947476-858wr"]
Sep 08 00:34:36.531419 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:36.531387    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8686947476-858wr"]
Sep 08 00:34:37.927060 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:34:37.927020    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e83d67-0be6-4bb0-abbd-cd127ef5d179" path="/var/lib/kubelet/pods/e0e83d67-0be6-4bb0-abbd-cd127ef5d179/volumes"
Sep 08 00:35:37.321595 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321516    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8686947476-jmkvh"]
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321868    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee0739b-6006-4071-8b7d-d3c5bcd13920" containerName="revoke-keys"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321882    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee0739b-6006-4071-8b7d-d3c5bcd13920" containerName="revoke-keys"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321897    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e83d67-0be6-4bb0-abbd-cd127ef5d179" containerName="manager"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321902    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e83d67-0be6-4bb0-abbd-cd127ef5d179" containerName="manager"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321920    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef933a2c-27d2-4278-9997-bee3c683ca32" containerName="payload-pre-processing"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321926    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef933a2c-27d2-4278-9997-bee3c683ca32" containerName="payload-pre-processing"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321980    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ee0739b-6006-4071-8b7d-d3c5bcd13920" containerName="revoke-keys"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321991    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e83d67-0be6-4bb0-abbd-cd127ef5d179" containerName="manager"
Sep 08 00:35:37.322018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.321998    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef933a2c-27d2-4278-9997-bee3c683ca32" containerName="payload-pre-processing"
Sep 08 00:35:37.324967 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.324938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.327467 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.327443    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 00:35:37.327601 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.327523    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 00:35:37.327601 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.327442    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjbp5\""
Sep 08 00:35:37.327736 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.327444    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 00:35:37.333266 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.333235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686947476-jmkvh"]
Sep 08 00:35:37.367495 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.367470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-metrics-certs\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.367606 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.367565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj9zp\" (UniqueName: \"kubernetes.io/projected/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-kube-api-access-jj9zp\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.367606 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.367589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-webhook-cert\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.468731 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.468708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj9zp\" (UniqueName: \"kubernetes.io/projected/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-kube-api-access-jj9zp\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.468840 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.468741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-webhook-cert\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.468840 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.468774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-metrics-certs\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.471140 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.471123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-webhook-cert\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.471283 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.471262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-metrics-certs\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.476578 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.476550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj9zp\" (UniqueName: \"kubernetes.io/projected/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-kube-api-access-jj9zp\") pod \"maas-controller-8686947476-jmkvh\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") " pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.636004 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.635915    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:37.904915 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.904889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686947476-jmkvh"]
Sep 08 00:35:37.907684 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:35:37.907655    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce4aecd_b2f8_4c27_8da1_ac2c1db85b83.slice/crio-f36d29ddab27ee42f3f13b240f2a904a4eed0028ef230bf437e17104b829886b WatchSource:0}: Error finding container f36d29ddab27ee42f3f13b240f2a904a4eed0028ef230bf437e17104b829886b: Status 404 returned error can't find the container with id f36d29ddab27ee42f3f13b240f2a904a4eed0028ef230bf437e17104b829886b
Sep 08 00:35:37.909030 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:37.909005    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:35:38.819773 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:38.819733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-jmkvh" event={"ID":"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83","Type":"ContainerStarted","Data":"54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d"}
Sep 08 00:35:38.820221 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:38.819789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-jmkvh" event={"ID":"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83","Type":"ContainerStarted","Data":"f36d29ddab27ee42f3f13b240f2a904a4eed0028ef230bf437e17104b829886b"}
Sep 08 00:35:38.820221 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:38.819834    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:38.839648 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:38.839583    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8686947476-jmkvh" podStartSLOduration=1.44607703 podStartE2EDuration="1.839558082s" totalImagesPullingTime="393.481052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:35:38.837435133 +0000 UTC m=+1979.322863741" watchObservedRunningTime="2026-09-08 00:35:38.839558082 +0000 UTC m=+1979.324986689"
Sep 08 00:35:40.279260 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:40.279227    2580 scope.go:117] "RemoveContainer" containerID="0b146a11af811d1215641c2ef2659f2abd842fb408becb96d0ff7a66ee5c1da9"
Sep 08 00:35:40.287898 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:40.287874    2580 scope.go:117] "RemoveContainer" containerID="f2bedf4725ecfbc6b1966d7307c51d26ee9634491dd1a9fb82f2c8e95f06f233"
Sep 08 00:35:49.827971 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:49.827937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:58.759488 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:58.759450    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:59.014860 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.014746    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:59.099920 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.099883    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8686947476-jmkvh"]
Sep 08 00:35:59.100240 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.100204    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8686947476-jmkvh" podUID="dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" containerName="manager" containerID="cri-o://54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d" gracePeriod=30
Sep 08 00:35:59.354973 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.354945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:59.466069 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.466024    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-metrics-certs\") pod \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") "
Sep 08 00:35:59.466257 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.466111    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj9zp\" (UniqueName: \"kubernetes.io/projected/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-kube-api-access-jj9zp\") pod \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") "
Sep 08 00:35:59.466257 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.466171    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-webhook-cert\") pod \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\" (UID: \"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83\") "
Sep 08 00:35:59.468240 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.468207    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-kube-api-access-jj9zp" (OuterVolumeSpecName: "kube-api-access-jj9zp") pod "dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" (UID: "dce4aecd-b2f8-4c27-8da1-ac2c1db85b83"). InnerVolumeSpecName "kube-api-access-jj9zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:35:59.468240 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.468226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" (UID: "dce4aecd-b2f8-4c27-8da1-ac2c1db85b83"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:35:59.468411 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.468251    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" (UID: "dce4aecd-b2f8-4c27-8da1-ac2c1db85b83"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:35:59.567541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.567455    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-metrics-certs\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:35:59.567541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.567488    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj9zp\" (UniqueName: \"kubernetes.io/projected/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-kube-api-access-jj9zp\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:35:59.567541 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.567500    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83-webhook-cert\") on node \"ip-10-0-136-92.ec2.internal\" DevicePath \"\""
Sep 08 00:35:59.930476 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.930439    2580 generic.go:356] "Generic (PLEG): container finished" podID="dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" containerID="54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d" exitCode=0
Sep 08 00:35:59.930916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.930481    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-jmkvh"
Sep 08 00:35:59.930916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.930524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-jmkvh" event={"ID":"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83","Type":"ContainerDied","Data":"54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d"}
Sep 08 00:35:59.930916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.930576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-jmkvh" event={"ID":"dce4aecd-b2f8-4c27-8da1-ac2c1db85b83","Type":"ContainerDied","Data":"f36d29ddab27ee42f3f13b240f2a904a4eed0028ef230bf437e17104b829886b"}
Sep 08 00:35:59.930916 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.930601    2580 scope.go:117] "RemoveContainer" containerID="54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d"
Sep 08 00:35:59.939882 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.939867    2580 scope.go:117] "RemoveContainer" containerID="54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d"
Sep 08 00:35:59.940120 ip-10-0-136-92 kubenswrapper[2580]: E0908 00:35:59.940102    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d\": container with ID starting with 54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d not found: ID does not exist" containerID="54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d"
Sep 08 00:35:59.940168 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.940128    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d"} err="failed to get container status \"54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d\": rpc error: code = NotFound desc = could not find container \"54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d\": container with ID starting with 54c1218ef2fef5e16b86c17345ab547efcf631c85e2e78a4f953f222e6a9677d not found: ID does not exist"
Sep 08 00:35:59.951487 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.951456    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8686947476-jmkvh"]
Sep 08 00:35:59.953245 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:35:59.953222    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8686947476-jmkvh"]
Sep 08 00:36:00.831807 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.831767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:00.913908 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.913864    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8686947476-47kpp"]
Sep 08 00:36:00.914250 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.914237    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" containerName="manager"
Sep 08 00:36:00.914303 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.914252    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" containerName="manager"
Sep 08 00:36:00.914337 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.914317    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" containerName="manager"
Sep 08 00:36:00.918615 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.918598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:00.921421 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.921398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 00:36:00.921553 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.921444    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 00:36:00.921553 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.921462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjbp5\""
Sep 08 00:36:00.921553 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.921485    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 00:36:00.926392 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.926369    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686947476-47kpp"]
Sep 08 00:36:00.978788 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.978749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf75f\" (UniqueName: \"kubernetes.io/projected/ee02523c-0460-4120-a00a-e042deac3207-kube-api-access-pf75f\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:00.979209 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.978826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee02523c-0460-4120-a00a-e042deac3207-metrics-certs\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:00.979209 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:00.978870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee02523c-0460-4120-a00a-e042deac3207-webhook-cert\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.079954 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.079916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee02523c-0460-4120-a00a-e042deac3207-webhook-cert\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.080141 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.080011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf75f\" (UniqueName: \"kubernetes.io/projected/ee02523c-0460-4120-a00a-e042deac3207-kube-api-access-pf75f\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.080141 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.080037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee02523c-0460-4120-a00a-e042deac3207-metrics-certs\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.082560 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.082496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee02523c-0460-4120-a00a-e042deac3207-metrics-certs\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.082673 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.082605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee02523c-0460-4120-a00a-e042deac3207-webhook-cert\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.089048 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.089022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf75f\" (UniqueName: \"kubernetes.io/projected/ee02523c-0460-4120-a00a-e042deac3207-kube-api-access-pf75f\") pod \"maas-controller-8686947476-47kpp\" (UID: \"ee02523c-0460-4120-a00a-e042deac3207\") " pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.229693 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.229663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.500468 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.500431    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686947476-47kpp"]
Sep 08 00:36:01.502835 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:36:01.502806    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee02523c_0460_4120_a00a_e042deac3207.slice/crio-4e07251f5a49dd032724b7f6c373d053b0c51d91562c18fa4d098d938e35f599 WatchSource:0}: Error finding container 4e07251f5a49dd032724b7f6c373d053b0c51d91562c18fa4d098d938e35f599: Status 404 returned error can't find the container with id 4e07251f5a49dd032724b7f6c373d053b0c51d91562c18fa4d098d938e35f599
Sep 08 00:36:01.927913 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.927879    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dce4aecd-b2f8-4c27-8da1-ac2c1db85b83" path="/var/lib/kubelet/pods/dce4aecd-b2f8-4c27-8da1-ac2c1db85b83/volumes"
Sep 08 00:36:01.947376 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.947321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-47kpp" event={"ID":"ee02523c-0460-4120-a00a-e042deac3207","Type":"ContainerStarted","Data":"d2e4989bfaf3ad671b9a33e2883cbe1ca0cc02257e4b07a67a7733c58b529223"}
Sep 08 00:36:01.947556 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.947411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:01.947556 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.947436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686947476-47kpp" event={"ID":"ee02523c-0460-4120-a00a-e042deac3207","Type":"ContainerStarted","Data":"4e07251f5a49dd032724b7f6c373d053b0c51d91562c18fa4d098d938e35f599"}
Sep 08 00:36:01.963605 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:01.963556    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8686947476-47kpp" podStartSLOduration=1.666351536 podStartE2EDuration="1.963538752s" totalImagesPullingTime="297.187216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:36:01.962007211 +0000 UTC m=+2002.447435818" watchObservedRunningTime="2026-09-08 00:36:01.963538752 +0000 UTC m=+2002.448967371"
Sep 08 00:36:12.955250 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:12.955212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8686947476-47kpp"
Sep 08 00:36:34.777244 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:34.777205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:40.313496 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:36:40.313460    2580 scope.go:117] "RemoveContainer" containerID="99a8fdd9be47a11b7273c77604a48a5b0e972424ada4fbcf9da0e756c4716328"
Sep 08 00:37:20.385020 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:37:20.384913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:20.483283 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:37:20.483248    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:36.267491 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:37:36.267456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:10.273223 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:38:10.273184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:39.377445 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:38:39.377365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:40.346899 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:38:40.346864    2580 scope.go:117] "RemoveContainer" containerID="ba43b60d8baf993ba00c168a91c7518d5bd9f1d038769149e790de4cf152d43f"
Sep 08 00:38:40.355454 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:38:40.355426    2580 scope.go:117] "RemoveContainer" containerID="6d44819133e29a6f2bc377cd61f914c19a0eba9503440b5da556a7489d350460"
Sep 08 00:38:44.945303 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:38:44.945261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:12.750795 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:39:12.750756    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:13.609307 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:39:13.609276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:40:06.309049 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:06.308964    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6db78868f7-lx9n8_dd5097a4-100c-4c2b-9a2a-792afe97f265/authorino/0.log"
Sep 08 00:40:11.709539 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:11.709503    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8686947476-47kpp_ee02523c-0460-4120-a00a-e042deac3207/manager/0.log"
Sep 08 00:40:12.174860 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:12.174834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-srvgh_4b74d374-d28d-429f-86ad-8851ec50f221/copy-manifests/0.log"
Sep 08 00:40:12.180819 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:12.180795    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-srvgh_4b74d374-d28d-429f-86ad-8851ec50f221/manager/0.log"
Sep 08 00:40:12.941785 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:12.941751    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29813790-q8dsz_a2db476b-6ad0-4eb8-a6be-eeee47513ba0/cleanup/0.log"
Sep 08 00:40:13.054740 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:13.054708    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5ns54_de3b00c3-7a3c-4eb1-a89d-f6ff9dc2d258/postgres/0.log"
Sep 08 00:40:13.825703 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:13.825674    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6db78868f7-lx9n8_dd5097a4-100c-4c2b-9a2a-792afe97f265/authorino/0.log"
Sep 08 00:40:15.101622 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:15.101588    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-n8lp7_6eefd064-0ed2-4fd1-b43e-03d5086ec8b2/kube-auth-proxy/0.log"
Sep 08 00:40:15.439016 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:15.438986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rkh9c_3969be7a-7bc3-421d-8f76-2aa182fc1d56/payload-pre-processing/0.log"
Sep 08 00:40:15.551301 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:15.551270    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5fvdg_ce919e3c-7796-4faa-81b8-578bdbba2dd4/payload-processing/0.log"
Sep 08 00:40:16.247821 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:16.247790    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-v9wqd_24fde025-5f1a-4fcc-adb7-cbb0200852d7/main/0.log"
Sep 08 00:40:16.575018 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:16.574934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-d9bll_f7c51170-1057-4ee8-bf59-49c55d7514a6/main/0.log"
Sep 08 00:40:16.680812 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:16.680781    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-wqpgk_b65dca57-f1a0-43e9-ab08-6bad29fba164/main/0.log"
Sep 08 00:40:21.869228 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:21.869188    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:40:21.969429 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:21.969391    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log" limit=1024
Sep 08 00:40:25.069791 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:25.069762    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x9bsd_64d572a2-446d-4e67-9e21-8ad84a878f86/global-pull-secret-syncer/0.log"
Sep 08 00:40:25.204650 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:25.204617    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dwbtz_88d9dd4e-bfa0-434c-8331-90368393abb6/konnectivity-agent/0.log"
Sep 08 00:40:25.354621 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:25.354536    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-92.ec2.internal_06d7a19175fa2c2b715d0ca801338376/haproxy/0.log"
Sep 08 00:40:30.426216 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:30.426174    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6db78868f7-lx9n8_dd5097a4-100c-4c2b-9a2a-792afe97f265/authorino/0.log"
Sep 08 00:40:32.210747 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.210719    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c56d85f-07a9-46bd-a7ca-a03ddf1a4317/alertmanager/0.log"
Sep 08 00:40:32.265269 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.265243    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c56d85f-07a9-46bd-a7ca-a03ddf1a4317/config-reloader/0.log"
Sep 08 00:40:32.293754 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.293729    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c56d85f-07a9-46bd-a7ca-a03ddf1a4317/kube-rbac-proxy-web/0.log"
Sep 08 00:40:32.323302 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.323269    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c56d85f-07a9-46bd-a7ca-a03ddf1a4317/kube-rbac-proxy/0.log"
Sep 08 00:40:32.344356 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.344318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c56d85f-07a9-46bd-a7ca-a03ddf1a4317/kube-rbac-proxy-metric/0.log"
Sep 08 00:40:32.367566 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.367538    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c56d85f-07a9-46bd-a7ca-a03ddf1a4317/prom-label-proxy/0.log"
Sep 08 00:40:32.395263 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.395225    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c56d85f-07a9-46bd-a7ca-a03ddf1a4317/init-config-reloader/0.log"
Sep 08 00:40:32.773619 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.773584    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zx498_307db5ad-0c11-4023-b7d8-bfc3c943f201/node-exporter/0.log"
Sep 08 00:40:32.796979 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.796952    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zx498_307db5ad-0c11-4023-b7d8-bfc3c943f201/kube-rbac-proxy/0.log"
Sep 08 00:40:32.822572 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:32.822544    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zx498_307db5ad-0c11-4023-b7d8-bfc3c943f201/init-textfile/0.log"
Sep 08 00:40:33.128497 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.128411    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9b7n8_adc30c12-c088-42ed-bf61-994ead1cceb6/prometheus-operator/0.log"
Sep 08 00:40:33.147842 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.147823    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9b7n8_adc30c12-c088-42ed-bf61-994ead1cceb6/kube-rbac-proxy/0.log"
Sep 08 00:40:33.172773 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.172753    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-6bh9x_959556a9-09ec-4526-9253-4482e0f54c2f/prometheus-operator-admission-webhook/0.log"
Sep 08 00:40:33.242214 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.242193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6884dff746-42vxq_ab6405e7-87b3-41e7-9362-6cf0686623e2/telemeter-client/0.log"
Sep 08 00:40:33.263191 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.263172    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6884dff746-42vxq_ab6405e7-87b3-41e7-9362-6cf0686623e2/reload/0.log"
Sep 08 00:40:33.286276 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.286241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6884dff746-42vxq_ab6405e7-87b3-41e7-9362-6cf0686623e2/kube-rbac-proxy/0.log"
Sep 08 00:40:33.317287 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.317270    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6777c6bf8b-lzg2l_1f0c913f-f20d-4744-8d71-2124578fdf8a/thanos-query/0.log"
Sep 08 00:40:33.342396 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.342360    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6777c6bf8b-lzg2l_1f0c913f-f20d-4744-8d71-2124578fdf8a/kube-rbac-proxy-web/0.log"
Sep 08 00:40:33.363126 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.363102    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6777c6bf8b-lzg2l_1f0c913f-f20d-4744-8d71-2124578fdf8a/kube-rbac-proxy/0.log"
Sep 08 00:40:33.386228 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.386160    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6777c6bf8b-lzg2l_1f0c913f-f20d-4744-8d71-2124578fdf8a/prom-label-proxy/0.log"
Sep 08 00:40:33.430257 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.430233    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6777c6bf8b-lzg2l_1f0c913f-f20d-4744-8d71-2124578fdf8a/kube-rbac-proxy-rules/0.log"
Sep 08 00:40:33.465782 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:33.465754    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6777c6bf8b-lzg2l_1f0c913f-f20d-4744-8d71-2124578fdf8a/kube-rbac-proxy-metrics/0.log"
Sep 08 00:40:34.821023 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.820987    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"]
Sep 08 00:40:34.824700 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.824681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.826957 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.826928    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsrk2\"/\"kube-root-ca.crt\""
Sep 08 00:40:34.827519 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.827499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hsrk2\"/\"default-dockercfg-pzcbl\""
Sep 08 00:40:34.827584 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.827499    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsrk2\"/\"openshift-service-ca.crt\""
Sep 08 00:40:34.837086 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.837060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"]
Sep 08 00:40:34.894939 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.894890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsl6n\" (UniqueName: \"kubernetes.io/projected/3afec1a7-799e-434d-82d8-07ba561f2b01-kube-api-access-fsl6n\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.894939 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.894938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-proc\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.895185 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.894978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-lib-modules\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.895185 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.895025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-podres\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.895185 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.895054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-sys\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995480 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-proc\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-lib-modules\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-podres\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-proc\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-sys\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-sys\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995683 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsl6n\" (UniqueName: \"kubernetes.io/projected/3afec1a7-799e-434d-82d8-07ba561f2b01-kube-api-access-fsl6n\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995910 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995695    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-lib-modules\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:34.995910 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:34.995702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3afec1a7-799e-434d-82d8-07ba561f2b01-podres\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:35.004890 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:35.004866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsl6n\" (UniqueName: \"kubernetes.io/projected/3afec1a7-799e-434d-82d8-07ba561f2b01-kube-api-access-fsl6n\") pod \"perf-node-gather-daemonset-6c55q\" (UID: \"3afec1a7-799e-434d-82d8-07ba561f2b01\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:35.135457 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:35.135338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:35.408146 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:35.408122    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"]
Sep 08 00:40:35.410404 ip-10-0-136-92 kubenswrapper[2580]: W0908 00:40:35.410375    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3afec1a7_799e_434d_82d8_07ba561f2b01.slice/crio-ba1d09d763d463dcdd2e08594ca313d14a22fafab718242401506636e0e53b35 WatchSource:0}: Error finding container ba1d09d763d463dcdd2e08594ca313d14a22fafab718242401506636e0e53b35: Status 404 returned error can't find the container with id ba1d09d763d463dcdd2e08594ca313d14a22fafab718242401506636e0e53b35
Sep 08 00:40:35.977124 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:35.977081    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-hrpsk_48a3b35e-0bbb-41a1-8ce0-e9a3fbac34bb/download-server/0.log"
Sep 08 00:40:36.308777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:36.308665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q" event={"ID":"3afec1a7-799e-434d-82d8-07ba561f2b01","Type":"ContainerStarted","Data":"5ea412551b549b895d0d434a92e0ca3081d63fd4d75919bc4ebf95d03168c0b6"}
Sep 08 00:40:36.308777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:36.308738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:36.308777 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:36.308762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q" event={"ID":"3afec1a7-799e-434d-82d8-07ba561f2b01","Type":"ContainerStarted","Data":"ba1d09d763d463dcdd2e08594ca313d14a22fafab718242401506636e0e53b35"}
Sep 08 00:40:36.327417 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:36.327338    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q" podStartSLOduration=2.327321628 podStartE2EDuration="2.327321628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:40:36.325009261 +0000 UTC m=+2276.810437869" watchObservedRunningTime="2026-09-08 00:40:36.327321628 +0000 UTC m=+2276.812750235"
Sep 08 00:40:37.665707 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:37.665679    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4xh6w_8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2/dns/0.log"
Sep 08 00:40:37.689146 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:37.689112    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4xh6w_8c2e7745-c0d5-48f2-b5ab-d3c8794d63e2/kube-rbac-proxy/0.log"
Sep 08 00:40:37.843574 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:37.843542    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-msrxm_6bb4842c-673e-422e-abdc-d20c6a001ed3/dns-node-resolver/0.log"
Sep 08 00:40:38.550361 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:38.550303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rqzxd_3ae90b78-ddb0-4f9b-a843-eadebeaca31b/node-ca/0.log"
Sep 08 00:40:40.064016 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:40.063974    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-n8lp7_6eefd064-0ed2-4fd1-b43e-03d5086ec8b2/kube-auth-proxy/0.log"
Sep 08 00:40:40.172275 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:40.172241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rkh9c_3969be7a-7bc3-421d-8f76-2aa182fc1d56/payload-pre-processing/0.log"
Sep 08 00:40:40.226765 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:40.226734    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5fvdg_ce919e3c-7796-4faa-81b8-578bdbba2dd4/payload-processing/0.log"
Sep 08 00:40:40.390383 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:40.390269    2580 scope.go:117] "RemoveContainer" containerID="401eff8a1e00b9595b0ffe0087790725e260738c505cefb54181f1c743dd83a3"
Sep 08 00:40:40.399137 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:40.399114    2580 scope.go:117] "RemoveContainer" containerID="032cfafe548d773e4f833764a8ecd5e24eb02ae83be86eb1235a1a055963ceae"
Sep 08 00:40:41.129587 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:41.129552    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmqlw_2d3d3e1e-5b4d-4160-acf6-a962e17c4fa6/serve-healthcheck-canary/0.log"
Sep 08 00:40:41.803363 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:41.803312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v65pk_461bc645-9bf5-4a57-a82d-6dc560611057/kube-rbac-proxy/0.log"
Sep 08 00:40:41.825520 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:41.825496    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v65pk_461bc645-9bf5-4a57-a82d-6dc560611057/exporter/0.log"
Sep 08 00:40:41.846366 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:41.846326    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v65pk_461bc645-9bf5-4a57-a82d-6dc560611057/extractor/0.log"
Sep 08 00:40:42.323774 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:42.323745    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-6c55q"
Sep 08 00:40:44.360481 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:44.360437    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8686947476-47kpp_ee02523c-0460-4120-a00a-e042deac3207/manager/0.log"
Sep 08 00:40:44.786129 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:44.786097    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-srvgh_4b74d374-d28d-429f-86ad-8851ec50f221/manager/0.log"
Sep 08 00:40:44.838193 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:44.838163    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-srvgh_4b74d374-d28d-429f-86ad-8851ec50f221/copy-manifests/0.log"
Sep 08 00:40:45.657359 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:45.657312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-n8lp7_6eefd064-0ed2-4fd1-b43e-03d5086ec8b2/kube-auth-proxy/0.log"
Sep 08 00:40:45.764178 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:45.764146    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rkh9c_3969be7a-7bc3-421d-8f76-2aa182fc1d56/payload-pre-processing/0.log"
Sep 08 00:40:45.798501 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:45.798458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5fvdg_ce919e3c-7796-4faa-81b8-578bdbba2dd4/payload-processing/0.log"
Sep 08 00:40:46.337158 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:46.337077    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c54b7b87b-56t2j_2018ed44-52de-4102-a919-9bb671a399b8/manager/0.log"
Sep 08 00:40:46.390293 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:46.390260    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lncj5_49c7aeb0-34fe-40eb-875d-193177d414e4/openshift-lws-operator/0.log"
Sep 08 00:40:47.932963 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:47.932935    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-n8lp7_6eefd064-0ed2-4fd1-b43e-03d5086ec8b2/kube-auth-proxy/0.log"
Sep 08 00:40:48.037466 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:48.037381    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rkh9c_3969be7a-7bc3-421d-8f76-2aa182fc1d56/payload-pre-processing/0.log"
Sep 08 00:40:48.061626 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:48.061594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5fvdg_ce919e3c-7796-4faa-81b8-578bdbba2dd4/payload-processing/0.log"
Sep 08 00:40:53.234158 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:53.234126    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bjml_c0b01843-2b47-4d7e-918b-7344af21ff55/kube-multus-additional-cni-plugins/0.log"
Sep 08 00:40:53.256609 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:53.256584    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bjml_c0b01843-2b47-4d7e-918b-7344af21ff55/egress-router-binary-copy/0.log"
Sep 08 00:40:53.278111 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:53.278085    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bjml_c0b01843-2b47-4d7e-918b-7344af21ff55/cni-plugins/0.log"
Sep 08 00:40:53.302359 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:53.302316    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bjml_c0b01843-2b47-4d7e-918b-7344af21ff55/bond-cni-plugin/0.log"
Sep 08 00:40:53.327087 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:53.327069    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bjml_c0b01843-2b47-4d7e-918b-7344af21ff55/routeoverride-cni/0.log"
Sep 08 00:40:53.350870 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:53.350851    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bjml_c0b01843-2b47-4d7e-918b-7344af21ff55/whereabouts-cni-bincopy/0.log"
Sep 08 00:40:53.372449 ip-10-0-136-92 kubenswrapper[2580]: I0908 00:40:53.372420    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bjml_c0b01843-2b47-4d7e-918b-7344af21ff55/whereabouts-cni/0.log"