Sep 15 12:44:53.161133 ip-10-0-143-85 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 12:44:53.594021 ip-10-0-143-85 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 12:44:53.594021 ip-10-0-143-85 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 12:44:53.594021 ip-10-0-143-85 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 12:44:53.594021 ip-10-0-143-85 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 12:44:53.594021 ip-10-0-143-85 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 12:44:53.596925 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.596811    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 12:44:53.601023 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.600989    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:53.601023 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601011    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:53.601023 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601017    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:53.601023 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601022    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:53.601023 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601029    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601036    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601041    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601045    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601048    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601053    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601057    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601060    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601064    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601068    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601072    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601076    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601080    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601084    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601088    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601091    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601095    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601098    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601102    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601106    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:53.601329 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601110    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601114    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601118    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601122    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601126    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601129    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601133    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601142    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601148    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601154    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601159    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601163    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601167    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601172    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601177    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601182    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601186    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601191    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601197    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601201    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:53.602184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601205    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601209    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601214    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601218    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601222    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601227    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601231    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601235    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601240    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601244    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601248    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601252    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601257    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601262    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601266    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601270    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601275    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601279    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601283    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601287    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:53.603103 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601291    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601295    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601299    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601303    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601308    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601312    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601318    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601322    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601326    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601331    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601335    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601339    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601345    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601352    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601357    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601361    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601366    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601370    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601374    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601380    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:53.603949 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601384    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601389    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601395    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601400    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601404    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601408    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601413    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601418    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601423    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601427    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601431    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601436    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601441    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601445    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.601450    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602656    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602666    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602671    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602678    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602682    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:53.604782 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602686    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602691    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602695    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602699    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602703    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602708    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602712    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602717    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602722    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602726    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602730    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602735    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602751    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602757    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602761    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602766    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602770    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602775    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602779    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602783    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:53.605638 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602789    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602794    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602799    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602803    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602807    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602814    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602820    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602825    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602831    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602853    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602859    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602864    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602869    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602873    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602877    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602883    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602888    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602891    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602896    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:53.606296 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602900    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602905    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602909    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602914    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602918    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602922    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602928    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602932    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602937    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602941    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602946    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602950    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602954    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602958    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602963    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602967    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602972    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602976    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602980    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602985    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:53.606771 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602989    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602993    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.602997    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603006    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603012    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603017    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603022    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603027    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603032    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603036    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603040    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603045    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603049    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603053    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603057    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603062    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603066    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603071    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603076    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:53.607366 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603081    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603087    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603091    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603096    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603099    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603104    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603107    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603111    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603115    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603119    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603123    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603127    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603131    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603135    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603140    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603144    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603749    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603757    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603761    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603766    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:53.607881 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603771    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603776    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603780    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603788    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603792    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603796    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603800    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603804    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603808    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603813    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603818    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603822    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603827    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603831    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603854    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603858    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603863    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603867    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603871    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603875    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:53.608380 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603879    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603884    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603888    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603893    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603897    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603901    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603908    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603915    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603920    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603924    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603928    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603932    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603937    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603941    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603945    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603954    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603959    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603963    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603967    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603971    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:53.609092 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603976    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603980    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603984    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603989    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603993    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.603998    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604003    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604007    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604011    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604015    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604019    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604023    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604027    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604032    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604036    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604040    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604045    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604049    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604053    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:53.609665 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604058    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604062    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604067    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604071    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604075    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604080    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604084    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604088    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604093    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604097    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604101    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604105    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604110    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604114    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604118    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604122    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604130    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604134    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604138    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604145    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:53.610223 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604151    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604156    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604161    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604166    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604171    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604175    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604180    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604184    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604189    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604193    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604198    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604205    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604213    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604217    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604222    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.604227    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604337    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604388    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604399    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604406    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 12:44:53.610761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604413    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604418    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604424    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604432    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604437    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604442    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604447    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604453    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604458    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604463    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604468    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604473    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604478    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604483    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604490    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604494    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604499    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604504    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604510    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604516    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604521    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604526    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604532    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604537    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 12:44:53.611280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604544    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604550    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604555    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604560    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604566    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604571    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604576    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604581    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604586    2562 flags.go:64] FLAG: --enable-server="true"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604591    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604599    2562 flags.go:64] FLAG: --event-burst="100"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604604    2562 flags.go:64] FLAG: --event-qps="50"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604608    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604613    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604618    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604624    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604629    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604634    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604639    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604643    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604648    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604654    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604659    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604663    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604668    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 12:44:53.611908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604673    2562 flags.go:64] FLAG: --feature-gates=""
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604679    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604684    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604689    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604694    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604699    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604704    2562 flags.go:64] FLAG: --help="false"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604711    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604716    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604721    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604726    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604731    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604737    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604742    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604747    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604751    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604756    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604761    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604766    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604770    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604775    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604779    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604784    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604789    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 12:44:53.612541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604793    2562 flags.go:64] FLAG: --lock-file=""
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604797    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604802    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604807    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604816    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604821    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604826    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604831    2562 flags.go:64] FLAG: --logging-format="text"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604853    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604859    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604863    2562 flags.go:64] FLAG: --manifest-url=""
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604868    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604875    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604880    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604886    2562 flags.go:64] FLAG: --max-pods="110"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604894    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604898    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604903    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604909    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604913    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604918    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604923    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604934    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604939    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604944    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 12:44:53.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604949    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604954    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604962    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604967    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604972    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604977    2562 flags.go:64] FLAG: --port="10250"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604981    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604986    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ba7b87e94e6b7df9"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604991    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.604996    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605001    2562 flags.go:64] FLAG: --register-node="true"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605006    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605012    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605017    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605022    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605026    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605032    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605037    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605042    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605047    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605051    2562 flags.go:64] FLAG: --runonce="false"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605056    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605063    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605068    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605073    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 12:44:53.613807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605078    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605083    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605088    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605093    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605098    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605103    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605108    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605112    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605117    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605122    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605127    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605135    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605140    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605144    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605150    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605155    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605160    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605164    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605169    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605174    2562 flags.go:64] FLAG: --v="2"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605180    2562 flags.go:64] FLAG: --version="false"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605188    2562 flags.go:64] FLAG: --vmodule=""
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605195    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.605200    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605452    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:53.614433 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605459    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605463    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605468    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605473    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605479    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605484    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605488    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605495    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605500    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605505    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605509    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605513    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605517    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605522    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605526    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605530    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605534    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605539    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605543    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:53.615121 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605547    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605551    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605555    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605560    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605564    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605569    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605573    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605577    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605581    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605585    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605593    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605598    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605603    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605607    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605612    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605616    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605620    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605626    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605630    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:53.615589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605634    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605638    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605642    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605646    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605650    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605654    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605657    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605662    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605666    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605671    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605675    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605679    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605683    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605688    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605692    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605696    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605700    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605704    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605708    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605713    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:53.616081 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605717    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605721    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605725    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605729    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605735    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605739    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605743    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605747    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605751    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605755    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605763    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605767    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605771    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605776    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605780    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605784    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605788    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605793    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605796    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605801    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:53.616557 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605805    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605810    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605814    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605818    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605822    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605827    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605831    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605861    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605866    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605870    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605874    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605880    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605885    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605889    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605893    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605899    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605906    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605912    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605916    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:53.617070 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.605921    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.606868    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.614946    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.614962    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.614983    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.614989    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615048    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615054    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615058    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615061    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615065    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615069    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615072    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615076    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:53.617541 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615080    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615085    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615089    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615093    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615096    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615099    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615101    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615104    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615107    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615110    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615112    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615115    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615119    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615123    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615126    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615129    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615132    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615135    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615138    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:53.617904 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615141    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615144    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615148    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615150    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615153    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615157    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615161    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615165    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615170    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615173    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615176    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615178    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615181    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615184    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615187    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615189    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615192    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615194    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615197    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615200    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:53.618372 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615202    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615205    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615209    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615212    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615215    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615218    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615220    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615223    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615225    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615228    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615230    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615234    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615238    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615243    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615247    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615254    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615258    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615261    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615263    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:53.618924 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615266    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615268    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615271    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615274    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615277    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615280    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615283    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615286    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615288    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615291    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615293    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615296    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615298    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615301    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615304    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615307    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615309    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615312    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615316    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615321    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:53.619373 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615325    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615329    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615332    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615335    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615337    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615340    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615344    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615347    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615349    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615353    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615355    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615358    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615361    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.615367    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615491    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:53.619974 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615497    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615500    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615502    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615505    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615508    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615512    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615516    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615519    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615521    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615524    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615527    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615530    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615532    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615535    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615539    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615541    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615544    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615547    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615550    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:53.620343 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615554    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615558    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615562    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615567    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615570    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615573    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615576    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615578    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615582    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615584    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615587    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615590    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615592    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615595    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615598    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615601    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615604    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615606    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615609    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:53.620793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615611    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615615    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615618    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615621    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615623    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615627    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615631    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615636    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615640    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615644    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615647    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615650    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615652    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615654    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615657    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615659    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615663    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615665    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615668    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:53.621267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615671    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615673    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615676    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615680    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615683    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615685    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615688    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615690    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615693    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615695    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615698    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615701    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615704    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615707    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615711    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615716    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615720    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615724    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615727    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615729    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:53.621733 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615732    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615734    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615737    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615739    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615742    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615744    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615747    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615749    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615752    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615754    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615757    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615760    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615763    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615765    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615768    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615770    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615774    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615776    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615779    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615782    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:53.622224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:53.615785    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:53.622715 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.615792    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 12:44:53.622715 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.615957    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 12:44:53.724198 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.724013    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 12:44:53.725381 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.725368    2562 server.go:1019] "Starting client certificate rotation"
Sep 15 12:44:53.725495 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.725474    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 12:44:53.726339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.726328    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 12:44:53.728449 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.728435    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 12:44:53.732233 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.732201    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 12:44:53.748143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.748121    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 15 12:44:53.751622 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.751602    2562 log.go:25] "Validated CRI v1 image API"
Sep 15 12:44:53.752496 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.752457    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 12:44:53.756010 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.755981    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cee5d8dd-8bae-43a2-8a64-af4f3ebe7a87:/dev/nvme0n1p3 dda415cf-d490-44fe-85d2-214d817474aa:/dev/nvme0n1p4]
Sep 15 12:44:53.756103 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.756009    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 12:44:53.760522 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.760396    2562 manager.go:216] Machine: {Timestamp:2026-09-15 12:44:53.759802861 +0000 UTC m=+0.485664297 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098916 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb572cc502dcdc4ad6e02d9addef7 SystemUUID:ec2eb572-cc50-2dcd-c4ad-6e02d9addef7 BootID:7f55d44c-7381-41cc-a287-3dc1ef20227a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f4:07:be:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f4:07:be:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:11:d2:2f:98:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 12:44:53.760522 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.760510    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 12:44:53.760693 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.760674    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 12:44:53.763555 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.763522    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 12:44:53.763696 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.763559    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 12:44:53.764438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.764427    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 12:44:53.764473 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.764439    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 12:44:53.764473 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.764448    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 12:44:53.764473 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.764463    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 12:44:53.765667 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.765652    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 12:44:53.770351 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.770339    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 12:44:53.770642 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.770630    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 12:44:53.770684 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.770667    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 12:44:53.770684 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.770678    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 12:44:53.770747 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.770688    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 12:44:53.770747 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.770700    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 15 12:44:53.770747 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.770710    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 12:44:53.771110 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.771099    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 12:44:53.771168 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.771117    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 12:44:53.776169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.776153    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 12:44:53.779196 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.779182    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 12:44:53.779241 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.779213    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 12:44:53.782109 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782097    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 12:44:53.782143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782115    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 12:44:53.782143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782121    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 12:44:53.782143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782126    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 12:44:53.782143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782135    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 12:44:53.782143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782140    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782152    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782157    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782164    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782169    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782178    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782183    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782205    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 12:44:53.782284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.782210    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 12:44:53.786395 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.786377    2562 server.go:1268] "Started kubelet"
Sep 15 12:44:53.786649 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.786610    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 12:44:53.787056 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.787014    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 12:44:53.787111 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.787089    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 12:44:53.787441 ip-10-0-143-85 systemd[1]: Started Kubernetes Kubelet.
Sep 15 12:44:53.788966 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.788760    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 12:44:53.790720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.790704    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 12:44:53.794056 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.794036    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 12:44:53.795245 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.795228    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 12:44:53.796154 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.796137    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 12:44:53.796877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.796860    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 12:44:53.796950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.796871    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 12:44:53.797011 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.796995    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 15 12:44:53.797546 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.797523    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 12:44:53.797677 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797657    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 12:44:53.797677 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797665    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 12:44:53.797786 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797686    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 12:44:53.797786 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797704    2562 factory.go:55] Registering systemd factory
Sep 15 12:44:53.797786 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797721    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 15 12:44:53.797786 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.797699    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 12:44:53.797996 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797796    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 12:44:53.797996 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797804    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 12:44:53.797996 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797960    2562 factory.go:153] Registering CRI-O factory
Sep 15 12:44:53.797996 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.797970    2562 factory.go:223] Registration of the crio container factory successfully
Sep 15 12:44:53.797996 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.796866    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f35491df6ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.786334957 +0000 UTC m=+0.512196394,LastTimestamp:2026-09-15 12:44:53.786334957 +0000 UTC m=+0.512196394,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.798138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.798008    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 12:44:53.798138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.798023    2562 factory.go:103] Registering Raw factory
Sep 15 12:44:53.798138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.798033    2562 manager.go:1196] Started watching for new ooms in manager
Sep 15 12:44:53.798369 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.798358    2562 manager.go:349] Starting recovery of all containers
Sep 15 12:44:53.808018 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.808004    2562 manager.go:354] Recovery completed
Sep 15 12:44:53.812768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.812751    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:53.815583 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.815555    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 12:44:53.815683 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.815663    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 12:44:53.815804 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.815789    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:53.815868 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.815827    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:53.815922 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.815875    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:53.816861 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.816827    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 12:44:53.816861 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.816860    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 12:44:53.816996 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.816869    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:53.816996 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.816880    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 12:44:53.819131 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.819117    2562 policy_none.go:49] "None policy: Start"
Sep 15 12:44:53.819197 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.819135    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 12:44:53.819197 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.819149    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 12:44:53.819816 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.819800    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:53.819910 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.819831    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:53.819910 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.819866    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:53.821148 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.821136    2562 policy_none.go:47] "Start"
Sep 15 12:44:53.834690 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.834602    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354adfc68d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.815813773 +0000 UTC m=+0.541675211,LastTimestamp:2026-09-15 12:44:53.815813773 +0000 UTC m=+0.541675211,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.843856 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.843728    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354ae08ef2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.815865074 +0000 UTC m=+0.541726513,LastTimestamp:2026-09-15 12:44:53.815865074 +0000 UTC m=+0.541726513,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.850135 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.850076    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354ae0d32a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.815882538 +0000 UTC m=+0.541743976,LastTimestamp:2026-09-15 12:44:53.815882538 +0000 UTC m=+0.541743976,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.857448 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.857432    2562 manager.go:337] "Starting Device Plugin manager"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.857469    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.857479    2562 server.go:87] "Starting device plugin registration server"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.857732    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.857744    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.857871    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.857966    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.857977    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.858430    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.858481    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 15 12:44:53.878926 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.859117    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-85.ec2.internal.18d57f354adfc68d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354adfc68d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.815813773 +0000 UTC m=+0.541675211,LastTimestamp:2026-09-15 12:44:53.819816014 +0000 UTC m=+0.545677454,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.890864 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.890775    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-85.ec2.internal.18d57f354ae08ef2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354ae08ef2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.815865074 +0000 UTC m=+0.541726513,LastTimestamp:2026-09-15 12:44:53.819852186 +0000 UTC m=+0.545713623,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.891145 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.891111    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 12:44:53.892352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.892329    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 12:44:53.892422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.892391    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 12:44:53.892422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.892416    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 12:44:53.892487 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.892462    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 12:44:53.903462 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.903441    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 15 12:44:53.903900 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.903822    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-85.ec2.internal.18d57f354ae0d32a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354ae0d32a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.815882538 +0000 UTC m=+0.541743976,LastTimestamp:2026-09-15 12:44:53.819872406 +0000 UTC m=+0.545733844,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.907413 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:53.907355    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354d7f1233  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.859807795 +0000 UTC m=+0.585669223,LastTimestamp:2026-09-15 12:44:53.859807795 +0000 UTC m=+0.585669223,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:53.941421 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.941393    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvbxk"
Sep 15 12:44:53.958469 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.958447    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:53.960024 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.960007    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:53.960129 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.960042    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:53.960129 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.960056    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:53.960129 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.960087    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:53.979768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.979738    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvbxk"
Sep 15 12:44:53.993119 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.993091    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"]
Sep 15 12:44:53.993228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.993167    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:53.994796 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.994779    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:53.994921 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.994813    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:53.994921 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.994827    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:53.997150 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997136    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:53.997280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:53.997333 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997285    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:53.997922 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997902    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:53.997922 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997909    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:53.998033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997927    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:53.998033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997936    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:53.998033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997952    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:53.998033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.997939    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:53.998148 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.998128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:53.998180 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.998156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:53.998212 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:53.998181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fd76400f9433d06743f51faa0c5dcb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-85.ec2.internal\" (UID: \"d8fd76400f9433d06743f51faa0c5dcb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:54.000271 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:54.000257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:54.000372 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:54.000281    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:54.001045 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:54.001032    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:54.001125 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:54.001058    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:54.001125 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:54.001071    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:54.021955 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:54.021867    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-85.ec2.internal.18d57f354adfc68d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d57f354adfc68d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-15 12:44:53.815813773 +0000 UTC m=+0.541675211,LastTimestamp:2026-09-15 12:44:53.960024289 +0000 UTC m=+0.685885728,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 15 12:44:54.022420 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:54.022406    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-85.ec2.internal\" not found" node="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:54.025906 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:54.025889    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-85.ec2.internal\" not found" node="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:54.068632 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:54.068602    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-85.ec2.internal\" not found" node="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.455776 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:55.455756    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-85.ec2.internal\" not found" node="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.462215 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.462159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.462215 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.462204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.462341 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.462231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fd76400f9433d06743f51faa0c5dcb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-85.ec2.internal\" (UID: \"d8fd76400f9433d06743f51faa0c5dcb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.462341 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.462273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.462341 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.462286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.462341 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.462287    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fd76400f9433d06743f51faa0c5dcb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-85.ec2.internal\" (UID: \"d8fd76400f9433d06743f51faa0c5dcb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.656826 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.656793    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.658376 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.658356    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.658482 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.658389    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.658482 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.658399    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.658482 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.658425    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.673462 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.673444    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.673535 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:55.673465    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-85.ec2.internal\": node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 15 12:44:55.688203 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.688187    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.691304 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:55.691287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:55.723208 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:55.723131    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 15 12:44:55.823743 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:55.823712    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 15 12:44:55.924254 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:55.924217    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 15 12:44:56.024820 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.024732    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 15 12:44:56.066924 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.066895    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:56.069347 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.069330    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:56.088430 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.088401    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 12:44:56.088567 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.088547    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 12:44:56.088606 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.088579    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 12:44:56.134509 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.134484    2562 apiserver.go:52] "Watching apiserver"
Sep 15 12:44:56.154045 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.154022    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 12:44:56.154409 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.154390    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-x4ztz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42","openshift-dns/node-resolver-qq2q2","openshift-image-registry/node-ca-h6r25","openshift-multus/multus-additional-cni-plugins-gcqmb","openshift-multus/multus-sn2b9","openshift-multus/network-metrics-daemon-45pmz","openshift-network-diagnostics/network-check-target-fbt6z","kube-system/konnectivity-agent-b6z56","openshift-cluster-node-tuning-operator/tuned-2blth","openshift-network-operator/iptables-alerter-m244f","openshift-ovn-kubernetes/ovnkube-node-qtgfv"]
Sep 15 12:44:56.156716 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.156698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.156803 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.156782    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:44:56.158927 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.158908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.159716 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.159699    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 12:44:56.161001 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.160983    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:56.161123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.161108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.163220 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.163202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.163817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.163796    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 12:44:56.163911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.163796    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 12:44:56.163911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.163872    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 12:44:56.164911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.164885    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 12:44:56.164911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.164902    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ht57z\""
Sep 15 12:44:56.165062 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.164947    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 12:44:56.165062 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.164989    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5wxm2\""
Sep 15 12:44:56.165174 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rhqp\" (UniqueName: \"kubernetes.io/projected/ebdf428a-ff17-4bba-a692-f9d171fa14ec-kube-api-access-7rhqp\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.165228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-serviceca\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.165228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mx4m\" (UniqueName: \"kubernetes.io/projected/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-kube-api-access-2mx4m\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.165326 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-registration-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.165326 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.165422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xpjx\" (UniqueName: \"kubernetes.io/projected/8a335817-6c95-4c1d-8b71-96ba45d0ed76-kube-api-access-4xpjx\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.165422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a495889-b555-4136-8810-50a9f9321749-kubelet-config\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.165422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a495889-b555-4136-8810-50a9f9321749-dbus\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.165422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebdf428a-ff17-4bba-a692-f9d171fa14ec-hosts-file\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.165422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdf428a-ff17-4bba-a692-f9d171fa14ec-tmp-dir\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.165638 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-host\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.165638 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.165638 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.165638 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-socket-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.165638 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-device-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.165638 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-sys-fs\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.165638 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.165611    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.166169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.166150    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 12:44:56.167645 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.167627    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.168527 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168506    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 12:44:56.168613 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168551    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 12:44:56.168707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168614    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s2qj4\""
Sep 15 12:44:56.168707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168554    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 12:44:56.168707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168615    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xhg62\""
Sep 15 12:44:56.168707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168557    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 12:44:56.168707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168666    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 12:44:56.168877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.168737    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 12:44:56.169275 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.169261    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 12:44:56.169843 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.169828    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:56.169933 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.169895    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:44:56.172755 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.172732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:44:56.173013 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.172946    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:44:56.173132 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.173115    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 12:44:56.175423 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.175325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.175423 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.175392    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j58xz\""
Sep 15 12:44:56.175889 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.175869    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:56.176156 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.176133    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 12:44:56.176259 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.176227    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 15 12:44:56.177956 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.177938    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.178502 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.178486    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7q469\""
Sep 15 12:44:56.178726 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.178711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 12:44:56.178768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.178728    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 12:44:56.180385 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.180333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.180688 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.180667    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svzkg\""
Sep 15 12:44:56.180861 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.180842    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 12:44:56.181558 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.181542    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 12:44:56.182768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.182752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"]
Sep 15 12:44:56.182846 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.182813    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 12:44:56.182900 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.182859    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.182949 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.182898    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 12:44:56.183202 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.183020    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qxfgb\""
Sep 15 12:44:56.183202 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.183206    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 12:44:56.184664 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.184648    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 12:44:56.189441 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.189423    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 12:44:56.190911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.190730    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 12:44:56.190911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.190743    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 12:44:56.190911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.190799    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 12:44:56.190911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.190807    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 12:44:56.190911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.190814    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 12:44:56.190911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.190856    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lwv27\""
Sep 15 12:44:56.191693 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.191680    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 12:44:56.191890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.191875    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"]
Sep 15 12:44:56.220459 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.220440    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sstkn"
Sep 15 12:44:56.234686 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.234666    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sstkn"
Sep 15 12:44:56.261569 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.261542    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 12:44:56.266083 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-device-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.266181 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-sys-fs\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.266181 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q62v\" (UniqueName: \"kubernetes.io/projected/34f67a37-352d-4025-88fe-682ad24dc5a6-kube-api-access-4q62v\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.266181 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovnkube-config\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.266181 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266170    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-device-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.266339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-host-slash\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.266339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xpjx\" (UniqueName: \"kubernetes.io/projected/8a335817-6c95-4c1d-8b71-96ba45d0ed76-kube-api-access-4xpjx\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.266339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cnibin\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.266339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.266339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-cni-multus\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.266339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-sys-fs\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.266339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebdf428a-ff17-4bba-a692-f9d171fa14ec-hosts-file\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-cni-bin\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebdf428a-ff17-4bba-a692-f9d171fa14ec-hosts-file\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-kubelet\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-var-lib-kubelet\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-socket-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-k8s-cni-cncf-io\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-slash\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.266608    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:56.266646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-run-netns\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266647    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-socket-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.266660    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret podName:4a495889-b555-4136-8810-50a9f9321749 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:56.766644969 +0000 UTC m=+2.129376551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret") pod "global-pull-secret-syncer-x4ztz" (UID: "4a495889-b555-4136-8810-50a9f9321749") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-ovn\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-systemd-units\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-env-overrides\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-netns\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-tmp\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-node-log\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-cni-bin\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovnkube-script-lib\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a495889-b555-4136-8810-50a9f9321749-dbus\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.266994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdf428a-ff17-4bba-a692-f9d171fa14ec-tmp-dir\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-cnibin\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-conf-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a495889-b555-4136-8810-50a9f9321749-dbus\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-system-cni-dir\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-modprobe-d\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysctl-conf\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-tuned\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-host\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rhqp\" (UniqueName: \"kubernetes.io/projected/ebdf428a-ff17-4bba-a692-f9d171fa14ec-kube-api-access-7rhqp\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdf428a-ff17-4bba-a692-f9d171fa14ec-tmp-dir\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-cni-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-host\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7wfm\" (UniqueName: \"kubernetes.io/projected/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-kube-api-access-q7wfm\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.267736 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-kubelet\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-systemd\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-etc-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-serviceca\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mx4m\" (UniqueName: \"kubernetes.io/projected/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-kube-api-access-2mx4m\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-registration-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34f67a37-352d-4025-88fe-682ad24dc5a6-cni-binary-copy\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysctl-d\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-862wj\" (UniqueName: \"kubernetes.io/projected/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-kube-api-access-862wj\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-registration-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-systemd\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-host\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-var-lib-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-cni-netd\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysconfig\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-etc-kubernetes\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.268438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2011e93e-12ec-41e0-98a9-a8bdec2421f3-konnectivity-ca\") pod \"konnectivity-agent-b6z56\" (UID: \"2011e93e-12ec-41e0-98a9-a8bdec2421f3\") " pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-log-socket\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-serviceca\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-socket-dir-parent\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a335817-6c95-4c1d-8b71-96ba45d0ed76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtcjl\" (UniqueName: \"kubernetes.io/projected/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-kube-api-access-mtcjl\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-iptables-alerter-script\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5f5n\" (UniqueName: \"kubernetes.io/projected/8981f791-5aeb-4ac2-a44b-a78924e14068-kube-api-access-g5f5n\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-sys\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovn-node-metrics-cert\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-system-cni-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.267999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-hostroot\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-multus-certs\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2011e93e-12ec-41e0-98a9-a8bdec2421f3-agent-certs\") pod \"konnectivity-agent-b6z56\" (UID: \"2011e93e-12ec-41e0-98a9-a8bdec2421f3\") " pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.268931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268060    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km94r\" (UniqueName: \"kubernetes.io/projected/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-kube-api-access-km94r\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.269405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-lib-modules\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.269405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a495889-b555-4136-8810-50a9f9321749-kubelet-config\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.269405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-daemon-config\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.269405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a495889-b555-4136-8810-50a9f9321749-kubelet-config\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.269405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:56.269405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-kubernetes\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.269405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.268253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-run\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.275110 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.275047    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 12:44:56.278828 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.278805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rhqp\" (UniqueName: \"kubernetes.io/projected/ebdf428a-ff17-4bba-a692-f9d171fa14ec-kube-api-access-7rhqp\") pod \"node-resolver-qq2q2\" (UID: \"ebdf428a-ff17-4bba-a692-f9d171fa14ec\") " pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.278828 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.278823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xpjx\" (UniqueName: \"kubernetes.io/projected/8a335817-6c95-4c1d-8b71-96ba45d0ed76-kube-api-access-4xpjx\") pod \"aws-ebs-csi-driver-node-nfz42\" (UID: \"8a335817-6c95-4c1d-8b71-96ba45d0ed76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.278952 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.278810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mx4m\" (UniqueName: \"kubernetes.io/projected/307a6080-bd75-4ed9-83c5-a4fb4b919a7d-kube-api-access-2mx4m\") pod \"node-ca-h6r25\" (UID: \"307a6080-bd75-4ed9-83c5-a4fb4b919a7d\") " pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.331267 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.331229    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8fd76400f9433d06743f51faa0c5dcb.slice/crio-87a3ca714112cddcfacec28933cedf12a4f9d86dee622641c9988dd6eaadee0c WatchSource:0}: Error finding container 87a3ca714112cddcfacec28933cedf12a4f9d86dee622641c9988dd6eaadee0c: Status 404 returned error can't find the container with id 87a3ca714112cddcfacec28933cedf12a4f9d86dee622641c9988dd6eaadee0c
Sep 15 12:44:56.331476 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.331456    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd79124a262d4d1f4b0672083ba4d2cd.slice/crio-5cbe1bf95b820135c488b155cb80d09a8bbcef405480b34fa6b1e3e130a0a278 WatchSource:0}: Error finding container 5cbe1bf95b820135c488b155cb80d09a8bbcef405480b34fa6b1e3e130a0a278: Status 404 returned error can't find the container with id 5cbe1bf95b820135c488b155cb80d09a8bbcef405480b34fa6b1e3e130a0a278
Sep 15 12:44:56.335731 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.335713    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:44:56.347778 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.347726    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 12:39:55 +0000 UTC" deadline="2028-04-06 12:01:05.247648238 +0000 UTC"
Sep 15 12:44:56.347865 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.347778    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13655h16m8.899873684s"
Sep 15 12:44:56.369253 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2011e93e-12ec-41e0-98a9-a8bdec2421f3-konnectivity-ca\") pod \"konnectivity-agent-b6z56\" (UID: \"2011e93e-12ec-41e0-98a9-a8bdec2421f3\") " pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.369382 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-log-socket\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.369382 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-socket-dir-parent\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.369382 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtcjl\" (UniqueName: \"kubernetes.io/projected/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-kube-api-access-mtcjl\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.369382 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369352    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-log-socket\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-socket-dir-parent\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-iptables-alerter-script\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5f5n\" (UniqueName: \"kubernetes.io/projected/8981f791-5aeb-4ac2-a44b-a78924e14068-kube-api-access-g5f5n\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-sys\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovn-node-metrics-cert\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-system-cni-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-hostroot\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-multus-certs\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.369600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2011e93e-12ec-41e0-98a9-a8bdec2421f3-agent-certs\") pod \"konnectivity-agent-b6z56\" (UID: \"2011e93e-12ec-41e0-98a9-a8bdec2421f3\") " pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km94r\" (UniqueName: \"kubernetes.io/projected/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-kube-api-access-km94r\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-system-cni-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-lib-modules\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-hostroot\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-sys\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-daemon-config\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-kubernetes\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-run\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q62v\" (UniqueName: \"kubernetes.io/projected/34f67a37-352d-4025-88fe-682ad24dc5a6-kube-api-access-4q62v\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-multus-certs\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovnkube-config\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-host-slash\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cnibin\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2011e93e-12ec-41e0-98a9-a8bdec2421f3-konnectivity-ca\") pod \"konnectivity-agent-b6z56\" (UID: \"2011e93e-12ec-41e0-98a9-a8bdec2421f3\") " pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.370123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.369933    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-lib-modules\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cnibin\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-kubernetes\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-host-slash\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-cni-multus\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370064    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-run\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-iptables-alerter-script\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-cni-bin\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-kubelet\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-var-lib-kubelet\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370263    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-cni-bin\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-k8s-cni-cncf-io\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-var-lib-kubelet\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-slash\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.370390    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-run-netns\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-ovn\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.370950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-systemd-units\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370583    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-k8s-cni-cncf-io\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370620    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-cni-multus\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370623    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-daemon-config\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370641    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovnkube-config\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-env-overrides\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.370683    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs podName:8981f791-5aeb-4ac2-a44b-a78924e14068 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:56.870665176 +0000 UTC m=+2.233396758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs") pod "network-metrics-daemon-45pmz" (UID: "8981f791-5aeb-4ac2-a44b-a78924e14068") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-run-netns\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-var-lib-kubelet\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370711    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-netns\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370729    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-ovn\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.371817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-tmp\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-node-log\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370782    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-slash\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-cni-bin\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370817    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-node-log\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-systemd-units\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovnkube-script-lib\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-cni-bin\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-cnibin\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-host-run-netns\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-conf-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-env-overrides\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-cnibin\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.370957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-conf-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-system-cni-dir\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-modprobe-d\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-system-cni-dir\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysctl-conf\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-tuned\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-cni-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7wfm\" (UniqueName: \"kubernetes.io/projected/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-kube-api-access-q7wfm\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-kubelet\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-systemd\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysctl-conf\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-etc-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-modprobe-d\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34f67a37-352d-4025-88fe-682ad24dc5a6-cni-binary-copy\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371389    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-etc-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysctl-d\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-862wj\" (UniqueName: \"kubernetes.io/projected/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-kube-api-access-862wj\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-systemd\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.372986 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-host\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-var-lib-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovnkube-script-lib\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371585    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-cni-netd\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysconfig\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371638    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-cni-netd\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysctl-d\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-etc-kubernetes\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371700    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-systemd\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-etc-kubernetes\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-host\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371767    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-sysconfig\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-var-lib-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-host-kubelet\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371846    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-systemd\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34f67a37-352d-4025-88fe-682ad24dc5a6-multus-cni-dir\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371858    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-run-openvswitch\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.371960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34f67a37-352d-4025-88fe-682ad24dc5a6-cni-binary-copy\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.373939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.372442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-ovn-node-metrics-cert\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.373939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.372548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2011e93e-12ec-41e0-98a9-a8bdec2421f3-agent-certs\") pod \"konnectivity-agent-b6z56\" (UID: \"2011e93e-12ec-41e0-98a9-a8bdec2421f3\") " pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.373939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.373359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-etc-tuned\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.373939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.373427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-tmp\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.382111 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.382092    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:44:56.382111 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.382111    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:44:56.382253 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.382121    2562 projected.go:196] Error preparing data for projected volume kube-api-access-f4s77 for pod openshift-network-diagnostics/network-check-target-fbt6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:56.382253 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.382177    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77 podName:8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a nodeName:}" failed. No retries permitted until 2026-09-15 12:44:56.882163556 +0000 UTC m=+2.244895136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s77" (UniqueName: "kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77") pod "network-check-target-fbt6z" (UID: "8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:56.383746 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.383718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5f5n\" (UniqueName: \"kubernetes.io/projected/8981f791-5aeb-4ac2-a44b-a78924e14068-kube-api-access-g5f5n\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:56.384021 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.383988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q62v\" (UniqueName: \"kubernetes.io/projected/34f67a37-352d-4025-88fe-682ad24dc5a6-kube-api-access-4q62v\") pod \"multus-sn2b9\" (UID: \"34f67a37-352d-4025-88fe-682ad24dc5a6\") " pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.384090 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.384058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtcjl\" (UniqueName: \"kubernetes.io/projected/37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25-kube-api-access-mtcjl\") pod \"iptables-alerter-m244f\" (UID: \"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25\") " pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.384822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.384803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km94r\" (UniqueName: \"kubernetes.io/projected/c75e3fc2-378d-4bfd-80f2-bbdf01206c71-kube-api-access-km94r\") pod \"multus-additional-cni-plugins-gcqmb\" (UID: \"c75e3fc2-378d-4bfd-80f2-bbdf01206c71\") " pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.385280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.385264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7wfm\" (UniqueName: \"kubernetes.io/projected/f462ce1e-21c0-4f53-aed4-7c7e0f223c35-kube-api-access-q7wfm\") pod \"tuned-2blth\" (UID: \"f462ce1e-21c0-4f53-aed4-7c7e0f223c35\") " pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.385347 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.385305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-862wj\" (UniqueName: \"kubernetes.io/projected/614d58f9-3b8a-4a06-9eae-a294ff8ffa01-kube-api-access-862wj\") pod \"ovnkube-node-qtgfv\" (UID: \"614d58f9-3b8a-4a06-9eae-a294ff8ffa01\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.488450 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.488420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42"
Sep 15 12:44:56.498242 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.498218    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a335817_6c95_4c1d_8b71_96ba45d0ed76.slice/crio-043763fbc511dc36d826d65193ae33033aeb556101c1f8e41ba62e2c56943521 WatchSource:0}: Error finding container 043763fbc511dc36d826d65193ae33033aeb556101c1f8e41ba62e2c56943521: Status 404 returned error can't find the container with id 043763fbc511dc36d826d65193ae33033aeb556101c1f8e41ba62e2c56943521
Sep 15 12:44:56.506583 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.506560    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qq2q2"
Sep 15 12:44:56.511510 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.511490    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6r25"
Sep 15 12:44:56.514870 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.514845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdf428a_ff17_4bba_a692_f9d171fa14ec.slice/crio-8f5d51b6dd44441f39337deac674f1a2d1f824a3f7e87b9542145deb3a4b1913 WatchSource:0}: Error finding container 8f5d51b6dd44441f39337deac674f1a2d1f824a3f7e87b9542145deb3a4b1913: Status 404 returned error can't find the container with id 8f5d51b6dd44441f39337deac674f1a2d1f824a3f7e87b9542145deb3a4b1913
Sep 15 12:44:56.519579 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.519554    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307a6080_bd75_4ed9_83c5_a4fb4b919a7d.slice/crio-48459b67431ecd4dd97331f844b64ca09c6c8dc415c920a0cfaea1ddc0a0ec89 WatchSource:0}: Error finding container 48459b67431ecd4dd97331f844b64ca09c6c8dc415c920a0cfaea1ddc0a0ec89: Status 404 returned error can't find the container with id 48459b67431ecd4dd97331f844b64ca09c6c8dc415c920a0cfaea1ddc0a0ec89
Sep 15 12:44:56.521201 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.521184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcqmb"
Sep 15 12:44:56.529676 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.529651    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75e3fc2_378d_4bfd_80f2_bbdf01206c71.slice/crio-352304d476f2ad46e686a21a20d6f104d82aeee26ea8de67075d47fa6e8dc436 WatchSource:0}: Error finding container 352304d476f2ad46e686a21a20d6f104d82aeee26ea8de67075d47fa6e8dc436: Status 404 returned error can't find the container with id 352304d476f2ad46e686a21a20d6f104d82aeee26ea8de67075d47fa6e8dc436
Sep 15 12:44:56.554979 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.554942    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sn2b9"
Sep 15 12:44:56.561011 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.560993    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:44:56.563064 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.563034    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f67a37_352d_4025_88fe_682ad24dc5a6.slice/crio-867da9e8575731e7d845c6521bde9cf8ec17370569b4cbb33f5312b4b2a2be41 WatchSource:0}: Error finding container 867da9e8575731e7d845c6521bde9cf8ec17370569b4cbb33f5312b4b2a2be41: Status 404 returned error can't find the container with id 867da9e8575731e7d845c6521bde9cf8ec17370569b4cbb33f5312b4b2a2be41
Sep 15 12:44:56.568982 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.568949    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2011e93e_12ec_41e0_98a9_a8bdec2421f3.slice/crio-f26993a68b585ca098d5c07879a71300ee5aa21e799c7b80ce1f40352b855192 WatchSource:0}: Error finding container f26993a68b585ca098d5c07879a71300ee5aa21e799c7b80ce1f40352b855192: Status 404 returned error can't find the container with id f26993a68b585ca098d5c07879a71300ee5aa21e799c7b80ce1f40352b855192
Sep 15 12:44:56.575933 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.575917    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:56.602525 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.602501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2blth"
Sep 15 12:44:56.611588 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.611567    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf462ce1e_21c0_4f53_aed4_7c7e0f223c35.slice/crio-a42762473a87e9f49d9ae2f0854e8a13114a3e646e2732de7ea56b7523c5f74e WatchSource:0}: Error finding container a42762473a87e9f49d9ae2f0854e8a13114a3e646e2732de7ea56b7523c5f74e: Status 404 returned error can't find the container with id a42762473a87e9f49d9ae2f0854e8a13114a3e646e2732de7ea56b7523c5f74e
Sep 15 12:44:56.627343 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.627325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m244f"
Sep 15 12:44:56.632338 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.632321    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:44:56.635571 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.635552    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d6a5c0_7fbe_4e6a_a60a_3dc24f5b7e25.slice/crio-bb121eaded99899f88d6b9571cbda742c770ee413525d7534353a69382a8f787 WatchSource:0}: Error finding container bb121eaded99899f88d6b9571cbda742c770ee413525d7534353a69382a8f787: Status 404 returned error can't find the container with id bb121eaded99899f88d6b9571cbda742c770ee413525d7534353a69382a8f787
Sep 15 12:44:56.640531 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:44:56.640508    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614d58f9_3b8a_4a06_9eae_a294ff8ffa01.slice/crio-3e93cfffdcd56d22f67c5031275726244575db4292d05c81e2d76c899960dbdc WatchSource:0}: Error finding container 3e93cfffdcd56d22f67c5031275726244575db4292d05c81e2d76c899960dbdc: Status 404 returned error can't find the container with id 3e93cfffdcd56d22f67c5031275726244575db4292d05c81e2d76c899960dbdc
Sep 15 12:44:56.774626 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.774587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:56.774798 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.774774    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:56.774859 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.774854    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret podName:4a495889-b555-4136-8810-50a9f9321749 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:57.774823225 +0000 UTC m=+3.137554817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret") pod "global-pull-secret-syncer-x4ztz" (UID: "4a495889-b555-4136-8810-50a9f9321749") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:56.875420 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.875324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:56.875577 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.875515    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:56.875633 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.875593    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs podName:8981f791-5aeb-4ac2-a44b-a78924e14068 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:57.875573865 +0000 UTC m=+3.238305443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs") pod "network-metrics-daemon-45pmz" (UID: "8981f791-5aeb-4ac2-a44b-a78924e14068") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:56.975912 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:56.975872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:44:56.976141 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.976091    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:44:56.976141 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.976111    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:44:56.976141 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.976123    2562 projected.go:196] Error preparing data for projected volume kube-api-access-f4s77 for pod openshift-network-diagnostics/network-check-target-fbt6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:56.976266 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:56.976184    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77 podName:8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a nodeName:}" failed. No retries permitted until 2026-09-15 12:44:57.976165381 +0000 UTC m=+3.338896963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s77" (UniqueName: "kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77") pod "network-check-target-fbt6z" (UID: "8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:57.237851 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.237623    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:39:56 +0000 UTC" deadline="2028-06-08 10:18:19.619834324 +0000 UTC"
Sep 15 12:44:57.237851 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.237685    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15165h33m22.382153732s"
Sep 15 12:44:57.258995 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.258954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:44:57.259151 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.259088    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:44:57.259528 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.259509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:57.259638 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.259619    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:44:57.272344 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.272293    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m244f" event={"ID":"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25","Type":"ContainerStarted","Data":"bb121eaded99899f88d6b9571cbda742c770ee413525d7534353a69382a8f787"}
Sep 15 12:44:57.274367 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.274328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerStarted","Data":"352304d476f2ad46e686a21a20d6f104d82aeee26ea8de67075d47fa6e8dc436"}
Sep 15 12:44:57.281918 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.281887    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42" event={"ID":"8a335817-6c95-4c1d-8b71-96ba45d0ed76","Type":"ContainerStarted","Data":"043763fbc511dc36d826d65193ae33033aeb556101c1f8e41ba62e2c56943521"}
Sep 15 12:44:57.283771 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.283743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" event={"ID":"cd79124a262d4d1f4b0672083ba4d2cd","Type":"ContainerStarted","Data":"5cbe1bf95b820135c488b155cb80d09a8bbcef405480b34fa6b1e3e130a0a278"}
Sep 15 12:44:57.288234 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.288208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal" event={"ID":"d8fd76400f9433d06743f51faa0c5dcb","Type":"ContainerStarted","Data":"87a3ca714112cddcfacec28933cedf12a4f9d86dee622641c9988dd6eaadee0c"}
Sep 15 12:44:57.291027 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.291003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"3e93cfffdcd56d22f67c5031275726244575db4292d05c81e2d76c899960dbdc"}
Sep 15 12:44:57.295634 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.295599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2blth" event={"ID":"f462ce1e-21c0-4f53-aed4-7c7e0f223c35","Type":"ContainerStarted","Data":"a42762473a87e9f49d9ae2f0854e8a13114a3e646e2732de7ea56b7523c5f74e"}
Sep 15 12:44:57.298548 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.298528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b6z56" event={"ID":"2011e93e-12ec-41e0-98a9-a8bdec2421f3","Type":"ContainerStarted","Data":"f26993a68b585ca098d5c07879a71300ee5aa21e799c7b80ce1f40352b855192"}
Sep 15 12:44:57.301690 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.301665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sn2b9" event={"ID":"34f67a37-352d-4025-88fe-682ad24dc5a6","Type":"ContainerStarted","Data":"867da9e8575731e7d845c6521bde9cf8ec17370569b4cbb33f5312b4b2a2be41"}
Sep 15 12:44:57.304960 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.304936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6r25" event={"ID":"307a6080-bd75-4ed9-83c5-a4fb4b919a7d","Type":"ContainerStarted","Data":"48459b67431ecd4dd97331f844b64ca09c6c8dc415c920a0cfaea1ddc0a0ec89"}
Sep 15 12:44:57.307488 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.307462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qq2q2" event={"ID":"ebdf428a-ff17-4bba-a692-f9d171fa14ec","Type":"ContainerStarted","Data":"8f5d51b6dd44441f39337deac674f1a2d1f824a3f7e87b9542145deb3a4b1913"}
Sep 15 12:44:57.721504 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.721362    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:57.783581 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.783548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:57.783747 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.783723    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:57.783828 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.783782    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret podName:4a495889-b555-4136-8810-50a9f9321749 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:59.783764291 +0000 UTC m=+5.146495875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret") pod "global-pull-secret-syncer-x4ztz" (UID: "4a495889-b555-4136-8810-50a9f9321749") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:57.810587 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.810378    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:57.883944 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.883914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:57.884133 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.884066    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:57.884133 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.884130    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs podName:8981f791-5aeb-4ac2-a44b-a78924e14068 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:59.884110614 +0000 UTC m=+5.246842213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs") pod "network-metrics-daemon-45pmz" (UID: "8981f791-5aeb-4ac2-a44b-a78924e14068") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:57.985360 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:57.985057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:44:57.985360 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.985263    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:44:57.985360 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.985283    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:44:57.985360 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.985296    2562 projected.go:196] Error preparing data for projected volume kube-api-access-f4s77 for pod openshift-network-diagnostics/network-check-target-fbt6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:57.985360 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:57.985359    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77 podName:8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a nodeName:}" failed. No retries permitted until 2026-09-15 12:44:59.985340074 +0000 UTC m=+5.348071652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s77" (UniqueName: "kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77") pod "network-check-target-fbt6z" (UID: "8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:58.237952 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:58.237833    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:39:56 +0000 UTC" deadline="2028-02-21 23:28:05.454123915 +0000 UTC"
Sep 15 12:44:58.237952 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:58.237874    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12586h43m7.216254262s"
Sep 15 12:44:58.256177 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:58.256142    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:58.256349 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:58.256289    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:44:59.259010 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:59.258978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:44:59.259437 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:59.259101    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:44:59.259512 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:59.259494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:59.259653 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:59.259589    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:44:59.800890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:59.800837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:44:59.801067 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:59.801024    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:59.801146 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:59.801098    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret podName:4a495889-b555-4136-8810-50a9f9321749 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:03.801077329 +0000 UTC m=+9.163808920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret") pod "global-pull-secret-syncer-x4ztz" (UID: "4a495889-b555-4136-8810-50a9f9321749") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:59.901686 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:44:59.901648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:44:59.901884 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:59.901859    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:59.901954 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:44:59.901923    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs podName:8981f791-5aeb-4ac2-a44b-a78924e14068 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:03.901905601 +0000 UTC m=+9.264637193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs") pod "network-metrics-daemon-45pmz" (UID: "8981f791-5aeb-4ac2-a44b-a78924e14068") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:00.002158 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:00.002073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:00.002337 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:00.002258    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:00.002337 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:00.002277    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:00.002337 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:00.002290    2562 projected.go:196] Error preparing data for projected volume kube-api-access-f4s77 for pod openshift-network-diagnostics/network-check-target-fbt6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:00.002493 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:00.002352    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77 podName:8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a nodeName:}" failed. No retries permitted until 2026-09-15 12:45:04.002333081 +0000 UTC m=+9.365064662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s77" (UniqueName: "kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77") pod "network-check-target-fbt6z" (UID: "8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:00.256288 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:00.256202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:00.256455 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:00.256346    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:01.256932 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:01.256290    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:01.256932 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:01.256442    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:01.256932 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:01.256800    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:01.256932 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:01.256893    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:02.256778 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:02.256747    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:02.256952 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:02.256853    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:03.256357 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:03.256313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:03.256549 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:03.256448    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:03.256549 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:03.256534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:03.256671 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:03.256649    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:03.834892 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:03.834848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:03.835503 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:03.835012    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:03.835503 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:03.835078    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret podName:4a495889-b555-4136-8810-50a9f9321749 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:11.835063064 +0000 UTC m=+17.197794641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret") pod "global-pull-secret-syncer-x4ztz" (UID: "4a495889-b555-4136-8810-50a9f9321749") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:03.935412 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:03.935320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:03.935562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:03.935503    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:03.935612 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:03.935569    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs podName:8981f791-5aeb-4ac2-a44b-a78924e14068 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:11.935550167 +0000 UTC m=+17.298281765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs") pod "network-metrics-daemon-45pmz" (UID: "8981f791-5aeb-4ac2-a44b-a78924e14068") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:04.035866 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:04.035790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:04.036061 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:04.035997    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:04.036061 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:04.036028    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:04.036061 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:04.036041    2562 projected.go:196] Error preparing data for projected volume kube-api-access-f4s77 for pod openshift-network-diagnostics/network-check-target-fbt6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:04.036199 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:04.036093    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77 podName:8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a nodeName:}" failed. No retries permitted until 2026-09-15 12:45:12.036079571 +0000 UTC m=+17.398811147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s77" (UniqueName: "kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77") pod "network-check-target-fbt6z" (UID: "8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:04.256577 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:04.256036    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:04.256577 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:04.256163    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:05.257202 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:05.257170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:05.257671 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:05.257263    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:05.257671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:05.257416    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:05.257671 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:05.257511    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:06.256749 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:06.256710    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:06.256915 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:06.256853    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:07.259338 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:07.259304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:07.259848 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:07.259441    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:07.259848 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:07.259494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:07.259848 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:07.259595    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:08.256280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:08.256244    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:08.256463 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:08.256356    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:09.258890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:09.258861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:09.258890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:09.258877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:09.259355 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:09.258984    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:09.259355 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:09.259120    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:10.256657 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:10.256622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:10.256832 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:10.256741    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:11.259081 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:11.259011    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:11.259081 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:11.259026    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:11.259488 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:11.259116    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:11.259488 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:11.259256    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:11.894207 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:11.894175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:11.894435 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:11.894315    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:11.894435 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:11.894381    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret podName:4a495889-b555-4136-8810-50a9f9321749 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:27.894362174 +0000 UTC m=+33.257093766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret") pod "global-pull-secret-syncer-x4ztz" (UID: "4a495889-b555-4136-8810-50a9f9321749") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:11.994876 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:11.994845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:11.995056 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:11.995002    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:11.995110 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:11.995061    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs podName:8981f791-5aeb-4ac2-a44b-a78924e14068 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:27.995044103 +0000 UTC m=+33.357775686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs") pod "network-metrics-daemon-45pmz" (UID: "8981f791-5aeb-4ac2-a44b-a78924e14068") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:12.095377 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:12.095342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:12.095551 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:12.095521    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:12.095551 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:12.095546    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:12.095637 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:12.095558    2562 projected.go:196] Error preparing data for projected volume kube-api-access-f4s77 for pod openshift-network-diagnostics/network-check-target-fbt6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:12.095637 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:12.095613    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77 podName:8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a nodeName:}" failed. No retries permitted until 2026-09-15 12:45:28.095600138 +0000 UTC m=+33.458331719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s77" (UniqueName: "kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77") pod "network-check-target-fbt6z" (UID: "8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:12.256086 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:12.256053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:12.256277 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:12.256164    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:13.256832 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:13.256800    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:13.257272 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:13.256811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:13.257272 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:13.256918    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:13.257272 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:13.257052    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:14.256252 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:14.256216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:14.256404 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:14.256323    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:15.266411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:15.266378    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:15.266759 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:15.266413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:15.266759 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:15.266497    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:15.266759 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:15.266600    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:16.256324 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.256131    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:16.256517 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:16.256425    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:16.351303 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.351266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6r25" event={"ID":"307a6080-bd75-4ed9-83c5-a4fb4b919a7d","Type":"ContainerStarted","Data":"7f85e3a7979af2715353dddc34df467c02b071e982406037668726547a046293"}
Sep 15 12:45:16.352763 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.352735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qq2q2" event={"ID":"ebdf428a-ff17-4bba-a692-f9d171fa14ec","Type":"ContainerStarted","Data":"c668775d76153aa578c1ac0e82b7edfa2915ab470672067fe0937e520e7f20ec"}
Sep 15 12:45:16.354225 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.354199    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75e3fc2-378d-4bfd-80f2-bbdf01206c71" containerID="46855350e9a5377f5dcd15aba30a41a0af4b8da55dd5257fcf7b50ab6c6193cd" exitCode=0
Sep 15 12:45:16.354327 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.354269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerDied","Data":"46855350e9a5377f5dcd15aba30a41a0af4b8da55dd5257fcf7b50ab6c6193cd"}
Sep 15 12:45:16.355928 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.355901    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42" event={"ID":"8a335817-6c95-4c1d-8b71-96ba45d0ed76","Type":"ContainerStarted","Data":"7466245ee6a52941c381bda9318c9d22424254b2da3a70dab52cc4c82ac777df"}
Sep 15 12:45:16.357488 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.357464    2562 generic.go:356] "Generic (PLEG): container finished" podID="cd79124a262d4d1f4b0672083ba4d2cd" containerID="7f5e1a88d657d5198a981988dc814cd5160b1e6cd4314b887ab868845a6429a4" exitCode=0
Sep 15 12:45:16.357628 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.357552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" event={"ID":"cd79124a262d4d1f4b0672083ba4d2cd","Type":"ContainerDied","Data":"7f5e1a88d657d5198a981988dc814cd5160b1e6cd4314b887ab868845a6429a4"}
Sep 15 12:45:16.360915 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.359609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal" event={"ID":"d8fd76400f9433d06743f51faa0c5dcb","Type":"ContainerStarted","Data":"6ccad0efc5422028db7e1bdacebde4a12900324ca0780fa6e4df9c362b16af4b"}
Sep 15 12:45:16.364161 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364146    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:45:16.364482 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364465    2562 generic.go:356] "Generic (PLEG): container finished" podID="614d58f9-3b8a-4a06-9eae-a294ff8ffa01" containerID="cd4d841379ecb674d3824f1c4ebeca6db14684ab77882f292739b61f12eb1e18" exitCode=1
Sep 15 12:45:16.364549 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"12d604b0aff46b8895f38be6f6d57722a953118b1291383e9a00478765234965"}
Sep 15 12:45:16.364603 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"a4f932d7eeb7e84bc111c01fecb2e6f1e023f4c5bc261a6ff6efb0338524929b"}
Sep 15 12:45:16.364643 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"4f7be3efc294d84645f90be4b861b806eb2b897f1359a6d78903001d240e2686"}
Sep 15 12:45:16.364672 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364664    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"789548a18e1264fba207e7d3dd6af6dc7a470aada9a425e244c3b1ee669e3017"}
Sep 15 12:45:16.364717 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364706    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerDied","Data":"cd4d841379ecb674d3824f1c4ebeca6db14684ab77882f292739b61f12eb1e18"}
Sep 15 12:45:16.364768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.364746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"a7933b95f1cfff3ca645fb60c9a97f24c2c87175508a0759ec9efc7e4c68a919"}
Sep 15 12:45:16.365915 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.365894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2blth" event={"ID":"f462ce1e-21c0-4f53-aed4-7c7e0f223c35","Type":"ContainerStarted","Data":"a3d20a473b11145c00f4092b8c02dbacb9de8c7e3d70742abb2bb9029f5bcd75"}
Sep 15 12:45:16.367352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.367329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b6z56" event={"ID":"2011e93e-12ec-41e0-98a9-a8bdec2421f3","Type":"ContainerStarted","Data":"36d34577fbc1613d1539b2f4b99eb73624423255ba9adbd3c34a082bb32d9ffa"}
Sep 15 12:45:16.368335 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.368277    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h6r25" podStartSLOduration=2.69118099 podStartE2EDuration="21.368262239s" totalImagesPullingTime="18.677081249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:16.367810939 +0000 UTC m=+21.730542538" watchObservedRunningTime="2026-09-15 12:45:16.368262239 +0000 UTC m=+21.730993862"
Sep 15 12:45:16.369014 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.368994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sn2b9" event={"ID":"34f67a37-352d-4025-88fe-682ad24dc5a6","Type":"ContainerStarted","Data":"9c3b8556a3d944995e3cadeb83e4784e8e62c63d53e172798b4788064cc019d7"}
Sep 15 12:45:16.399237 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.399064    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal" podStartSLOduration=20.399043564 podStartE2EDuration="20.399043564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:16.398160444 +0000 UTC m=+21.760892044" watchObservedRunningTime="2026-09-15 12:45:16.399043564 +0000 UTC m=+21.761775158"
Sep 15 12:45:16.418944 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.418889    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2blth" podStartSLOduration=2.88535097 podStartE2EDuration="21.418874721s" totalImagesPullingTime="18.533523751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:16.418707114 +0000 UTC m=+21.781438716" watchObservedRunningTime="2026-09-15 12:45:16.418874721 +0000 UTC m=+21.781606320"
Sep 15 12:45:16.434449 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.434389    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qq2q2" podStartSLOduration=2.752845842 podStartE2EDuration="21.434369884s" totalImagesPullingTime="18.681524042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:16.434066076 +0000 UTC m=+21.796797678" watchObservedRunningTime="2026-09-15 12:45:16.434369884 +0000 UTC m=+21.797101487"
Sep 15 12:45:16.487125 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.487020    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b6z56" podStartSLOduration=3.773316782 podStartE2EDuration="21.486998408s" totalImagesPullingTime="17.713681626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:16.470163791 +0000 UTC m=+21.832895392" watchObservedRunningTime="2026-09-15 12:45:16.486998408 +0000 UTC m=+21.849730009"
Sep 15 12:45:16.487864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.487816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sn2b9" podStartSLOduration=2.854034855 podStartE2EDuration="21.487806938s" totalImagesPullingTime="18.633772083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:16.486918957 +0000 UTC m=+21.849650549" watchObservedRunningTime="2026-09-15 12:45:16.487806938 +0000 UTC m=+21.850538539"
Sep 15 12:45:16.858262 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:16.858104    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 12:45:17.122793 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.122653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:17.232128 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.232034    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T12:45:16.858258418Z","UUID":"1835f9c8-c821-4d93-9a62-89a08775b8f6","Handler":null,"Name":"","Endpoint":""}
Sep 15 12:45:17.233464 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.233448    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 12:45:17.233545 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.233480    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 12:45:17.259041 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.259019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:17.259148 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:17.259110    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:17.259200 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.259164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:17.259255 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:17.259240    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:17.372671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.372630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m244f" event={"ID":"37d6a5c0-7fbe-4e6a-a60a-3dc24f5b7e25","Type":"ContainerStarted","Data":"d025c8f211ff01e67a5692c2a2e6d03e1dab1955bffda7e750fa1c8b30c70210"}
Sep 15 12:45:17.374820 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.374750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42" event={"ID":"8a335817-6c95-4c1d-8b71-96ba45d0ed76","Type":"ContainerStarted","Data":"3b41129680ec447a40afbcf32caae1aff64716ca011c4e736b2e4188abde4196"}
Sep 15 12:45:17.377050 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.377020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" event={"ID":"cd79124a262d4d1f4b0672083ba4d2cd","Type":"ContainerStarted","Data":"5dfa300ffae8987c4b552f2332f8679d5b5b9cf53f892d887252b29166c23933"}
Sep 15 12:45:17.389166 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.389115    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m244f" podStartSLOduration=3.922087711 podStartE2EDuration="22.389097134s" totalImagesPullingTime="18.467009423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:17.388541909 +0000 UTC m=+22.751273507" watchObservedRunningTime="2026-09-15 12:45:17.389097134 +0000 UTC m=+22.751828733"
Sep 15 12:45:17.403837 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:17.403784    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" podStartSLOduration=21.403765336 podStartE2EDuration="21.403765336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:17.403487984 +0000 UTC m=+22.766219583" watchObservedRunningTime="2026-09-15 12:45:17.403765336 +0000 UTC m=+22.766496938"
Sep 15 12:45:18.084528 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:18.084490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:18.256141 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:18.256113    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:18.256316 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:18.256234    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:18.382542 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:18.382469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:45:18.382931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:18.382833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"49066d16160c5f0c41db4b3d58a7bb00e65108e3889235e0fa4ce0513d29bcbe"}
Sep 15 12:45:18.384673 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:18.384640    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42" event={"ID":"8a335817-6c95-4c1d-8b71-96ba45d0ed76","Type":"ContainerStarted","Data":"07c3b11eb00b86ebe914c2f225e077752b4f491472635257a29701cb4c17dba4"}
Sep 15 12:45:18.405190 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:18.405136    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfz42" podStartSLOduration=4.015333382 podStartE2EDuration="23.405115327s" totalImagesPullingTime="19.389781945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:18.404545738 +0000 UTC m=+23.767277338" watchObservedRunningTime="2026-09-15 12:45:18.405115327 +0000 UTC m=+23.767846928"
Sep 15 12:45:19.025944 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.025887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:19.087616 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.087580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:19.169236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.169159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:19.229100 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.229066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:19.256318 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.256287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:19.256495 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.256316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:19.256495 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:19.256411    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:19.256634 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:19.256531    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:19.921492 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.921448    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:45:19.922192 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:19.922173    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:45:20.253690 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:20.253658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:20.256482 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:20.256463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:20.256613 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:20.256590    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:20.354424 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:20.354391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:20.389821 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:20.389769    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:45:20.390380 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:20.390332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b6z56"
Sep 15 12:45:20.458777 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:20.458736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:21.259579 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:21.259549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:21.260128 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:21.259666    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:21.260128 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:21.259727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:21.260128 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:21.259832    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:21.327458 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:21.327411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:22.256391 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:22.256215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:22.256544 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:22.256469    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:22.396498 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:22.396468    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75e3fc2-378d-4bfd-80f2-bbdf01206c71" containerID="62b7b984b6f64325de6c030e692398c08c7ac3c42b3775e3fa0b1323b4580238" exitCode=0
Sep 15 12:45:22.396954 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:22.396529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerDied","Data":"62b7b984b6f64325de6c030e692398c08c7ac3c42b3775e3fa0b1323b4580238"}
Sep 15 12:45:22.400355 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:22.400338    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:45:22.400720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:22.400698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"1c52943ee6b7bd5a46748cd847f9d8bd7b926264ecc7ad9805f3a3429092f4a4"}
Sep 15 12:45:22.401172 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:22.401159    2562 scope.go:117] "RemoveContainer" containerID="cd4d841379ecb674d3824f1c4ebeca6db14684ab77882f292739b61f12eb1e18"
Sep 15 12:45:23.259313 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.259284    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:23.259497 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:23.259387    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:23.259497 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.259413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:23.259497 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:23.259459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:23.407927 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.407905    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:45:23.408459 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.408276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" event={"ID":"614d58f9-3b8a-4a06-9eae-a294ff8ffa01","Type":"ContainerStarted","Data":"2e581f0a05a3754dd17fbcf144a275385ad46f1e1c9c3ca95c819d366e11016e"}
Sep 15 12:45:23.408519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.408480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:45:23.408604 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.408584    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:45:23.408676 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.408664    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:45:23.423396 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.423374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:45:23.423521 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.423465    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:45:23.441409 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.441367    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv" podStartSLOduration=9.582864586 podStartE2EDuration="28.441353443s" totalImagesPullingTime="18.858488857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:23.439735299 +0000 UTC m=+28.802466898" watchObservedRunningTime="2026-09-15 12:45:23.441353443 +0000 UTC m=+28.804085041"
Sep 15 12:45:23.787937 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.787861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x4ztz"]
Sep 15 12:45:23.788079 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.788007    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:23.788125 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:23.788086    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:23.791775 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.791748    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fbt6z"]
Sep 15 12:45:23.791930 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.791835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:23.792016 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:23.791930    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:23.792409 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.792386    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45pmz"]
Sep 15 12:45:23.792495 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:23.792463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:23.792557 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:23.792542    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:24.413541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:24.413502    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75e3fc2-378d-4bfd-80f2-bbdf01206c71" containerID="4e0cd3a13099215cbb83bff1aaee14106ef4b8fb36692cbfb493d95de69ad2fc" exitCode=0
Sep 15 12:45:24.414266 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:24.413538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerDied","Data":"4e0cd3a13099215cbb83bff1aaee14106ef4b8fb36692cbfb493d95de69ad2fc"}
Sep 15 12:45:25.256541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:25.256375    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:25.256698 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:25.256460    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:25.256698 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:25.256612    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:25.256698 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:25.256499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:25.256698 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:25.256687    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:25.256911 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:25.256800    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:25.418155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:25.418069    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75e3fc2-378d-4bfd-80f2-bbdf01206c71" containerID="c7d94fe3ef5f4c7e1cb319fa82299a7719591d5ffbeb640e8058cda75d7d5162" exitCode=0
Sep 15 12:45:25.418155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:25.418145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerDied","Data":"c7d94fe3ef5f4c7e1cb319fa82299a7719591d5ffbeb640e8058cda75d7d5162"}
Sep 15 12:45:27.256509 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:27.256477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:27.256982 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:27.256529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:27.256982 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:27.256477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:27.256982 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:27.256632    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45pmz" podUID="8981f791-5aeb-4ac2-a44b-a78924e14068"
Sep 15 12:45:27.256982 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:27.256677    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fbt6z" podUID="8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a"
Sep 15 12:45:27.256982 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:27.256746    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x4ztz" podUID="4a495889-b555-4136-8810-50a9f9321749"
Sep 15 12:45:27.358574 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:27.358544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:27.906791 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:27.906757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:27.906995 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:27.906932    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:27.907044 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:27.907025    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret podName:4a495889-b555-4136-8810-50a9f9321749 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:59.907001553 +0000 UTC m=+65.269733134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret") pod "global-pull-secret-syncer-x4ztz" (UID: "4a495889-b555-4136-8810-50a9f9321749") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:28.007323 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.007262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:28.007529 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.007382    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:28.007529 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.007457    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs podName:8981f791-5aeb-4ac2-a44b-a78924e14068 nodeName:}" failed. No retries permitted until 2026-09-15 12:46:00.00743505 +0000 UTC m=+65.370166642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs") pod "network-metrics-daemon-45pmz" (UID: "8981f791-5aeb-4ac2-a44b-a78924e14068") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:28.108018 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.107959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:28.108182 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.108099    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:28.108182 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.108127    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:28.108182 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.108142    2562 projected.go:196] Error preparing data for projected volume kube-api-access-f4s77 for pod openshift-network-diagnostics/network-check-target-fbt6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:28.108299 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.108228    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77 podName:8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a nodeName:}" failed. No retries permitted until 2026-09-15 12:46:00.10820843 +0000 UTC m=+65.470940011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s77" (UniqueName: "kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77") pod "network-check-target-fbt6z" (UID: "8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:28.251805 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.251771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:28.363526 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.363492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:28.464028 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.464001    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeReady"
Sep 15 12:45:28.464199 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.464142    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 12:45:28.521278 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.521089    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-855bfd65c6-d2ctr"]
Sep 15 12:45:28.524947 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.524919    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sv54n"]
Sep 15 12:45:28.525118 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.525050    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.525642 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.525584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:28.527949 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.527928    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.528744 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.528721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 12:45:28.528915 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.528721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 12:45:28.532799 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.532777    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kb7jf"]
Sep 15 12:45:28.535671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.535652    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.539503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.539483    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 12:45:28.539503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.539499    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmbfk\""
Sep 15 12:45:28.539682 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.539657    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rtf69\""
Sep 15 12:45:28.539779 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.539668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 12:45:28.540689 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.540668    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 12:45:28.540781 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.540760    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 12:45:28.540888 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.540871    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 12:45:28.541014 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.540996    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ht9tr\""
Sep 15 12:45:28.541069 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.540997    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 12:45:28.541069 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.541057    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 12:45:28.541268 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.541250    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 12:45:28.549491 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.549470    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sv54n"]
Sep 15 12:45:28.574337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.574298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-855bfd65c6-d2ctr"]
Sep 15 12:45:28.584039 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.584014    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rthbg"]
Sep 15 12:45:28.586799 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.586782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.589842 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.589822    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 12:45:28.589959 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.589877    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 12:45:28.589959 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.589886    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h4s4k\""
Sep 15 12:45:28.589959 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.589883    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 12:45:28.597604 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.597565    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb7jf"]
Sep 15 12:45:28.612775 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.612749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-certificates\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.612890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.612784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-tmp-dir\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.612890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.612817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69f184c-ce30-42a0-aa11-94b1c564489f-ca-trust-extracted\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.612890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.612873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg89t\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-kube-api-access-fg89t\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.613023 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.612909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/628d798d-b2be-4827-92a1-662daf8f7d32-crio-socket\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.613023 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.612989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-bound-sa-token\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.613023 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-trusted-ca\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.613138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.613138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.613138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.613138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-image-registry-private-configuration\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.613287 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-installation-pull-secrets\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.613287 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.613287 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sjt6\" (UniqueName: \"kubernetes.io/projected/628d798d-b2be-4827-92a1-662daf8f7d32-kube-api-access-8sjt6\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.613400 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-config-volume\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.613400 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/628d798d-b2be-4827-92a1-662daf8f7d32-data-volume\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.613400 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.613353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjtk\" (UniqueName: \"kubernetes.io/projected/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-kube-api-access-nkjtk\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.631358 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.631200    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rthbg"]
Sep 15 12:45:28.644338 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.644309    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:28.714246 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.714397 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.714397 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.714355    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 12:45:28.714494 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.714436    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:29.214414958 +0000 UTC m=+34.577146538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : configmap "kube-rbac-proxy" not found
Sep 15 12:45:28.714494 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-image-registry-private-configuration\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.714494 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-installation-pull-secrets\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.714646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.714646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sjt6\" (UniqueName: \"kubernetes.io/projected/628d798d-b2be-4827-92a1-662daf8f7d32-kube-api-access-8sjt6\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.714646 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.714571    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:28.714646 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.714607    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 12:45:28.714646 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.714625    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855bfd65c6-d2ctr: secret "image-registry-tls" not found
Sep 15 12:45:28.714646 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.714643    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:29.214625103 +0000 UTC m=+34.577356695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:28.714931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-config-volume\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.714931 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.714683    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls podName:a69f184c-ce30-42a0-aa11-94b1c564489f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:29.214666567 +0000 UTC m=+34.577398165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls") pod "image-registry-855bfd65c6-d2ctr" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f") : secret "image-registry-tls" not found
Sep 15 12:45:28.714931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/628d798d-b2be-4827-92a1-662daf8f7d32-data-volume\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.714931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjtk\" (UniqueName: \"kubernetes.io/projected/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-kube-api-access-nkjtk\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.714931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-certificates\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.714931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-tmp-dir\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.714931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69f184c-ce30-42a0-aa11-94b1c564489f-ca-trust-extracted\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.714992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg89t\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-kube-api-access-fg89t\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/628d798d-b2be-4827-92a1-662daf8f7d32-crio-socket\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-bound-sa-token\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-trusted-ca\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e89219d5-94e0-4b6d-9049-8ec43b094910-cert\") pod \"ingress-canary-rthbg\" (UID: \"e89219d5-94e0-4b6d-9049-8ec43b094910\") " pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/628d798d-b2be-4827-92a1-662daf8f7d32-data-volume\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88fsr\" (UniqueName: \"kubernetes.io/projected/e89219d5-94e0-4b6d-9049-8ec43b094910-kube-api-access-88fsr\") pod \"ingress-canary-rthbg\" (UID: \"e89219d5-94e0-4b6d-9049-8ec43b094910\") " pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-config-volume\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715253    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/628d798d-b2be-4827-92a1-662daf8f7d32-crio-socket\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.715352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715294    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-tmp-dir\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.715849 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.715586    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:28.715849 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69f184c-ce30-42a0-aa11-94b1c564489f-ca-trust-extracted\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.715849 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:28.715649    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls podName:47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:29.215634848 +0000 UTC m=+34.578366429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls") pod "dns-default-sv54n" (UID: "47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:28.715849 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.715818    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-certificates\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.716196 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.716171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-trusted-ca\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.718757 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.718736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-installation-pull-secrets\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.718847 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.718766    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-image-registry-private-configuration\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.738408 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.738381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-bound-sa-token\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.746876 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.746855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg89t\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-kube-api-access-fg89t\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:28.751413 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.751377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sjt6\" (UniqueName: \"kubernetes.io/projected/628d798d-b2be-4827-92a1-662daf8f7d32-kube-api-access-8sjt6\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:28.751534 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.751504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjtk\" (UniqueName: \"kubernetes.io/projected/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-kube-api-access-nkjtk\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:28.792142 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.792066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:28.815826 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.815791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88fsr\" (UniqueName: \"kubernetes.io/projected/e89219d5-94e0-4b6d-9049-8ec43b094910-kube-api-access-88fsr\") pod \"ingress-canary-rthbg\" (UID: \"e89219d5-94e0-4b6d-9049-8ec43b094910\") " pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.815987 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.815940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e89219d5-94e0-4b6d-9049-8ec43b094910-cert\") pod \"ingress-canary-rthbg\" (UID: \"e89219d5-94e0-4b6d-9049-8ec43b094910\") " pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.818665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.818640    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e89219d5-94e0-4b6d-9049-8ec43b094910-cert\") pod \"ingress-canary-rthbg\" (UID: \"e89219d5-94e0-4b6d-9049-8ec43b094910\") " pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.826123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.826103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88fsr\" (UniqueName: \"kubernetes.io/projected/e89219d5-94e0-4b6d-9049-8ec43b094910-kube-api-access-88fsr\") pod \"ingress-canary-rthbg\" (UID: \"e89219d5-94e0-4b6d-9049-8ec43b094910\") " pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.862442 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.862408    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"]
Sep 15 12:45:28.866437 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.866411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:28.871254 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.871225    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 15 12:45:28.871748 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.871721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nz69h\""
Sep 15 12:45:28.871909 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.871884    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 15 12:45:28.883180 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.883159    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"]
Sep 15 12:45:28.898074 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.898047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rthbg"
Sep 15 12:45:28.911486 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.911463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:28.916462 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.916431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:28.916603 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:28.916485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b3ff397-8f4f-4936-82eb-33c4307340fd-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:29.017910 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.017829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:29.017910 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.017912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b3ff397-8f4f-4936-82eb-33c4307340fd-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:29.018151 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.018056    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 12:45:29.018151 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.018135    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert podName:2b3ff397-8f4f-4936-82eb-33c4307340fd nodeName:}" failed. No retries permitted until 2026-09-15 12:45:29.518113302 +0000 UTC m=+34.880844902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-gddk5" (UID: "2b3ff397-8f4f-4936-82eb-33c4307340fd") : secret "networking-console-plugin-cert" not found
Sep 15 12:45:29.018718 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.018692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b3ff397-8f4f-4936-82eb-33c4307340fd-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:29.079195 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.079113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:29.173105 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.173063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:29.220280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.220237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:29.220445 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.220353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:29.220445 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.220388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:29.220445 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220397    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 12:45:29.220445 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220416    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855bfd65c6-d2ctr: secret "image-registry-tls" not found
Sep 15 12:45:29.220445 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.220418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:29.220693 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220480    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls podName:a69f184c-ce30-42a0-aa11-94b1c564489f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.220458165 +0000 UTC m=+35.583189765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls") pod "image-registry-855bfd65c6-d2ctr" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f") : secret "image-registry-tls" not found
Sep 15 12:45:29.220693 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220492    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 12:45:29.220693 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220503    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:29.220693 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220524    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:29.220693 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220555    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls podName:47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.220538781 +0000 UTC m=+35.583270373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls") pod "dns-default-sv54n" (UID: "47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:29.220693 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220575    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.220565421 +0000 UTC m=+35.583297002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : configmap "kube-rbac-proxy" not found
Sep 15 12:45:29.220693 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.220587    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.220580216 +0000 UTC m=+35.583311793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:29.256703 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.256673    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:29.256868 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.256676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:45:29.256928 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.256885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:45:29.261919 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.261899    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 12:45:29.262053 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.262013    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 12:45:29.262151 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.262136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w5cgx\""
Sep 15 12:45:29.262265 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.262247    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 12:45:29.262323 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.262306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 12:45:29.262457 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.262443    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z9dbl\""
Sep 15 12:45:29.274274 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.274244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:29.376391 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.376302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:29.464684 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.464650    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"]
Sep 15 12:45:29.468958 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.468933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"
Sep 15 12:45:29.471550 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.471510    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 15 12:45:29.471671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.471548    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 15 12:45:29.472088 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.472069    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j555c\""
Sep 15 12:45:29.473816 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.473786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:29.477797 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.477759    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"]
Sep 15 12:45:29.523392 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.523360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5nc2\" (UniqueName: \"kubernetes.io/projected/0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c-kube-api-access-v5nc2\") pod \"migrator-8b4d697c5-4rxsq\" (UID: \"0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"
Sep 15 12:45:29.523529 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.523425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:29.523529 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.523511    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 12:45:29.523609 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:29.523570    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert podName:2b3ff397-8f4f-4936-82eb-33c4307340fd nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.523556831 +0000 UTC m=+35.886288408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-gddk5" (UID: "2b3ff397-8f4f-4936-82eb-33c4307340fd") : secret "networking-console-plugin-cert" not found
Sep 15 12:45:29.572293 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.572100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:29.623927 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.623896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5nc2\" (UniqueName: \"kubernetes.io/projected/0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c-kube-api-access-v5nc2\") pod \"migrator-8b4d697c5-4rxsq\" (UID: \"0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"
Sep 15 12:45:29.633900 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.633844    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5nc2\" (UniqueName: \"kubernetes.io/projected/0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c-kube-api-access-v5nc2\") pod \"migrator-8b4d697c5-4rxsq\" (UID: \"0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"
Sep 15 12:45:29.780048 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.780015    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"
Sep 15 12:45:29.800377 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.800354    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qq2q2_ebdf428a-ff17-4bba-a692-f9d171fa14ec/dns-node-resolver/0.log"
Sep 15 12:45:29.809355 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:29.809325    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rthbg"]
Sep 15 12:45:29.842114 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:29.842087    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89219d5_94e0_4b6d_9049_8ec43b094910.slice/crio-867aaecc39a2e726bb7ffcaedfb30bc78d4810372a5a374fe2287efba9fc8408 WatchSource:0}: Error finding container 867aaecc39a2e726bb7ffcaedfb30bc78d4810372a5a374fe2287efba9fc8408: Status 404 returned error can't find the container with id 867aaecc39a2e726bb7ffcaedfb30bc78d4810372a5a374fe2287efba9fc8408
Sep 15 12:45:30.074261 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.074231    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq"]
Sep 15 12:45:30.077305 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:30.077276    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2ff715_5c37_4681_a2b3_4d03d9f9ef8c.slice/crio-1221e574279458b18e74d218cb0bd45e5235aef9f4a96775b7d3ea1d6c8bda95 WatchSource:0}: Error finding container 1221e574279458b18e74d218cb0bd45e5235aef9f4a96775b7d3ea1d6c8bda95: Status 404 returned error can't find the container with id 1221e574279458b18e74d218cb0bd45e5235aef9f4a96775b7d3ea1d6c8bda95
Sep 15 12:45:30.137117 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.137090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:30.196913 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.196888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:30.229228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.229199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:30.229337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.229230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:30.229337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.229250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:30.229337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.229284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:30.229422 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229339    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 12:45:30.229422 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229365    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:30.229422 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229370    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 12:45:30.229422 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229383    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855bfd65c6-d2ctr: secret "image-registry-tls" not found
Sep 15 12:45:30.229422 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229347    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:30.229422 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229408    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.229387943 +0000 UTC m=+37.592119535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : configmap "kube-rbac-proxy" not found
Sep 15 12:45:30.229422 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229425    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.229416456 +0000 UTC m=+37.592148033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:30.229675 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229436    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls podName:a69f184c-ce30-42a0-aa11-94b1c564489f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.229431009 +0000 UTC m=+37.592162586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls") pod "image-registry-855bfd65c6-d2ctr" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f") : secret "image-registry-tls" not found
Sep 15 12:45:30.229675 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.229446    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls podName:47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.229441115 +0000 UTC m=+37.592172691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls") pod "dns-default-sv54n" (UID: "47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:30.401012 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.400925    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6r25_307a6080-bd75-4ed9-83c5-a4fb4b919a7d/node-ca/0.log"
Sep 15 12:45:30.432038 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.432009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rthbg" event={"ID":"e89219d5-94e0-4b6d-9049-8ec43b094910","Type":"ContainerStarted","Data":"867aaecc39a2e726bb7ffcaedfb30bc78d4810372a5a374fe2287efba9fc8408"}
Sep 15 12:45:30.433074 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.433045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq" event={"ID":"0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c","Type":"ContainerStarted","Data":"1221e574279458b18e74d218cb0bd45e5235aef9f4a96775b7d3ea1d6c8bda95"}
Sep 15 12:45:30.435758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.435733    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75e3fc2-378d-4bfd-80f2-bbdf01206c71" containerID="92f648eebc7d155102950d4c0f193532c6027a849e34c142a18b9df6d3a7bf69" exitCode=0
Sep 15 12:45:30.435851 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.435771    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerDied","Data":"92f648eebc7d155102950d4c0f193532c6027a849e34c142a18b9df6d3a7bf69"}
Sep 15 12:45:30.531405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.531379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:30.531546 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.531526    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 12:45:30.531617 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:30.531605    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert podName:2b3ff397-8f4f-4936-82eb-33c4307340fd nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.531585013 +0000 UTC m=+37.894316591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-gddk5" (UID: "2b3ff397-8f4f-4936-82eb-33c4307340fd") : secret "networking-console-plugin-cert" not found
Sep 15 12:45:30.780429 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:30.780399    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:31.007313 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.007234    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-ldjnc"]
Sep 15 12:45:31.032627 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.032595    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-ldjnc"]
Sep 15 12:45:31.032806 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.032713    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.037804 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.037772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 12:45:31.038324 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.038308    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 12:45:31.039227 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.039208    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 12:45:31.039334 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.039231    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 12:45:31.048902 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.048879    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fgwk8\""
Sep 15 12:45:31.136862 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.136831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2f1bec26-8383-4d2d-9702-dad3a32ca633-signing-key\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.137045 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.136877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72q7m\" (UniqueName: \"kubernetes.io/projected/2f1bec26-8383-4d2d-9702-dad3a32ca633-kube-api-access-72q7m\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.137045 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.136960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2f1bec26-8383-4d2d-9702-dad3a32ca633-signing-cabundle\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.237939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.237907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2f1bec26-8383-4d2d-9702-dad3a32ca633-signing-cabundle\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.238173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.238060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2f1bec26-8383-4d2d-9702-dad3a32ca633-signing-key\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.238173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.238087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72q7m\" (UniqueName: \"kubernetes.io/projected/2f1bec26-8383-4d2d-9702-dad3a32ca633-kube-api-access-72q7m\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.238725 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.238698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2f1bec26-8383-4d2d-9702-dad3a32ca633-signing-cabundle\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.241296 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.241262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2f1bec26-8383-4d2d-9702-dad3a32ca633-signing-key\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.254462 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.254442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72q7m\" (UniqueName: \"kubernetes.io/projected/2f1bec26-8383-4d2d-9702-dad3a32ca633-kube-api-access-72q7m\") pod \"service-ca-568869fdc5-ldjnc\" (UID: \"2f1bec26-8383-4d2d-9702-dad3a32ca633\") " pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.319244 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.319100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:31.342921 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.342887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-ldjnc"
Sep 15 12:45:31.441491 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.441457    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75e3fc2-378d-4bfd-80f2-bbdf01206c71" containerID="9743136b267ed9370bd9d75acb1b8c189e64314f42e2c45e545965c5e0b12938" exitCode=0
Sep 15 12:45:31.441939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.441543    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerDied","Data":"9743136b267ed9370bd9d75acb1b8c189e64314f42e2c45e545965c5e0b12938"}
Sep 15 12:45:31.462795 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.462767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:31.643023 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:31.642606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-ldjnc"]
Sep 15 12:45:31.646403 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:31.646372    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1bec26_8383_4d2d_9702_dad3a32ca633.slice/crio-2c030d8ee31f92ff204f7e71def21d0f5c7d474d957cd2718bdd483b4d920aab WatchSource:0}: Error finding container 2c030d8ee31f92ff204f7e71def21d0f5c7d474d957cd2718bdd483b4d920aab: Status 404 returned error can't find the container with id 2c030d8ee31f92ff204f7e71def21d0f5c7d474d957cd2718bdd483b4d920aab
Sep 15 12:45:32.250764 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.250709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:32.250764 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.250762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:32.250995 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.250820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:32.250995 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.250840    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 12:45:32.250995 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.250918    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:36.250899532 +0000 UTC m=+41.613631130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : configmap "kube-rbac-proxy" not found
Sep 15 12:45:32.250995 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.250948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:32.250995 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.250987    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 12:45:32.250995 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.250989    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:32.251275 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.251052    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:32.251275 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.251059    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:36.251039986 +0000 UTC m=+41.613771579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:32.251275 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.251001    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855bfd65c6-d2ctr: secret "image-registry-tls" not found
Sep 15 12:45:32.251275 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.251087    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls podName:47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:36.251075922 +0000 UTC m=+41.613807503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls") pod "dns-default-sv54n" (UID: "47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:32.251275 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.251103    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls podName:a69f184c-ce30-42a0-aa11-94b1c564489f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:36.25109308 +0000 UTC m=+41.613824675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls") pod "image-registry-855bfd65c6-d2ctr" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f") : secret "image-registry-tls" not found
Sep 15 12:45:32.447458 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.447421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" event={"ID":"c75e3fc2-378d-4bfd-80f2-bbdf01206c71","Type":"ContainerStarted","Data":"3899fbebcb4c03f50950771a7bdbfd20772aa2a8b7cab09a01ffa1c017a5e59a"}
Sep 15 12:45:32.448615 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.448586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-ldjnc" event={"ID":"2f1bec26-8383-4d2d-9702-dad3a32ca633","Type":"ContainerStarted","Data":"2c030d8ee31f92ff204f7e71def21d0f5c7d474d957cd2718bdd483b4d920aab"}
Sep 15 12:45:32.509023 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.508918    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gcqmb" podStartSLOduration=7.475269009 podStartE2EDuration="37.508902004s" totalImagesPullingTime="30.033632995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:32.500206895 +0000 UTC m=+37.862938494" watchObservedRunningTime="2026-09-15 12:45:32.508902004 +0000 UTC m=+37.871633603"
Sep 15 12:45:32.554447 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.554045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:32.554447 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.554371    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 12:45:32.554447 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:32.554430    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert podName:2b3ff397-8f4f-4936-82eb-33c4307340fd nodeName:}" failed. No retries permitted until 2026-09-15 12:45:36.554413027 +0000 UTC m=+41.917144607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-gddk5" (UID: "2b3ff397-8f4f-4936-82eb-33c4307340fd") : secret "networking-console-plugin-cert" not found
Sep 15 12:45:32.787661 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.787582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:32.945179 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:32.945144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:33.453486 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:33.453454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rthbg" event={"ID":"e89219d5-94e0-4b6d-9049-8ec43b094910","Type":"ContainerStarted","Data":"0ad640838472ca56ddb0724fd476023edb69aa08b7f3bc473c9c286a25e5d620"}
Sep 15 12:45:33.455299 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:33.455276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq" event={"ID":"0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c","Type":"ContainerStarted","Data":"692c2e3db27357d57768ca23343b72606543e7aaccabb9aef14b059f53b8e33c"}
Sep 15 12:45:33.455397 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:33.455318    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq" event={"ID":"0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c","Type":"ContainerStarted","Data":"15d4b330d04ccd8e795d8bb172d678aed364f0a22f47f0adf51bbcf9a16497f8"}
Sep 15 12:45:33.482854 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:33.482809    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rthbg" podStartSLOduration=2.1588010029999998 podStartE2EDuration="5.482794499s" totalImagesPullingTime="3.323993496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:33.48151359 +0000 UTC m=+38.844245190" watchObservedRunningTime="2026-09-15 12:45:33.482794499 +0000 UTC m=+38.845526089"
Sep 15 12:45:33.580267 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:33.580236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:33.776855 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:33.776821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:33.888221 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:33.888173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:34.487828 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:34.487779    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-4rxsq" podStartSLOduration=2.396729645 podStartE2EDuration="5.487764314s" totalImagesPullingTime="3.091034669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:34.487746136 +0000 UTC m=+39.850477732" watchObservedRunningTime="2026-09-15 12:45:34.487764314 +0000 UTC m=+39.850495913"
Sep 15 12:45:35.308685 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:35.308654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:35.445343 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:35.445308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:35.461350 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:35.461322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-ldjnc" event={"ID":"2f1bec26-8383-4d2d-9702-dad3a32ca633","Type":"ContainerStarted","Data":"45dd1384b0771146f1829538a026226a88528ec0b8589949f4d1a7847d0a868e"}
Sep 15 12:45:35.485582 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:35.485530    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-ldjnc" podStartSLOduration=1.810117145 podStartE2EDuration="5.48551483s" totalImagesPullingTime="3.675397685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:35.483927813 +0000 UTC m=+40.846659413" watchObservedRunningTime="2026-09-15 12:45:35.48551483 +0000 UTC m=+40.848246429"
Sep 15 12:45:36.290090 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:36.290053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:36.290090 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:36.290094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:36.290113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:36.290158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.290201    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.290266    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls podName:47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:44.290250546 +0000 UTC m=+49.652982122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls") pod "dns-default-sv54n" (UID: "47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.290288    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.290337    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls podName:628d798d-b2be-4827-92a1-662daf8f7d32 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:44.290325184 +0000 UTC m=+49.653056766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb7jf" (UID: "628d798d-b2be-4827-92a1-662daf8f7d32") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.290293    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.290354    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855bfd65c6-d2ctr: secret "image-registry-tls" not found
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.290384    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls podName:a69f184c-ce30-42a0-aa11-94b1c564489f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:44.290377668 +0000 UTC m=+49.653109244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls") pod "image-registry-855bfd65c6-d2ctr" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f") : secret "image-registry-tls" not found
Sep 15 12:45:36.290562 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:36.290562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/628d798d-b2be-4827-92a1-662daf8f7d32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:36.593141 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:36.593043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:36.593311 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.593165    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 12:45:36.593311 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:36.593226    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert podName:2b3ff397-8f4f-4936-82eb-33c4307340fd nodeName:}" failed. No retries permitted until 2026-09-15 12:45:44.593211308 +0000 UTC m=+49.955942890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-gddk5" (UID: "2b3ff397-8f4f-4936-82eb-33c4307340fd") : secret "networking-console-plugin-cert" not found
Sep 15 12:45:37.050061 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:37.049947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:37.201037 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:37.200989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:37.381588 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:37.381496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:37.494125 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:37.494096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:37.632055 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:37.631977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:37.814829 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:37.814785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:38.578104 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:38.578068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:39.157862 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:39.157826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:39.350102 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:39.350062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:39.558511 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:39.558467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:39.939148 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:39.939119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:40.532519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:40.532483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:40.734193 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:40.734165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:40.933125 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:40.933089    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:41.005188 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:41.005108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:41.346893 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:41.346817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:41.824405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:41.824374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:41.963728 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:41.963690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:42.178590 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:42.178559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:42.558193 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:42.558109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:42.772056 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:42.772025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:43.327370 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:43.327338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:43.575007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:43.574945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:43.967672 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:43.967635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:44.167198 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.167168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:44.359292 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.359208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:44.359292 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.359253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:44.359292 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.359290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:44.362853 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.362821    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/628d798d-b2be-4827-92a1-662daf8f7d32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb7jf\" (UID: \"628d798d-b2be-4827-92a1-662daf8f7d32\") " pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:44.362853 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.362834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1-metrics-tls\") pod \"dns-default-sv54n\" (UID: \"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1\") " pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:44.363024 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.362893    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"image-registry-855bfd65c6-d2ctr\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") " pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:44.437940 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.437894    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:44.446078 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.446049    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:44.452202 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.452184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb7jf"
Sep 15 12:45:44.588758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.588729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:44.661651 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.661574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:45:44.661791 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:44.661725    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 12:45:44.661835 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:45:44.661808    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert podName:2b3ff397-8f4f-4936-82eb-33c4307340fd nodeName:}" failed. No retries permitted until 2026-09-15 12:46:00.661793635 +0000 UTC m=+66.024525212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-gddk5" (UID: "2b3ff397-8f4f-4936-82eb-33c4307340fd") : secret "networking-console-plugin-cert" not found
Sep 15 12:45:44.778718 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.778687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:44.802864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.802807    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-855bfd65c6-d2ctr"]
Sep 15 12:45:44.804259 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.804182    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sv54n"]
Sep 15 12:45:44.804453 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:44.804428    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b6fb0c_3c65_46f7_b1e8_1ac7c4af13b1.slice/crio-bd6327119605413eb5e1af54ed95f45e10abf8bea8252c519623661bdcd3aa9f WatchSource:0}: Error finding container bd6327119605413eb5e1af54ed95f45e10abf8bea8252c519623661bdcd3aa9f: Status 404 returned error can't find the container with id bd6327119605413eb5e1af54ed95f45e10abf8bea8252c519623661bdcd3aa9f
Sep 15 12:45:44.838363 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:44.838324    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb7jf"]
Sep 15 12:45:44.841509 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:44.841480    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628d798d_b2be_4827_92a1_662daf8f7d32.slice/crio-d2265a4788c4b5ff17e91ac30955b17bed2a911b1c4d2d302d7cf33671b3ac5e WatchSource:0}: Error finding container d2265a4788c4b5ff17e91ac30955b17bed2a911b1c4d2d302d7cf33671b3ac5e: Status 404 returned error can't find the container with id d2265a4788c4b5ff17e91ac30955b17bed2a911b1c4d2d302d7cf33671b3ac5e
Sep 15 12:45:45.171707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.171671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:45.277734 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.277630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:45.489037 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.488999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr" event={"ID":"a69f184c-ce30-42a0-aa11-94b1c564489f","Type":"ContainerStarted","Data":"74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66"}
Sep 15 12:45:45.489485 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.489062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr" event={"ID":"a69f184c-ce30-42a0-aa11-94b1c564489f","Type":"ContainerStarted","Data":"12f02b8242ca329cbfd650b218780c24a1ca282475f42080eb7edd7284f1fa1b"}
Sep 15 12:45:45.489485 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.489238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:45:45.490825 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.490802    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb7jf" event={"ID":"628d798d-b2be-4827-92a1-662daf8f7d32","Type":"ContainerStarted","Data":"448bbd756fb379c609abcedf128c8dc12a3c50c6efc98d28434251309dca5865"}
Sep 15 12:45:45.490959 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.490847    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb7jf" event={"ID":"628d798d-b2be-4827-92a1-662daf8f7d32","Type":"ContainerStarted","Data":"d2265a4788c4b5ff17e91ac30955b17bed2a911b1c4d2d302d7cf33671b3ac5e"}
Sep 15 12:45:45.491926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.491906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sv54n" event={"ID":"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1","Type":"ContainerStarted","Data":"bd6327119605413eb5e1af54ed95f45e10abf8bea8252c519623661bdcd3aa9f"}
Sep 15 12:45:45.524429 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.524372    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr" podStartSLOduration=48.524354073 podStartE2EDuration="48.524354073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:45.523793234 +0000 UTC m=+50.886524834" watchObservedRunningTime="2026-09-15 12:45:45.524354073 +0000 UTC m=+50.887085673"
Sep 15 12:45:45.773124 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:45.773077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:46.181864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:46.181821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:46.497999 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:46.497943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb7jf" event={"ID":"628d798d-b2be-4827-92a1-662daf8f7d32","Type":"ContainerStarted","Data":"83a2560f1c019a41b695d4c6b96b899ccb0c598bd4971a5efe177e6836ea5047"}
Sep 15 12:45:46.583314 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:46.583213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:46.773232 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:46.773194    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:47.237386 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:47.237355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:47.506821 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:47.506751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sv54n" event={"ID":"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1","Type":"ContainerStarted","Data":"a65d1a86f72cb010e93ace79000e7c9c7bf4486d59d5e32e6ac3dec0eccdc0a7"}
Sep 15 12:45:47.507168 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:47.506826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sv54n" event={"ID":"47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1","Type":"ContainerStarted","Data":"5201203dd7caa2eea36c3362c3d0ddeb385cf6f80a31d8df87ee3f4fe327773d"}
Sep 15 12:45:47.507168 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:47.506902    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:47.543568 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:47.543520    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sv54n" podStartSLOduration=17.676377075 podStartE2EDuration="19.543502995s" totalImagesPullingTime="1.86712592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:47.543269223 +0000 UTC m=+52.906000823" watchObservedRunningTime="2026-09-15 12:45:47.543502995 +0000 UTC m=+52.906234588"
Sep 15 12:45:47.689497 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:47.689463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:47.830467 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:47.830379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:48.511726 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:48.511688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb7jf" event={"ID":"628d798d-b2be-4827-92a1-662daf8f7d32","Type":"ContainerStarted","Data":"c48055a4a83171cae136d21ac3ea968bacfd9dd0642d85849e520fd2b86b55b6"}
Sep 15 12:45:48.538036 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:48.537946    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kb7jf" podStartSLOduration=18.142582149 podStartE2EDuration="20.537924408s" totalImagesPullingTime="2.395342259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:45:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:48.536695237 +0000 UTC m=+53.899426836" watchObservedRunningTime="2026-09-15 12:45:48.537924408 +0000 UTC m=+53.900656008"
Sep 15 12:45:50.266087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:50.266059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:50.389812 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:50.389776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:54.580183 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:54.580134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:55.171680 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.171644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:55.381561 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.381532    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"]
Sep 15 12:45:55.385158 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.385136    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.414374 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.414348    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 12:45:55.414503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.414402    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 12:45:55.415509 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.415483    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 12:45:55.415509 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.415507    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jfcc5\""
Sep 15 12:45:55.418829 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.418800    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 12:45:55.428309 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.428263    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtgfv"
Sep 15 12:45:55.443090 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.443069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad55b328-8e74-4749-a5cc-024c9d755f01-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85c4794d4b-gj8s7\" (UID: \"ad55b328-8e74-4749-a5cc-024c9d755f01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.443196 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.443184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pdv\" (UniqueName: \"kubernetes.io/projected/ad55b328-8e74-4749-a5cc-024c9d755f01-kube-api-access-c9pdv\") pod \"managed-serviceaccount-addon-agent-85c4794d4b-gj8s7\" (UID: \"ad55b328-8e74-4749-a5cc-024c9d755f01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.479297 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.479272    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"]
Sep 15 12:45:55.543928 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.543900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad55b328-8e74-4749-a5cc-024c9d755f01-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85c4794d4b-gj8s7\" (UID: \"ad55b328-8e74-4749-a5cc-024c9d755f01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.544092 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.543935    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pdv\" (UniqueName: \"kubernetes.io/projected/ad55b328-8e74-4749-a5cc-024c9d755f01-kube-api-access-c9pdv\") pod \"managed-serviceaccount-addon-agent-85c4794d4b-gj8s7\" (UID: \"ad55b328-8e74-4749-a5cc-024c9d755f01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.549356 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.549324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad55b328-8e74-4749-a5cc-024c9d755f01-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85c4794d4b-gj8s7\" (UID: \"ad55b328-8e74-4749-a5cc-024c9d755f01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.619609 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.619574    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"]
Sep 15 12:45:55.622035 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.622018    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-855bfd65c6-d2ctr"]
Sep 15 12:45:55.622212 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.622190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"
Sep 15 12:45:55.642847 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.642822    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dsbbg\""
Sep 15 12:45:55.642847 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.642839    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-k66zp"]
Sep 15 12:45:55.643058 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.642836    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 12:45:55.645207 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.645181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2dbaa567-2f8d-4e2e-b87d-bf37583d3b33-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rjx45\" (UID: \"2dbaa567-2f8d-4e2e-b87d-bf37583d3b33\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"
Sep 15 12:45:55.646225 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.645527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-k66zp"
Sep 15 12:45:55.648223 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.648202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-98tsg\""
Sep 15 12:45:55.648330 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.648243    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 12:45:55.648607 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.648590    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 12:45:55.648756 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.648737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pdv\" (UniqueName: \"kubernetes.io/projected/ad55b328-8e74-4749-a5cc-024c9d755f01-kube-api-access-c9pdv\") pod \"managed-serviceaccount-addon-agent-85c4794d4b-gj8s7\" (UID: \"ad55b328-8e74-4749-a5cc-024c9d755f01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.654919 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.654893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:55.671428 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.671407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"]
Sep 15 12:45:55.703632 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.703574    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"
Sep 15 12:45:55.709791 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.709768    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-k66zp"]
Sep 15 12:45:55.745873 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.745846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2dbaa567-2f8d-4e2e-b87d-bf37583d3b33-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rjx45\" (UID: \"2dbaa567-2f8d-4e2e-b87d-bf37583d3b33\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"
Sep 15 12:45:55.746026 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.745893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjm7c\" (UniqueName: \"kubernetes.io/projected/71cd4cc7-fbc6-435a-b8f4-43e41faf6e97-kube-api-access-cjm7c\") pod \"downloads-76f99584f4-k66zp\" (UID: \"71cd4cc7-fbc6-435a-b8f4-43e41faf6e97\") " pod="openshift-console/downloads-76f99584f4-k66zp"
Sep 15 12:45:55.748320 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.748262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2dbaa567-2f8d-4e2e-b87d-bf37583d3b33-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rjx45\" (UID: \"2dbaa567-2f8d-4e2e-b87d-bf37583d3b33\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"
Sep 15 12:45:55.790426 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.790400    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7665f8bd6f-4gwhz"]
Sep 15 12:45:55.793952 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.793935    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.818349 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.818327    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7665f8bd6f-4gwhz"]
Sep 15 12:45:55.846163 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846137    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01f35f51-1f55-4a87-b712-e39d4464ed3e-installation-pull-secrets\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846163 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01f35f51-1f55-4a87-b712-e39d4464ed3e-trusted-ca\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846298 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01f35f51-1f55-4a87-b712-e39d4464ed3e-image-registry-private-configuration\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846298 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-registry-tls\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846298 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01f35f51-1f55-4a87-b712-e39d4464ed3e-registry-certificates\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846394 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01f35f51-1f55-4a87-b712-e39d4464ed3e-ca-trust-extracted\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846394 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-bound-sa-token\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846454 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tzk\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-kube-api-access-k9tzk\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.846454 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.846447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjm7c\" (UniqueName: \"kubernetes.io/projected/71cd4cc7-fbc6-435a-b8f4-43e41faf6e97-kube-api-access-cjm7c\") pod \"downloads-76f99584f4-k66zp\" (UID: \"71cd4cc7-fbc6-435a-b8f4-43e41faf6e97\") " pod="openshift-console/downloads-76f99584f4-k66zp"
Sep 15 12:45:55.882708 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.882679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjm7c\" (UniqueName: \"kubernetes.io/projected/71cd4cc7-fbc6-435a-b8f4-43e41faf6e97-kube-api-access-cjm7c\") pod \"downloads-76f99584f4-k66zp\" (UID: \"71cd4cc7-fbc6-435a-b8f4-43e41faf6e97\") " pod="openshift-console/downloads-76f99584f4-k66zp"
Sep 15 12:45:55.930898 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.930864    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"
Sep 15 12:45:55.943537 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.943505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:55.947487 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-registry-tls\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.947581 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01f35f51-1f55-4a87-b712-e39d4464ed3e-registry-certificates\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.947581 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01f35f51-1f55-4a87-b712-e39d4464ed3e-ca-trust-extracted\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.947581 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-bound-sa-token\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.947581 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tzk\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-kube-api-access-k9tzk\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.947778 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01f35f51-1f55-4a87-b712-e39d4464ed3e-installation-pull-secrets\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.947778 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01f35f51-1f55-4a87-b712-e39d4464ed3e-trusted-ca\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.947778 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.947665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01f35f51-1f55-4a87-b712-e39d4464ed3e-image-registry-private-configuration\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.948405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.948382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01f35f51-1f55-4a87-b712-e39d4464ed3e-registry-certificates\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.948696 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.948664    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01f35f51-1f55-4a87-b712-e39d4464ed3e-trusted-ca\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.948815 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.948792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01f35f51-1f55-4a87-b712-e39d4464ed3e-ca-trust-extracted\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.950198 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.950179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01f35f51-1f55-4a87-b712-e39d4464ed3e-image-registry-private-configuration\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.950430 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.950412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-registry-tls\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.950613 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.950599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01f35f51-1f55-4a87-b712-e39d4464ed3e-installation-pull-secrets\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:55.959526 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.959474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-k66zp"
Sep 15 12:45:55.991062 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:55.990938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tzk\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-kube-api-access-k9tzk\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:56.000901 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.000842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01f35f51-1f55-4a87-b712-e39d4464ed3e-bound-sa-token\") pod \"image-registry-7665f8bd6f-4gwhz\" (UID: \"01f35f51-1f55-4a87-b712-e39d4464ed3e\") " pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:56.004873 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.004812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7"]
Sep 15 12:45:56.012466 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:56.012411    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad55b328_8e74_4749_a5cc_024c9d755f01.slice/crio-67d3c3dfc0b43a8b3927986e2b35bab3ee5301e3fd52e4e6cde7a694ba9983ca WatchSource:0}: Error finding container 67d3c3dfc0b43a8b3927986e2b35bab3ee5301e3fd52e4e6cde7a694ba9983ca: Status 404 returned error can't find the container with id 67d3c3dfc0b43a8b3927986e2b35bab3ee5301e3fd52e4e6cde7a694ba9983ca
Sep 15 12:45:56.103303 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.103270    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:56.231983 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.231946    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"]
Sep 15 12:45:56.234218 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:56.234190    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbaa567_2f8d_4e2e_b87d_bf37583d3b33.slice/crio-ffde8b603a81474b07c94495c2d23dbc03d5c3e2e22469a6907d516384c36c84 WatchSource:0}: Error finding container ffde8b603a81474b07c94495c2d23dbc03d5c3e2e22469a6907d516384c36c84: Status 404 returned error can't find the container with id ffde8b603a81474b07c94495c2d23dbc03d5c3e2e22469a6907d516384c36c84
Sep 15 12:45:56.257875 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.257851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:56.281457 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.281431    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-k66zp"]
Sep 15 12:45:56.284443 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:56.284421    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cd4cc7_fbc6_435a_b8f4_43e41faf6e97.slice/crio-509c4f8f3638251b1d6852c2bbdfafc3bf83beda1cf990c7155b976f5477a620 WatchSource:0}: Error finding container 509c4f8f3638251b1d6852c2bbdfafc3bf83beda1cf990c7155b976f5477a620: Status 404 returned error can't find the container with id 509c4f8f3638251b1d6852c2bbdfafc3bf83beda1cf990c7155b976f5477a620
Sep 15 12:45:56.413409 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.413380    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7665f8bd6f-4gwhz"]
Sep 15 12:45:56.415486 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:45:56.415460    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f35f51_1f55_4a87_b712_e39d4464ed3e.slice/crio-2fe4b15a3114ccb62bee48aa3b6e49e09fc64ac8f6cfe06581d7cc559125e07e WatchSource:0}: Error finding container 2fe4b15a3114ccb62bee48aa3b6e49e09fc64ac8f6cfe06581d7cc559125e07e: Status 404 returned error can't find the container with id 2fe4b15a3114ccb62bee48aa3b6e49e09fc64ac8f6cfe06581d7cc559125e07e
Sep 15 12:45:56.455040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.455013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:56.538329 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.538240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz" event={"ID":"01f35f51-1f55-4a87-b712-e39d4464ed3e","Type":"ContainerStarted","Data":"50843956f3630840dc73eafd611edf4f3fff17f3676075b6e5df850264c8a6f0"}
Sep 15 12:45:56.538329 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.538296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz" event={"ID":"01f35f51-1f55-4a87-b712-e39d4464ed3e","Type":"ContainerStarted","Data":"2fe4b15a3114ccb62bee48aa3b6e49e09fc64ac8f6cfe06581d7cc559125e07e"}
Sep 15 12:45:56.538329 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.538321    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:45:56.539575 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.539538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45" event={"ID":"2dbaa567-2f8d-4e2e-b87d-bf37583d3b33","Type":"ContainerStarted","Data":"ffde8b603a81474b07c94495c2d23dbc03d5c3e2e22469a6907d516384c36c84"}
Sep 15 12:45:56.540761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.540738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7" event={"ID":"ad55b328-8e74-4749-a5cc-024c9d755f01","Type":"ContainerStarted","Data":"67d3c3dfc0b43a8b3927986e2b35bab3ee5301e3fd52e4e6cde7a694ba9983ca"}
Sep 15 12:45:56.542093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.542054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-k66zp" event={"ID":"71cd4cc7-fbc6-435a-b8f4-43e41faf6e97","Type":"ContainerStarted","Data":"509c4f8f3638251b1d6852c2bbdfafc3bf83beda1cf990c7155b976f5477a620"}
Sep 15 12:45:56.581954 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.581895    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz" podStartSLOduration=1.581874729 podStartE2EDuration="1.581874729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:56.581262834 +0000 UTC m=+61.943994435" watchObservedRunningTime="2026-09-15 12:45:56.581874729 +0000 UTC m=+61.944606333"
Sep 15 12:45:56.629689 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.629653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:56.780481 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.780421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:56.983768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:56.983736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:57.095273 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:57.095236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:57.514737 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:57.514703    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sv54n"
Sep 15 12:45:57.551116 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:57.551049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45" event={"ID":"2dbaa567-2f8d-4e2e-b87d-bf37583d3b33","Type":"ContainerStarted","Data":"66c1f2f3879c21868715ef69f609b1e7dd8c547c7a73611a5ace69a885ddeeb5"}
Sep 15 12:45:57.551366 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:57.551322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"
Sep 15 12:45:57.557954 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:57.557924    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45"
Sep 15 12:45:57.622704 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:57.622649    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rjx45" podStartSLOduration=1.473508753 podStartE2EDuration="2.622623388s" totalImagesPullingTime="1.149114635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:57.621192672 +0000 UTC m=+62.983924272" watchObservedRunningTime="2026-09-15 12:45:57.622623388 +0000 UTC m=+62.985354987"
Sep 15 12:45:58.315851 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:58.315804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:58.487927 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:58.487892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:59.428813 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:59.428765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:45:59.561151 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:59.561111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7" event={"ID":"ad55b328-8e74-4749-a5cc-024c9d755f01","Type":"ContainerStarted","Data":"fa8440ebc3afd3bff415483880301357666b139e013f229e664d63f913b837b4"}
Sep 15 12:45:59.584306 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:59.584249    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85c4794d4b-gj8s7" podStartSLOduration=1.263189061 podStartE2EDuration="4.58422972s" totalImagesPullingTime="3.321040659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:59.582265021 +0000 UTC m=+64.944996619" watchObservedRunningTime="2026-09-15 12:45:59.58422972 +0000 UTC m=+64.946961322"
Sep 15 12:45:59.986677 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:59.986640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:45:59.990758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:45:59.990733    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 12:46:00.000152 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.000124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a495889-b555-4136-8810-50a9f9321749-original-pull-secret\") pod \"global-pull-secret-syncer-x4ztz\" (UID: \"4a495889-b555-4136-8810-50a9f9321749\") " pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:46:00.087364 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.087327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:46:00.091276 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.091254    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 12:46:00.100681 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.100651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8981f791-5aeb-4ac2-a44b-a78924e14068-metrics-certs\") pod \"network-metrics-daemon-45pmz\" (UID: \"8981f791-5aeb-4ac2-a44b-a78924e14068\") " pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:46:00.169487 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.169452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x4ztz"
Sep 15 12:46:00.186311 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.186286    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w5cgx\""
Sep 15 12:46:00.188775 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.188730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:46:00.192200 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.192178    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 12:46:00.193218 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.193191    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45pmz"
Sep 15 12:46:00.203361 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.203337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 12:46:00.212912 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.212886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4s77\" (UniqueName: \"kubernetes.io/projected/8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a-kube-api-access-f4s77\") pod \"network-check-target-fbt6z\" (UID: \"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a\") " pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:46:00.454333 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.454280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x4ztz"]
Sep 15 12:46:00.458692 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:00.458646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a495889_b555_4136_8810_50a9f9321749.slice/crio-14e390ceaaa2a3a99049e828752a604bcd4074af2155b286babf9cbc381effe9 WatchSource:0}: Error finding container 14e390ceaaa2a3a99049e828752a604bcd4074af2155b286babf9cbc381effe9: Status 404 returned error can't find the container with id 14e390ceaaa2a3a99049e828752a604bcd4074af2155b286babf9cbc381effe9
Sep 15 12:46:00.479127 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.479105    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z9dbl\""
Sep 15 12:46:00.484419 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.484131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45pmz"]
Sep 15 12:46:00.485939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.485914    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:46:00.486367 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:00.486337    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8981f791_5aeb_4ac2_a44b_a78924e14068.slice/crio-8afc2587411f680954d40f082e8495afadc0819af7ee7cfc94ac8f42a067a6be WatchSource:0}: Error finding container 8afc2587411f680954d40f082e8495afadc0819af7ee7cfc94ac8f42a067a6be: Status 404 returned error can't find the container with id 8afc2587411f680954d40f082e8495afadc0819af7ee7cfc94ac8f42a067a6be
Sep 15 12:46:00.566376 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.566332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x4ztz" event={"ID":"4a495889-b555-4136-8810-50a9f9321749","Type":"ContainerStarted","Data":"14e390ceaaa2a3a99049e828752a604bcd4074af2155b286babf9cbc381effe9"}
Sep 15 12:46:00.567800 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.567731    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45pmz" event={"ID":"8981f791-5aeb-4ac2-a44b-a78924e14068","Type":"ContainerStarted","Data":"8afc2587411f680954d40f082e8495afadc0819af7ee7cfc94ac8f42a067a6be"}
Sep 15 12:46:00.693158 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.693113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:46:00.695901 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.695870    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b3ff397-8f4f-4936-82eb-33c4307340fd-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-gddk5\" (UID: \"2b3ff397-8f4f-4936-82eb-33c4307340fd\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:46:00.773376 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.773346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fbt6z"]
Sep 15 12:46:00.776046 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:00.776018    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfb5b6a_d6f8_43ef_86e2_ef35b135ba4a.slice/crio-e7d5aa6c9ef1b482d91fa36f62a1554bc30469cb66f7be0363f2ef44dd6dc0ac WatchSource:0}: Error finding container e7d5aa6c9ef1b482d91fa36f62a1554bc30469cb66f7be0363f2ef44dd6dc0ac: Status 404 returned error can't find the container with id e7d5aa6c9ef1b482d91fa36f62a1554bc30469cb66f7be0363f2ef44dd6dc0ac
Sep 15 12:46:00.981274 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.981044    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nz69h\""
Sep 15 12:46:00.987783 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:00.987756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"
Sep 15 12:46:01.277026 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:01.276931    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5"]
Sep 15 12:46:01.422588 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:01.422551    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3ff397_8f4f_4936_82eb_33c4307340fd.slice/crio-0bf9a5101dc5e65af2853c88cac6ab99a95b28b03b219f13584a913b8db1ee6a WatchSource:0}: Error finding container 0bf9a5101dc5e65af2853c88cac6ab99a95b28b03b219f13584a913b8db1ee6a: Status 404 returned error can't find the container with id 0bf9a5101dc5e65af2853c88cac6ab99a95b28b03b219f13584a913b8db1ee6a
Sep 15 12:46:01.573794 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:01.573761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45pmz" event={"ID":"8981f791-5aeb-4ac2-a44b-a78924e14068","Type":"ContainerStarted","Data":"c75cf1debc2f03f0a35d50247e43430e644ed4bc7088bbf26601b8330b808e53"}
Sep 15 12:46:01.575425 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:01.575326    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5" event={"ID":"2b3ff397-8f4f-4936-82eb-33c4307340fd","Type":"ContainerStarted","Data":"0bf9a5101dc5e65af2853c88cac6ab99a95b28b03b219f13584a913b8db1ee6a"}
Sep 15 12:46:01.576676 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:01.576652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fbt6z" event={"ID":"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a","Type":"ContainerStarted","Data":"e7d5aa6c9ef1b482d91fa36f62a1554bc30469cb66f7be0363f2ef44dd6dc0ac"}
Sep 15 12:46:02.585379 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:02.585340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45pmz" event={"ID":"8981f791-5aeb-4ac2-a44b-a78924e14068","Type":"ContainerStarted","Data":"c2fdc5d7fc785f948a81e10ec4a38ee9119e52f16da6bc06186c961c04a14d27"}
Sep 15 12:46:02.674054 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:02.674019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:02.900360 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:02.900278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:03.068179 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:03.068131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:04.685257 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:04.685202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:05.138357 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.138283    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-45pmz" podStartSLOduration=69.157963497 podStartE2EDuration="1m10.13825891s" totalImagesPullingTime="980.295413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:02.617185899 +0000 UTC m=+67.979917500" watchObservedRunningTime="2026-09-15 12:46:05.13825891 +0000 UTC m=+70.500990511"
Sep 15 12:46:05.139361 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.139284    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"]
Sep 15 12:46:05.157666 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.157638    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.172845 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.172795    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 12:46:05.173316 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.173293    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 12:46:05.174210 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.174190    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 12:46:05.174315 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.174225    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 12:46:05.174523 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.174458    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 12:46:05.174722 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.174702    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-s5kkt\""
Sep 15 12:46:05.231286 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.231059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqq9j\" (UniqueName: \"kubernetes.io/projected/90ebcf29-821c-4c1a-b80f-d0cded64a993-kube-api-access-qqq9j\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.231286 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.231121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90ebcf29-821c-4c1a-b80f-d0cded64a993-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.231286 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.231148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ebcf29-821c-4c1a-b80f-d0cded64a993-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.231286 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.231218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ebcf29-821c-4c1a-b80f-d0cded64a993-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.231597 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.231579    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"]
Sep 15 12:46:05.248563 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.247188    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4qptp"]
Sep 15 12:46:05.272193 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.272164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.275097 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.275062    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 12:46:05.275493 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.275473    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 12:46:05.275694 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.275512    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9phj7\""
Sep 15 12:46:05.275694 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.275557    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 12:46:05.331583 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-sys\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.331740 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtnr\" (UniqueName: \"kubernetes.io/projected/918d70b7-b95e-4226-bc03-b7b8f69a9f52-kube-api-access-mgtnr\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.331740 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90ebcf29-821c-4c1a-b80f-d0cded64a993-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.331740 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ebcf29-821c-4c1a-b80f-d0cded64a993-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.331907 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.331907 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/918d70b7-b95e-4226-bc03-b7b8f69a9f52-metrics-client-ca\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.331907 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ebcf29-821c-4c1a-b80f-d0cded64a993-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.331907 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-root\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.331907 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.332182 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-tls\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.332182 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.331983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqq9j\" (UniqueName: \"kubernetes.io/projected/90ebcf29-821c-4c1a-b80f-d0cded64a993-kube-api-access-qqq9j\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.332182 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.332010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-textfile\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.332182 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.332066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-wtmp\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.332740 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.332690    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ebcf29-821c-4c1a-b80f-d0cded64a993-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.334647 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.334617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ebcf29-821c-4c1a-b80f-d0cded64a993-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.335223 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.335198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90ebcf29-821c-4c1a-b80f-d0cded64a993-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.390717 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.390624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqq9j\" (UniqueName: \"kubernetes.io/projected/90ebcf29-821c-4c1a-b80f-d0cded64a993-kube-api-access-qqq9j\") pod \"openshift-state-metrics-67dcf8c979-49gb5\" (UID: \"90ebcf29-821c-4c1a-b80f-d0cded64a993\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.433324 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-sys\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtnr\" (UniqueName: \"kubernetes.io/projected/918d70b7-b95e-4226-bc03-b7b8f69a9f52-kube-api-access-mgtnr\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/918d70b7-b95e-4226-bc03-b7b8f69a9f52-metrics-client-ca\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433445    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-sys\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-root\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433498    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-root\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-tls\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-textfile\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-wtmp\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.433877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.433736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-wtmp\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.434103 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.434013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-textfile\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.434574 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.434509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.434574 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.434544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/918d70b7-b95e-4226-bc03-b7b8f69a9f52-metrics-client-ca\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.436584 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.436429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-tls\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.436689 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.436624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/918d70b7-b95e-4226-bc03-b7b8f69a9f52-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.457403 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.457379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtnr\" (UniqueName: \"kubernetes.io/projected/918d70b7-b95e-4226-bc03-b7b8f69a9f52-kube-api-access-mgtnr\") pod \"node-exporter-4qptp\" (UID: \"918d70b7-b95e-4226-bc03-b7b8f69a9f52\") " pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.470211 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.470185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"
Sep 15 12:46:05.584797 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.584760    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qptp"
Sep 15 12:46:05.628807 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.628781    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:46:05.929105 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:05.929065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:06.088731 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.088677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:06.245789 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.245683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:06.427676 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.427644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:06.522864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.522785    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84ddcd4cb4-qknwp"]
Sep 15 12:46:06.544688 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.544660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.548019 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.547982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ddcd4cb4-qknwp"]
Sep 15 12:46:06.548442 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.548422    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 12:46:06.549320 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.549295    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2bspk\""
Sep 15 12:46:06.549994 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.549829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 12:46:06.549994 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.549863    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 12:46:06.549994 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.549903    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 12:46:06.550181 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.550082    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 12:46:06.607819 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.607785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:06.646212 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.646177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-service-ca\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.646399 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.646224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-serving-cert\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.646399 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.646270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmslg\" (UniqueName: \"kubernetes.io/projected/2c27361c-3383-4aca-84d5-308f94e99e89-kube-api-access-pmslg\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.646399 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.646317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-oauth-config\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.646399 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.646374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-oauth-serving-cert\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.646611 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.646404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-console-config\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.747623 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.747586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmslg\" (UniqueName: \"kubernetes.io/projected/2c27361c-3383-4aca-84d5-308f94e99e89-kube-api-access-pmslg\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.747803 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.747659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-oauth-config\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.747803 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.747704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-oauth-serving-cert\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.747803 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.747734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-console-config\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.747803 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.747775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-service-ca\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.748059 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.747807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-serving-cert\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.748608 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.748580    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-oauth-serving-cert\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.748731 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.748610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-console-config\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.748803 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.748757    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-service-ca\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.750808 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.750776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-oauth-config\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.750926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.750842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-serving-cert\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.764410 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.764365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmslg\" (UniqueName: \"kubernetes.io/projected/2c27361c-3383-4aca-84d5-308f94e99e89-kube-api-access-pmslg\") pod \"console-84ddcd4cb4-qknwp\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") " pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.858222 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.858120    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:06.903297 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:06.903160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:07.280911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:07.280876    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:08.153852 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:08.153809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:08.317385 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:08.317331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:08.484663 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:08.484585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:08.751225 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:08.751133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:08.891474 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:08.891422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:09.394705 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.394676    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:09.698532 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.698491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:09.740947 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.740911    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"]
Sep 15 12:46:09.745165 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.745141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:09.751643 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.751618    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 12:46:09.751842 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.751808    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fgp8k\""
Sep 15 12:46:09.769179 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.769154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"]
Sep 15 12:46:09.873948 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.873909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn94n\" (UniqueName: \"kubernetes.io/projected/b01fbe78-3cfb-4aeb-9c79-b0f085f08215-kube-api-access-dn94n\") pod \"monitoring-plugin-5d85778b9d-m56ht\" (UID: \"b01fbe78-3cfb-4aeb-9c79-b0f085f08215\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:09.873948 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.873951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b01fbe78-3cfb-4aeb-9c79-b0f085f08215-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-m56ht\" (UID: \"b01fbe78-3cfb-4aeb-9c79-b0f085f08215\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:09.930590 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.930540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:09.975268 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.975192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn94n\" (UniqueName: \"kubernetes.io/projected/b01fbe78-3cfb-4aeb-9c79-b0f085f08215-kube-api-access-dn94n\") pod \"monitoring-plugin-5d85778b9d-m56ht\" (UID: \"b01fbe78-3cfb-4aeb-9c79-b0f085f08215\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:09.975268 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.975230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b01fbe78-3cfb-4aeb-9c79-b0f085f08215-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-m56ht\" (UID: \"b01fbe78-3cfb-4aeb-9c79-b0f085f08215\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:09.977829 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:09.977804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b01fbe78-3cfb-4aeb-9c79-b0f085f08215-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-m56ht\" (UID: \"b01fbe78-3cfb-4aeb-9c79-b0f085f08215\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:10.009297 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:10.009271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn94n\" (UniqueName: \"kubernetes.io/projected/b01fbe78-3cfb-4aeb-9c79-b0f085f08215-kube-api-access-dn94n\") pod \"monitoring-plugin-5d85778b9d-m56ht\" (UID: \"b01fbe78-3cfb-4aeb-9c79-b0f085f08215\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:10.056163 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:10.056129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:10.113769 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:10.113726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:11.461247 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:11.461157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:11.658565 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:11.658517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:13.071093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:13.071060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:13.170933 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:13.170899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:15.106438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.106361    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5"]
Sep 15 12:46:15.110565 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.110537    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"]
Sep 15 12:46:15.128913 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.128890    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ddcd4cb4-qknwp"]
Sep 15 12:46:15.137172 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:15.137140    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ebcf29_821c_4c1a_b80f_d0cded64a993.slice/crio-e348c9e394f4a9af7b3fc69d97363ff8ff7521149739db7f8ab8262aed0a2c35 WatchSource:0}: Error finding container e348c9e394f4a9af7b3fc69d97363ff8ff7521149739db7f8ab8262aed0a2c35: Status 404 returned error can't find the container with id e348c9e394f4a9af7b3fc69d97363ff8ff7521149739db7f8ab8262aed0a2c35
Sep 15 12:46:15.137854 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:15.137829    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01fbe78_3cfb_4aeb_9c79_b0f085f08215.slice/crio-27f103ea9ffb1c6c70cda99aea955f001015f49728df288eaaa4128a3b9ce626 WatchSource:0}: Error finding container 27f103ea9ffb1c6c70cda99aea955f001015f49728df288eaaa4128a3b9ce626: Status 404 returned error can't find the container with id 27f103ea9ffb1c6c70cda99aea955f001015f49728df288eaaa4128a3b9ce626
Sep 15 12:46:15.138844 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:15.138768    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c27361c_3383_4aca_84d5_308f94e99e89.slice/crio-a78b471b634cd3bf83c878f8f4029548676b7b552d98b88ad8b9a015de9ae2a9 WatchSource:0}: Error finding container a78b471b634cd3bf83c878f8f4029548676b7b552d98b88ad8b9a015de9ae2a9: Status 404 returned error can't find the container with id a78b471b634cd3bf83c878f8f4029548676b7b552d98b88ad8b9a015de9ae2a9
Sep 15 12:46:15.645557 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.645516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fbt6z" event={"ID":"8bfb5b6a-d6f8-43ef-86e2-ef35b135ba4a","Type":"ContainerStarted","Data":"7dea44c5b434a5529f71a067f5433483b63da5e5c89f121bb8d28c9b36b7eac2"}
Sep 15 12:46:15.645995 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.645741    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:46:15.647779 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.647746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-k66zp" event={"ID":"71cd4cc7-fbc6-435a-b8f4-43e41faf6e97","Type":"ContainerStarted","Data":"adba5a1766498642edf797a9152b0a25c6ce0516e49e066107799d9bfc8a5aee"}
Sep 15 12:46:15.648101 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.648082    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-k66zp"
Sep 15 12:46:15.650359 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.650332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x4ztz" event={"ID":"4a495889-b555-4136-8810-50a9f9321749","Type":"ContainerStarted","Data":"c931623f65ca0cd288f914d5730f79947e19f312ed6169b256706783121da824"}
Sep 15 12:46:15.652591 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.652570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5" event={"ID":"90ebcf29-821c-4c1a-b80f-d0cded64a993","Type":"ContainerStarted","Data":"8ad689d707d1515945251dd8f815d7f4a1a5ca11fb65de7d321659e2ee670fbb"}
Sep 15 12:46:15.652700 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.652612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5" event={"ID":"90ebcf29-821c-4c1a-b80f-d0cded64a993","Type":"ContainerStarted","Data":"b834f0c6ac6c05a4ba5d2864f289c715947b21a4d1c3966889b08bc6024007ca"}
Sep 15 12:46:15.652700 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.652641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5" event={"ID":"90ebcf29-821c-4c1a-b80f-d0cded64a993","Type":"ContainerStarted","Data":"e348c9e394f4a9af7b3fc69d97363ff8ff7521149739db7f8ab8262aed0a2c35"}
Sep 15 12:46:15.654146 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.654125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht" event={"ID":"b01fbe78-3cfb-4aeb-9c79-b0f085f08215","Type":"ContainerStarted","Data":"27f103ea9ffb1c6c70cda99aea955f001015f49728df288eaaa4128a3b9ce626"}
Sep 15 12:46:15.655852 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.655833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qptp" event={"ID":"918d70b7-b95e-4226-bc03-b7b8f69a9f52","Type":"ContainerStarted","Data":"ac44a24d3dc955a669afee7c38e094f63ebf2024f6dd25513346d36d4034c105"}
Sep 15 12:46:15.658532 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.658504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5" event={"ID":"2b3ff397-8f4f-4936-82eb-33c4307340fd","Type":"ContainerStarted","Data":"2b72130ab754cfa1ba44cbf25e99d14b1f21293b9500fbea7f20f971dbad7a16"}
Sep 15 12:46:15.660539 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.660512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddcd4cb4-qknwp" event={"ID":"2c27361c-3383-4aca-84d5-308f94e99e89","Type":"ContainerStarted","Data":"a78b471b634cd3bf83c878f8f4029548676b7b552d98b88ad8b9a015de9ae2a9"}
Sep 15 12:46:15.666895 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.666849    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fbt6z" podStartSLOduration=66.614682807 podStartE2EDuration="1m20.666836053s" totalImagesPullingTime="14.052153246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:15.665037823 +0000 UTC m=+81.027769423" watchObservedRunningTime="2026-09-15 12:46:15.666836053 +0000 UTC m=+81.029567651"
Sep 15 12:46:15.668096 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.668077    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-k66zp"
Sep 15 12:46:15.689957 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.689888    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x4ztz" podStartSLOduration=66.317076833 podStartE2EDuration="1m20.689866012s" totalImagesPullingTime="14.372789179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:15.689247651 +0000 UTC m=+81.051979251" watchObservedRunningTime="2026-09-15 12:46:15.689866012 +0000 UTC m=+81.052597614"
Sep 15 12:46:15.744984 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.744889    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-k66zp" podStartSLOduration=1.8202412479999999 podStartE2EDuration="20.744865194s" totalImagesPullingTime="18.924623946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:15.714607806 +0000 UTC m=+81.077339402" watchObservedRunningTime="2026-09-15 12:46:15.744865194 +0000 UTC m=+81.107596795"
Sep 15 12:46:15.768834 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.768723    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-gddk5" podStartSLOduration=41.569416861 podStartE2EDuration="47.768700029s" totalImagesPullingTime="6.199283168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:15.744801442 +0000 UTC m=+81.107533038" watchObservedRunningTime="2026-09-15 12:46:15.768700029 +0000 UTC m=+81.131431628"
Sep 15 12:46:15.837006 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:15.836907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:16.667645 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:16.667595    2562 generic.go:356] "Generic (PLEG): container finished" podID="918d70b7-b95e-4226-bc03-b7b8f69a9f52" containerID="5db44f009674f76ced7ba8fcd58ee02cf3c047ff9a743280b20fff958669944d" exitCode=0
Sep 15 12:46:16.668231 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:16.667748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qptp" event={"ID":"918d70b7-b95e-4226-bc03-b7b8f69a9f52","Type":"ContainerDied","Data":"5db44f009674f76ced7ba8fcd58ee02cf3c047ff9a743280b20fff958669944d"}
Sep 15 12:46:17.268494 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.268395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:17.414773 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.414689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:17.537065 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.536691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:17.561881 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.561849    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7665f8bd6f-4gwhz"
Sep 15 12:46:17.651184 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.651152    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c7d566f7-mmvhh"]
Sep 15 12:46:17.680845 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.680736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5" event={"ID":"90ebcf29-821c-4c1a-b80f-d0cded64a993","Type":"ContainerStarted","Data":"f69aba8c457a0b107ce0dbe844fd123848eba4f24c4e0939e5bcc913f6a6da59"}
Sep 15 12:46:17.680845 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.680799    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c7d566f7-mmvhh"]
Sep 15 12:46:17.681388 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.680851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.686608 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.686513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qptp" event={"ID":"918d70b7-b95e-4226-bc03-b7b8f69a9f52","Type":"ContainerStarted","Data":"0e776d26a621304bf7586907390b3c99fea93b640f3c9b19f2c6b4030783545c"}
Sep 15 12:46:17.686608 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.686570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qptp" event={"ID":"918d70b7-b95e-4226-bc03-b7b8f69a9f52","Type":"ContainerStarted","Data":"a507cd706c7776cb9cd8a9d69b57ded13449d0f5b180908b367806e103b0714d"}
Sep 15 12:46:17.695597 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.695573    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 12:46:17.705213 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.705154    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-49gb5" podStartSLOduration=10.861750882 podStartE2EDuration="12.705132829s" totalImagesPullingTime="1.843381947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:17.701988087 +0000 UTC m=+83.064719687" watchObservedRunningTime="2026-09-15 12:46:17.705132829 +0000 UTC m=+83.067864429"
Sep 15 12:46:17.730409 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.730346    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4qptp" podStartSLOduration=11.652521941 podStartE2EDuration="12.7303247s" totalImagesPullingTime="992.953833ms" totalInitContainerRuntime="84.848926ms" isStatefulPod=true podCreationTimestamp="2026-09-15 12:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:17.728344814 +0000 UTC m=+83.091076416" watchObservedRunningTime="2026-09-15 12:46:17.7303247 +0000 UTC m=+83.093056300"
Sep 15 12:46:17.746536 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.746490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-serving-cert\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.746702 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.746548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-config\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.746761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.746721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-oauth-config\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.746812 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.746785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-trusted-ca-bundle\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.746862 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.746812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-oauth-serving-cert\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.746862 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.746842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c22kj\" (UniqueName: \"kubernetes.io/projected/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-kube-api-access-c22kj\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.746958 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.746901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-service-ca\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.789758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.789721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:17.847829 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.847793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-oauth-config\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.848052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.847852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-trusted-ca-bundle\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.848052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.847871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-oauth-serving-cert\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.848052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.847885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c22kj\" (UniqueName: \"kubernetes.io/projected/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-kube-api-access-c22kj\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.848052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.847909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-service-ca\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.848052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.847979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-serving-cert\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.848052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.848009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-config\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.848885 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.848850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-config\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.849015 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.848896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-oauth-serving-cert\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.849563 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.849517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-service-ca\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.850508 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.850464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-trusted-ca-bundle\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.852222 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.852176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-oauth-config\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.852222 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.852190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-serving-cert\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.859943 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.859914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c22kj\" (UniqueName: \"kubernetes.io/projected/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-kube-api-access-c22kj\") pod \"console-66c7d566f7-mmvhh\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") " pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:17.863110 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.863072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:17.996492 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:17.996419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:18.176615 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:18.176577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:18.303054 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:18.302896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:20.265359 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.265283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c7d566f7-mmvhh"]
Sep 15 12:46:20.269072 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:46:20.269042    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc2fab6_2b4b_4ba7_8515_4eb03c229d75.slice/crio-d81b642344639154de364b85050ba1ea891d9c8d138222e04328f9ac23734387 WatchSource:0}: Error finding container d81b642344639154de364b85050ba1ea891d9c8d138222e04328f9ac23734387: Status 404 returned error can't find the container with id d81b642344639154de364b85050ba1ea891d9c8d138222e04328f9ac23734387
Sep 15 12:46:20.276940 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.276911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:20.421223 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.421187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:20.640651 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.640559    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr" podUID="a69f184c-ce30-42a0-aa11-94b1c564489f" containerName="registry" containerID="cri-o://74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66" gracePeriod=30
Sep 15 12:46:20.706237 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.706181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddcd4cb4-qknwp" event={"ID":"2c27361c-3383-4aca-84d5-308f94e99e89","Type":"ContainerStarted","Data":"091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807"}
Sep 15 12:46:20.708228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.708197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c7d566f7-mmvhh" event={"ID":"efc2fab6-2b4b-4ba7-8515-4eb03c229d75","Type":"ContainerStarted","Data":"614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93"}
Sep 15 12:46:20.708391 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.708251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c7d566f7-mmvhh" event={"ID":"efc2fab6-2b4b-4ba7-8515-4eb03c229d75","Type":"ContainerStarted","Data":"d81b642344639154de364b85050ba1ea891d9c8d138222e04328f9ac23734387"}
Sep 15 12:46:20.710031 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.709996    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht" event={"ID":"b01fbe78-3cfb-4aeb-9c79-b0f085f08215","Type":"ContainerStarted","Data":"2a7399a312766f53a34377b7f2ef79f1b3162cb2a0c1f3a897b476677a415f1a"}
Sep 15 12:46:20.710236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.710215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:20.715791 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.715762    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht"
Sep 15 12:46:20.728293 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.728247    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84ddcd4cb4-qknwp" podStartSLOduration=9.881697374 podStartE2EDuration="14.728231025s" totalImagesPullingTime="4.846533651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:20.727317654 +0000 UTC m=+86.090049244" watchObservedRunningTime="2026-09-15 12:46:20.728231025 +0000 UTC m=+86.090962623"
Sep 15 12:46:20.759872 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.759816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c7d566f7-mmvhh" podStartSLOduration=3.759798039 podStartE2EDuration="3.759798039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:20.758800085 +0000 UTC m=+86.121531684" watchObservedRunningTime="2026-09-15 12:46:20.759798039 +0000 UTC m=+86.122529637"
Sep 15 12:46:20.782369 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.782320    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-m56ht" podStartSLOduration=6.942391546 podStartE2EDuration="11.782300584s" totalImagesPullingTime="4.839909038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:20.780675024 +0000 UTC m=+86.143406625" watchObservedRunningTime="2026-09-15 12:46:20.782300584 +0000 UTC m=+86.145032182"
Sep 15 12:46:20.944254 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:20.944220    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:46:21.080213 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080176    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg89t\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-kube-api-access-fg89t\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080398 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080243    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-trusted-ca\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080398 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080281    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-image-registry-private-configuration\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080398 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080330    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-certificates\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080398 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080369    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-bound-sa-token\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080602 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080401    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69f184c-ce30-42a0-aa11-94b1c564489f-ca-trust-extracted\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080602 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080428    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080602 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080455    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-installation-pull-secrets\") pod \"a69f184c-ce30-42a0-aa11-94b1c564489f\" (UID: \"a69f184c-ce30-42a0-aa11-94b1c564489f\") "
Sep 15 12:46:21.080738 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080657    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:46:21.080795 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.080727    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:46:21.083343 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.083288    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:46:21.083623 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.083578    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:46:21.083623 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.083598    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:46:21.084547 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.084518    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:46:21.085145 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.085120    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-kube-api-access-fg89t" (OuterVolumeSpecName: "kube-api-access-fg89t") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "kube-api-access-fg89t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:46:21.091382 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.091354    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69f184c-ce30-42a0-aa11-94b1c564489f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a69f184c-ce30-42a0-aa11-94b1c564489f" (UID: "a69f184c-ce30-42a0-aa11-94b1c564489f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:46:21.172810 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.172772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:21.181793 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181763    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-image-registry-private-configuration\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.181793 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181791    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-certificates\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.182007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181811    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-bound-sa-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.182007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181825    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69f184c-ce30-42a0-aa11-94b1c564489f-ca-trust-extracted\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.182007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181838    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-registry-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.182007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181852    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69f184c-ce30-42a0-aa11-94b1c564489f-installation-pull-secrets\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.182007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181863    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg89t\" (UniqueName: \"kubernetes.io/projected/a69f184c-ce30-42a0-aa11-94b1c564489f-kube-api-access-fg89t\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.182007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.181872    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69f184c-ce30-42a0-aa11-94b1c564489f-trusted-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:21.377231 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.377190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:21.715887 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.715848    2562 generic.go:356] "Generic (PLEG): container finished" podID="a69f184c-ce30-42a0-aa11-94b1c564489f" containerID="74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66" exitCode=0
Sep 15 12:46:21.716087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.715908    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr"
Sep 15 12:46:21.716087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.715929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr" event={"ID":"a69f184c-ce30-42a0-aa11-94b1c564489f","Type":"ContainerDied","Data":"74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66"}
Sep 15 12:46:21.716087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.716002    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855bfd65c6-d2ctr" event={"ID":"a69f184c-ce30-42a0-aa11-94b1c564489f","Type":"ContainerDied","Data":"12f02b8242ca329cbfd650b218780c24a1ca282475f42080eb7edd7284f1fa1b"}
Sep 15 12:46:21.716087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.716045    2562 scope.go:117] "RemoveContainer" containerID="74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66"
Sep 15 12:46:21.726019 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.725998    2562 scope.go:117] "RemoveContainer" containerID="74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66"
Sep 15 12:46:21.726423 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:46:21.726396    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66\": container with ID starting with 74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66 not found: ID does not exist" containerID="74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66"
Sep 15 12:46:21.726526 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.726429    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66"} err="failed to get container status \"74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66\": rpc error: code = NotFound desc = could not find container \"74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66\": container with ID starting with 74b5ac596aef384efbc51ba5b8a74741662db9e7181232ddad4b57c280fd7c66 not found: ID does not exist"
Sep 15 12:46:21.740981 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.740935    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-855bfd65c6-d2ctr"]
Sep 15 12:46:21.748524 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:21.748496    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-855bfd65c6-d2ctr"]
Sep 15 12:46:23.262405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:23.262370    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69f184c-ce30-42a0-aa11-94b1c564489f" path="/var/lib/kubelet/pods/a69f184c-ce30-42a0-aa11-94b1c564489f/volumes"
Sep 15 12:46:26.523555 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:26.523516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:26.584798 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:26.584754    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:26.859331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:26.859252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:26.859548 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:26.859348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:26.864195 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:26.864173    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:27.042129 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:27.042095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:27.744496 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:27.744468    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:27.997215 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:27.997135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:27.997215 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:27.997199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:28.002529 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:28.002508    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:28.748847 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:28.748813    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:46:28.801916 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:28.801886    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ddcd4cb4-qknwp"]
Sep 15 12:46:28.838796 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:28.838759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:30.302718 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:30.302684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:30.436324 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:30.436292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:30.663464 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:30.663380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:30.776678 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:30.776646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:35.304107 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:35.304071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:35.578081 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:35.577985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:46.670995 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:46.670946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fbt6z"
Sep 15 12:46:50.252285 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:50.252246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:50.400862 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:50.400829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:54.767588 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:54.767536    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84ddcd4cb4-qknwp" podUID="2c27361c-3383-4aca-84d5-308f94e99e89" containerName="console" containerID="cri-o://091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807" gracePeriod=15
Sep 15 12:46:55.051524 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.051493    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:55.142473 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142439    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-serving-cert\") pod \"2c27361c-3383-4aca-84d5-308f94e99e89\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") "
Sep 15 12:46:55.142473 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142474    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmslg\" (UniqueName: \"kubernetes.io/projected/2c27361c-3383-4aca-84d5-308f94e99e89-kube-api-access-pmslg\") pod \"2c27361c-3383-4aca-84d5-308f94e99e89\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") "
Sep 15 12:46:55.142720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-oauth-config\") pod \"2c27361c-3383-4aca-84d5-308f94e99e89\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") "
Sep 15 12:46:55.142720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-oauth-serving-cert\") pod \"2c27361c-3383-4aca-84d5-308f94e99e89\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") "
Sep 15 12:46:55.142720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142585    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-service-ca\") pod \"2c27361c-3383-4aca-84d5-308f94e99e89\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") "
Sep 15 12:46:55.142720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142634    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-console-config\") pod \"2c27361c-3383-4aca-84d5-308f94e99e89\" (UID: \"2c27361c-3383-4aca-84d5-308f94e99e89\") "
Sep 15 12:46:55.143010 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142982    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2c27361c-3383-4aca-84d5-308f94e99e89" (UID: "2c27361c-3383-4aca-84d5-308f94e99e89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:46:55.143091 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.142983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-service-ca" (OuterVolumeSpecName: "service-ca") pod "2c27361c-3383-4aca-84d5-308f94e99e89" (UID: "2c27361c-3383-4aca-84d5-308f94e99e89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:46:55.143091 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.143074    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-console-config" (OuterVolumeSpecName: "console-config") pod "2c27361c-3383-4aca-84d5-308f94e99e89" (UID: "2c27361c-3383-4aca-84d5-308f94e99e89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:46:55.144863 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.144832    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2c27361c-3383-4aca-84d5-308f94e99e89" (UID: "2c27361c-3383-4aca-84d5-308f94e99e89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:46:55.144863 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.144838    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c27361c-3383-4aca-84d5-308f94e99e89-kube-api-access-pmslg" (OuterVolumeSpecName: "kube-api-access-pmslg") pod "2c27361c-3383-4aca-84d5-308f94e99e89" (UID: "2c27361c-3383-4aca-84d5-308f94e99e89"). InnerVolumeSpecName "kube-api-access-pmslg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:46:55.145083 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.144908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2c27361c-3383-4aca-84d5-308f94e99e89" (UID: "2c27361c-3383-4aca-84d5-308f94e99e89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:46:55.243987 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.243938    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-console-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:55.243987 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.243979    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:55.243987 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.243990    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmslg\" (UniqueName: \"kubernetes.io/projected/2c27361c-3383-4aca-84d5-308f94e99e89-kube-api-access-pmslg\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:55.244203 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.243999    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c27361c-3383-4aca-84d5-308f94e99e89-console-oauth-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:55.244203 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.244007    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-oauth-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:55.244203 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.244015    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c27361c-3383-4aca-84d5-308f94e99e89-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:46:55.838903 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.838866    2562 generic.go:356] "Generic (PLEG): container finished" podID="2c27361c-3383-4aca-84d5-308f94e99e89" containerID="091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807" exitCode=0
Sep 15 12:46:55.839374 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.838926    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddcd4cb4-qknwp"
Sep 15 12:46:55.839374 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.838945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddcd4cb4-qknwp" event={"ID":"2c27361c-3383-4aca-84d5-308f94e99e89","Type":"ContainerDied","Data":"091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807"}
Sep 15 12:46:55.839374 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.839010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddcd4cb4-qknwp" event={"ID":"2c27361c-3383-4aca-84d5-308f94e99e89","Type":"ContainerDied","Data":"a78b471b634cd3bf83c878f8f4029548676b7b552d98b88ad8b9a015de9ae2a9"}
Sep 15 12:46:55.839374 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.839030    2562 scope.go:117] "RemoveContainer" containerID="091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807"
Sep 15 12:46:55.846763 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.846743    2562 scope.go:117] "RemoveContainer" containerID="091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807"
Sep 15 12:46:55.847037 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:46:55.847020    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807\": container with ID starting with 091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807 not found: ID does not exist" containerID="091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807"
Sep 15 12:46:55.847082 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.847045    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807"} err="failed to get container status \"091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807\": rpc error: code = NotFound desc = could not find container \"091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807\": container with ID starting with 091f7fb15e69caeec202add2d690bb8a847a2e20de6561fe15e62ccfdc5ca807 not found: ID does not exist"
Sep 15 12:46:55.870172 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.870150    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ddcd4cb4-qknwp"]
Sep 15 12:46:55.876102 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:55.876082    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84ddcd4cb4-qknwp"]
Sep 15 12:46:57.260769 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:57.260736    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c27361c-3383-4aca-84d5-308f94e99e89" path="/var/lib/kubelet/pods/2c27361c-3383-4aca-84d5-308f94e99e89/volumes"
Sep 15 12:46:58.571943 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:58.571911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:46:58.633343 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:46:58.633307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:04.334062 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:04.334032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:04.766754 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:04.766719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:24.892752 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:24.892708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:25.280944 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:25.280911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:33.518809 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.518775    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-646d694f5f-nrq7f"]
Sep 15 12:47:33.519289 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.519186    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c27361c-3383-4aca-84d5-308f94e99e89" containerName="console"
Sep 15 12:47:33.519289 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.519204    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c27361c-3383-4aca-84d5-308f94e99e89" containerName="console"
Sep 15 12:47:33.519289 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.519218    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69f184c-ce30-42a0-aa11-94b1c564489f" containerName="registry"
Sep 15 12:47:33.519289 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.519226    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69f184c-ce30-42a0-aa11-94b1c564489f" containerName="registry"
Sep 15 12:47:33.519496 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.519302    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c27361c-3383-4aca-84d5-308f94e99e89" containerName="console"
Sep 15 12:47:33.519496 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.519313    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69f184c-ce30-42a0-aa11-94b1c564489f" containerName="registry"
Sep 15 12:47:33.523697 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.523676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.596124 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.596091    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646d694f5f-nrq7f"]
Sep 15 12:47:33.633058 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.633013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-console-config\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.633155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.633069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-serving-cert\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.633155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.633090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-oauth-serving-cert\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.633220 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.633155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-trusted-ca-bundle\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.633220 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.633172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvrd9\" (UniqueName: \"kubernetes.io/projected/4f315eca-8f36-4620-8f46-73208d2a0b22-kube-api-access-xvrd9\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.633286 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.633240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-oauth-config\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.633286 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.633266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-service-ca\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.733819 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.733784    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-trusted-ca-bundle\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.733819 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.733819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvrd9\" (UniqueName: \"kubernetes.io/projected/4f315eca-8f36-4620-8f46-73208d2a0b22-kube-api-access-xvrd9\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734064 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.733844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-oauth-config\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734064 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.733860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-service-ca\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734064 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.734009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-console-config\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734064 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.734056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-serving-cert\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734260 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.734082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-oauth-serving-cert\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734691 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.734664    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-service-ca\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734836 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.734816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-trusted-ca-bundle\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734893 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.734757    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-console-config\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.734893 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.734748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-oauth-serving-cert\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.736266 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.736245    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-oauth-config\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.736379 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.736362    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-serving-cert\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.770423 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.770345    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvrd9\" (UniqueName: \"kubernetes.io/projected/4f315eca-8f36-4620-8f46-73208d2a0b22-kube-api-access-xvrd9\") pod \"console-646d694f5f-nrq7f\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") " pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:33.832014 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:33.831950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:34.123728 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:34.123642    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646d694f5f-nrq7f"]
Sep 15 12:47:34.127587 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:47:34.127565    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f315eca_8f36_4620_8f46_73208d2a0b22.slice/crio-f0da770d38b1227f3c5ef995003343ffb2463fcd763af6d43f672f4d2bbbd0c2 WatchSource:0}: Error finding container f0da770d38b1227f3c5ef995003343ffb2463fcd763af6d43f672f4d2bbbd0c2: Status 404 returned error can't find the container with id f0da770d38b1227f3c5ef995003343ffb2463fcd763af6d43f672f4d2bbbd0c2
Sep 15 12:47:34.647619 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:34.647581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:34.727701 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:34.727656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:34.988411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:34.988376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646d694f5f-nrq7f" event={"ID":"4f315eca-8f36-4620-8f46-73208d2a0b22","Type":"ContainerStarted","Data":"93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb"}
Sep 15 12:47:34.988595 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:34.988426    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646d694f5f-nrq7f" event={"ID":"4f315eca-8f36-4620-8f46-73208d2a0b22","Type":"ContainerStarted","Data":"f0da770d38b1227f3c5ef995003343ffb2463fcd763af6d43f672f4d2bbbd0c2"}
Sep 15 12:47:35.013664 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:35.013607    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-646d694f5f-nrq7f" podStartSLOduration=2.013594423 podStartE2EDuration="2.013594423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:47:35.011947956 +0000 UTC m=+160.374679555" watchObservedRunningTime="2026-09-15 12:47:35.013594423 +0000 UTC m=+160.376326022"
Sep 15 12:47:42.642303 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:42.642261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:43.832935 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:43.832895    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:43.833338 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:43.832990    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:43.837645 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:43.837611    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:44.024541 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:44.024512    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:47:44.071903 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:44.071873    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c7d566f7-mmvhh"]
Sep 15 12:47:44.199253 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:44.199217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:44.300761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:44.300728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:47:44.401775 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:47:44.401742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:48:09.096237 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.096186    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c7d566f7-mmvhh" podUID="efc2fab6-2b4b-4ba7-8515-4eb03c229d75" containerName="console" containerID="cri-o://614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93" gracePeriod=15
Sep 15 12:48:09.334582 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.334559    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:48:09.409205 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409122    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c22kj\" (UniqueName: \"kubernetes.io/projected/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-kube-api-access-c22kj\") pod \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") "
Sep 15 12:48:09.409205 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409174    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-service-ca\") pod \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") "
Sep 15 12:48:09.409205 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-oauth-config\") pod \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") "
Sep 15 12:48:09.409472 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409222    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-config\") pod \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") "
Sep 15 12:48:09.409472 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-oauth-serving-cert\") pod \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") "
Sep 15 12:48:09.409472 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409286    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-serving-cert\") pod \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") "
Sep 15 12:48:09.409472 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409301    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-trusted-ca-bundle\") pod \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\" (UID: \"efc2fab6-2b4b-4ba7-8515-4eb03c229d75\") "
Sep 15 12:48:09.409781 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409727    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-service-ca" (OuterVolumeSpecName: "service-ca") pod "efc2fab6-2b4b-4ba7-8515-4eb03c229d75" (UID: "efc2fab6-2b4b-4ba7-8515-4eb03c229d75"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:48:09.409781 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409744    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "efc2fab6-2b4b-4ba7-8515-4eb03c229d75" (UID: "efc2fab6-2b4b-4ba7-8515-4eb03c229d75"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:48:09.409781 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409743    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-config" (OuterVolumeSpecName: "console-config") pod "efc2fab6-2b4b-4ba7-8515-4eb03c229d75" (UID: "efc2fab6-2b4b-4ba7-8515-4eb03c229d75"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:48:09.409992 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.409784    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "efc2fab6-2b4b-4ba7-8515-4eb03c229d75" (UID: "efc2fab6-2b4b-4ba7-8515-4eb03c229d75"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:48:09.411500 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.411478    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "efc2fab6-2b4b-4ba7-8515-4eb03c229d75" (UID: "efc2fab6-2b4b-4ba7-8515-4eb03c229d75"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:48:09.411761 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.411742    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-kube-api-access-c22kj" (OuterVolumeSpecName: "kube-api-access-c22kj") pod "efc2fab6-2b4b-4ba7-8515-4eb03c229d75" (UID: "efc2fab6-2b4b-4ba7-8515-4eb03c229d75"). InnerVolumeSpecName "kube-api-access-c22kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:48:09.411811 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.411741    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "efc2fab6-2b4b-4ba7-8515-4eb03c229d75" (UID: "efc2fab6-2b4b-4ba7-8515-4eb03c229d75"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:48:09.510331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.510269    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:48:09.510331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.510322    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-trusted-ca-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:48:09.510331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.510335    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c22kj\" (UniqueName: \"kubernetes.io/projected/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-kube-api-access-c22kj\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:48:09.510566 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.510349    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:48:09.510566 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.510363    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-oauth-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:48:09.510566 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.510374    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-console-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:48:09.510566 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:09.510385    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc2fab6-2b4b-4ba7-8515-4eb03c229d75-oauth-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:48:10.117286 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.117249    2562 generic.go:356] "Generic (PLEG): container finished" podID="efc2fab6-2b4b-4ba7-8515-4eb03c229d75" containerID="614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93" exitCode=0
Sep 15 12:48:10.117794 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.117297    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c7d566f7-mmvhh"
Sep 15 12:48:10.117794 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.117336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c7d566f7-mmvhh" event={"ID":"efc2fab6-2b4b-4ba7-8515-4eb03c229d75","Type":"ContainerDied","Data":"614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93"}
Sep 15 12:48:10.117794 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.117389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c7d566f7-mmvhh" event={"ID":"efc2fab6-2b4b-4ba7-8515-4eb03c229d75","Type":"ContainerDied","Data":"d81b642344639154de364b85050ba1ea891d9c8d138222e04328f9ac23734387"}
Sep 15 12:48:10.117794 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.117411    2562 scope.go:117] "RemoveContainer" containerID="614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93"
Sep 15 12:48:10.127028 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.127009    2562 scope.go:117] "RemoveContainer" containerID="614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93"
Sep 15 12:48:10.127601 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:48:10.127574    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93\": container with ID starting with 614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93 not found: ID does not exist" containerID="614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93"
Sep 15 12:48:10.127702 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.127605    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93"} err="failed to get container status \"614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93\": rpc error: code = NotFound desc = could not find container \"614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93\": container with ID starting with 614c866c440759de8c4df3a71804923ad341e1aac6bb60cbb22ab8d19f5b5e93 not found: ID does not exist"
Sep 15 12:48:10.141525 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.141499    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c7d566f7-mmvhh"]
Sep 15 12:48:10.147692 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:10.147669    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c7d566f7-mmvhh"]
Sep 15 12:48:11.261175 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:11.261143    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc2fab6-2b4b-4ba7-8515-4eb03c229d75" path="/var/lib/kubelet/pods/efc2fab6-2b4b-4ba7-8515-4eb03c229d75/volumes"
Sep 15 12:48:35.194530 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:35.194481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:48:35.272594 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:35.272560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:48:40.123146 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:40.123107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:48:40.202290 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:40.202253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:48:50.088223 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.088188    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6578f45bb9-dqtfm"]
Sep 15 12:48:50.088585 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.088447    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc2fab6-2b4b-4ba7-8515-4eb03c229d75" containerName="console"
Sep 15 12:48:50.088585 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.088458    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc2fab6-2b4b-4ba7-8515-4eb03c229d75" containerName="console"
Sep 15 12:48:50.088585 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.088508    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc2fab6-2b4b-4ba7-8515-4eb03c229d75" containerName="console"
Sep 15 12:48:50.091385 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.091368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.105031 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.105002    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6578f45bb9-dqtfm"]
Sep 15 12:48:50.213607 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.213565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-serving-cert\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.213607 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.213604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-service-ca\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.213855 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.213669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-trusted-ca-bundle\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.213855 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.213691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-console-config\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.213855 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.213706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-oauth-serving-cert\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.213855 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.213721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krt8m\" (UniqueName: \"kubernetes.io/projected/aff22913-aba8-4a49-8b43-09a915062caa-kube-api-access-krt8m\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.213855 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.213835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-oauth-config\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.314349 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.314319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-serving-cert\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.314349 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.314352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-service-ca\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.314572 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.314379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-trusted-ca-bundle\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.314572 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.314408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-console-config\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.314572 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.314432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-oauth-serving-cert\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.314572 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.314459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krt8m\" (UniqueName: \"kubernetes.io/projected/aff22913-aba8-4a49-8b43-09a915062caa-kube-api-access-krt8m\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.314572 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.314525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-oauth-config\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.315153 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.315116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-service-ca\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.315267 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.315193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-console-config\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.315343 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.315321    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-oauth-serving-cert\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.315406 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.315346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-trusted-ca-bundle\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.317034 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.317016    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-serving-cert\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.317093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.317050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-oauth-config\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.326906 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.326884    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krt8m\" (UniqueName: \"kubernetes.io/projected/aff22913-aba8-4a49-8b43-09a915062caa-kube-api-access-krt8m\") pod \"console-6578f45bb9-dqtfm\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") " pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.400906 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.400826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:48:50.679301 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:50.679266    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6578f45bb9-dqtfm"]
Sep 15 12:48:50.682184 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:48:50.682161    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff22913_aba8_4a49_8b43_09a915062caa.slice/crio-4943a994b140233d79b27f8f6266cb29f4661561dfefe6509b47025c2e6ad936 WatchSource:0}: Error finding container 4943a994b140233d79b27f8f6266cb29f4661561dfefe6509b47025c2e6ad936: Status 404 returned error can't find the container with id 4943a994b140233d79b27f8f6266cb29f4661561dfefe6509b47025c2e6ad936
Sep 15 12:48:51.268798 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:51.268767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6578f45bb9-dqtfm" event={"ID":"aff22913-aba8-4a49-8b43-09a915062caa","Type":"ContainerStarted","Data":"a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f"}
Sep 15 12:48:51.269169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:51.268817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6578f45bb9-dqtfm" event={"ID":"aff22913-aba8-4a49-8b43-09a915062caa","Type":"ContainerStarted","Data":"4943a994b140233d79b27f8f6266cb29f4661561dfefe6509b47025c2e6ad936"}
Sep 15 12:48:51.291455 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:51.291408    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6578f45bb9-dqtfm" podStartSLOduration=1.2913930200000001 podStartE2EDuration="1.29139302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:48:51.289709686 +0000 UTC m=+236.652441279" watchObservedRunningTime="2026-09-15 12:48:51.29139302 +0000 UTC m=+236.654124619"
Sep 15 12:48:51.997549 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:51.997519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:48:52.064179 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:52.064146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:48:52.136161 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:48:52.136126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:00.401899 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:00.401867    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:49:00.402310 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:00.401947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:49:00.406802 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:00.406774    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:49:01.307632 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:01.307598    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:49:01.365156 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:01.365126    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646d694f5f-nrq7f"]
Sep 15 12:49:01.489380 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:01.489350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:01.589645 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:01.589561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:01.690312 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:01.690260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:01.757558 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:01.757525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:05.256837 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:05.256799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:05.357050 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:05.357017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:09.611117 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:09.611078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:49:26.389193 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.389082    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-646d694f5f-nrq7f" podUID="4f315eca-8f36-4620-8f46-73208d2a0b22" containerName="console" containerID="cri-o://93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb" gracePeriod=15
Sep 15 12:49:26.638030 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.638008    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:49:26.686722 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.686696    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-serving-cert\") pod \"4f315eca-8f36-4620-8f46-73208d2a0b22\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") "
Sep 15 12:49:26.686859 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.686730    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-trusted-ca-bundle\") pod \"4f315eca-8f36-4620-8f46-73208d2a0b22\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") "
Sep 15 12:49:26.686859 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.686756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-console-config\") pod \"4f315eca-8f36-4620-8f46-73208d2a0b22\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") "
Sep 15 12:49:26.686859 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.686778    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-oauth-serving-cert\") pod \"4f315eca-8f36-4620-8f46-73208d2a0b22\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") "
Sep 15 12:49:26.686859 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.686803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-oauth-config\") pod \"4f315eca-8f36-4620-8f46-73208d2a0b22\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") "
Sep 15 12:49:26.687054 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.686866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvrd9\" (UniqueName: \"kubernetes.io/projected/4f315eca-8f36-4620-8f46-73208d2a0b22-kube-api-access-xvrd9\") pod \"4f315eca-8f36-4620-8f46-73208d2a0b22\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") "
Sep 15 12:49:26.687054 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.686901    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-service-ca\") pod \"4f315eca-8f36-4620-8f46-73208d2a0b22\" (UID: \"4f315eca-8f36-4620-8f46-73208d2a0b22\") "
Sep 15 12:49:26.687300 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.687219    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-console-config" (OuterVolumeSpecName: "console-config") pod "4f315eca-8f36-4620-8f46-73208d2a0b22" (UID: "4f315eca-8f36-4620-8f46-73208d2a0b22"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:49:26.687300 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.687234    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f315eca-8f36-4620-8f46-73208d2a0b22" (UID: "4f315eca-8f36-4620-8f46-73208d2a0b22"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:49:26.687458 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.687359    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f315eca-8f36-4620-8f46-73208d2a0b22" (UID: "4f315eca-8f36-4620-8f46-73208d2a0b22"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:49:26.687458 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.687419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f315eca-8f36-4620-8f46-73208d2a0b22" (UID: "4f315eca-8f36-4620-8f46-73208d2a0b22"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:49:26.688866 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.688841    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f315eca-8f36-4620-8f46-73208d2a0b22" (UID: "4f315eca-8f36-4620-8f46-73208d2a0b22"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:49:26.689027 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.688998    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f315eca-8f36-4620-8f46-73208d2a0b22-kube-api-access-xvrd9" (OuterVolumeSpecName: "kube-api-access-xvrd9") pod "4f315eca-8f36-4620-8f46-73208d2a0b22" (UID: "4f315eca-8f36-4620-8f46-73208d2a0b22"). InnerVolumeSpecName "kube-api-access-xvrd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:49:26.689128 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.689026    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f315eca-8f36-4620-8f46-73208d2a0b22" (UID: "4f315eca-8f36-4620-8f46-73208d2a0b22"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:49:26.788172 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.788141    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:49:26.788172 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.788167    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-trusted-ca-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:49:26.788172 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.788176    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-console-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:49:26.788392 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.788186    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-oauth-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:49:26.788392 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.788194    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f315eca-8f36-4620-8f46-73208d2a0b22-console-oauth-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:49:26.788392 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.788202    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvrd9\" (UniqueName: \"kubernetes.io/projected/4f315eca-8f36-4620-8f46-73208d2a0b22-kube-api-access-xvrd9\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:49:26.788392 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:26.788212    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f315eca-8f36-4620-8f46-73208d2a0b22-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:49:27.397799 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.397765    2562 generic.go:356] "Generic (PLEG): container finished" podID="4f315eca-8f36-4620-8f46-73208d2a0b22" containerID="93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb" exitCode=0
Sep 15 12:49:27.398219 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.397805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646d694f5f-nrq7f" event={"ID":"4f315eca-8f36-4620-8f46-73208d2a0b22","Type":"ContainerDied","Data":"93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb"}
Sep 15 12:49:27.398219 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.397830    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646d694f5f-nrq7f"
Sep 15 12:49:27.398219 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.397869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646d694f5f-nrq7f" event={"ID":"4f315eca-8f36-4620-8f46-73208d2a0b22","Type":"ContainerDied","Data":"f0da770d38b1227f3c5ef995003343ffb2463fcd763af6d43f672f4d2bbbd0c2"}
Sep 15 12:49:27.398219 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.397888    2562 scope.go:117] "RemoveContainer" containerID="93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb"
Sep 15 12:49:27.405535 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.405518    2562 scope.go:117] "RemoveContainer" containerID="93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb"
Sep 15 12:49:27.405875 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:49:27.405850    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb\": container with ID starting with 93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb not found: ID does not exist" containerID="93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb"
Sep 15 12:49:27.405995 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.405885    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb"} err="failed to get container status \"93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb\": rpc error: code = NotFound desc = could not find container \"93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb\": container with ID starting with 93cd66112ad214035e7e25070e83c77ca01e63aed01953caa4191881d20595eb not found: ID does not exist"
Sep 15 12:49:27.417428 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.417403    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646d694f5f-nrq7f"]
Sep 15 12:49:27.420486 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:27.420466    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-646d694f5f-nrq7f"]
Sep 15 12:49:29.261115 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:29.261080    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f315eca-8f36-4620-8f46-73208d2a0b22" path="/var/lib/kubelet/pods/4f315eca-8f36-4620-8f46-73208d2a0b22/volumes"
Sep 15 12:49:55.175795 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:55.175763    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:49:55.178111 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:55.178091    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:49:55.183796 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:49:55.183773    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 12:50:12.560210 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:12.560170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:16.540299 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:16.540261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:16.702641 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:16.702612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:17.443319 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.443282    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"]
Sep 15 12:50:17.443580 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.443568    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f315eca-8f36-4620-8f46-73208d2a0b22" containerName="console"
Sep 15 12:50:17.443622 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.443582    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f315eca-8f36-4620-8f46-73208d2a0b22" containerName="console"
Sep 15 12:50:17.443656 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.443635    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f315eca-8f36-4620-8f46-73208d2a0b22" containerName="console"
Sep 15 12:50:17.446511 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.446494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.449661 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.449639    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 12:50:17.449817 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.449729    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 12:50:17.450824 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.450806    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvskx\""
Sep 15 12:50:17.459473 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.459449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"]
Sep 15 12:50:17.562919 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.562884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.562919 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.562918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqws\" (UniqueName: \"kubernetes.io/projected/88bc37cf-7ba8-406a-a15e-7ae9107572bc-kube-api-access-2wqws\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.563337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.562961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.663459 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.663426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.663459 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.663462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqws\" (UniqueName: \"kubernetes.io/projected/88bc37cf-7ba8-406a-a15e-7ae9107572bc-kube-api-access-2wqws\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.663670 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.663505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.663798 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.663777    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.663839 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.663803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.674511 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.674481    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqws\" (UniqueName: \"kubernetes.io/projected/88bc37cf-7ba8-406a-a15e-7ae9107572bc-kube-api-access-2wqws\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:17.755231 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:17.755157    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:18.029988 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:18.029926    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"]
Sep 15 12:50:18.032577 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:50:18.032552    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bc37cf_7ba8_406a_a15e_7ae9107572bc.slice/crio-4d9852b7c3a5b7b6343ade8f6b10a010947d3cd98cf19d29c2fd9964f6e60399 WatchSource:0}: Error finding container 4d9852b7c3a5b7b6343ade8f6b10a010947d3cd98cf19d29c2fd9964f6e60399: Status 404 returned error can't find the container with id 4d9852b7c3a5b7b6343ade8f6b10a010947d3cd98cf19d29c2fd9964f6e60399
Sep 15 12:50:18.034538 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:18.034520    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:50:18.586888 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:18.586845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw" event={"ID":"88bc37cf-7ba8-406a-a15e-7ae9107572bc","Type":"ContainerStarted","Data":"4d9852b7c3a5b7b6343ade8f6b10a010947d3cd98cf19d29c2fd9964f6e60399"}
Sep 15 12:50:24.612860 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:24.612827    2562 generic.go:356] "Generic (PLEG): container finished" podID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerID="f7f4271ce122c91a4c6f69665cd9cb8c8cdf9f17ff154e8d63208fdcc6ab8f06" exitCode=0
Sep 15 12:50:24.613281 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:24.612876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw" event={"ID":"88bc37cf-7ba8-406a-a15e-7ae9107572bc","Type":"ContainerDied","Data":"f7f4271ce122c91a4c6f69665cd9cb8c8cdf9f17ff154e8d63208fdcc6ab8f06"}
Sep 15 12:50:27.627303 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:27.627260    2562 generic.go:356] "Generic (PLEG): container finished" podID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerID="bcc4376a70afd76f539016d4690132ee222b342d3d2760c6053d03f4ef236ebf" exitCode=0
Sep 15 12:50:27.627673 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:27.627313    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw" event={"ID":"88bc37cf-7ba8-406a-a15e-7ae9107572bc","Type":"ContainerDied","Data":"bcc4376a70afd76f539016d4690132ee222b342d3d2760c6053d03f4ef236ebf"}
Sep 15 12:50:36.663416 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:36.663384    2562 generic.go:356] "Generic (PLEG): container finished" podID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerID="7c2267618d70d09e7d59a7f1a5a642d94288bf438eb07d640ea72359bd2971d6" exitCode=0
Sep 15 12:50:36.663771 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:36.663428    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw" event={"ID":"88bc37cf-7ba8-406a-a15e-7ae9107572bc","Type":"ContainerDied","Data":"7c2267618d70d09e7d59a7f1a5a642d94288bf438eb07d640ea72359bd2971d6"}
Sep 15 12:50:37.792017 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:37.791993    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:37.932221 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:37.932188    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wqws\" (UniqueName: \"kubernetes.io/projected/88bc37cf-7ba8-406a-a15e-7ae9107572bc-kube-api-access-2wqws\") pod \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") "
Sep 15 12:50:37.932375 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:37.932273    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-bundle\") pod \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") "
Sep 15 12:50:37.932437 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:37.932363    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-util\") pod \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\" (UID: \"88bc37cf-7ba8-406a-a15e-7ae9107572bc\") "
Sep 15 12:50:37.932875 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:37.932852    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-bundle" (OuterVolumeSpecName: "bundle") pod "88bc37cf-7ba8-406a-a15e-7ae9107572bc" (UID: "88bc37cf-7ba8-406a-a15e-7ae9107572bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:50:37.934390 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:37.934367    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88bc37cf-7ba8-406a-a15e-7ae9107572bc-kube-api-access-2wqws" (OuterVolumeSpecName: "kube-api-access-2wqws") pod "88bc37cf-7ba8-406a-a15e-7ae9107572bc" (UID: "88bc37cf-7ba8-406a-a15e-7ae9107572bc"). InnerVolumeSpecName "kube-api-access-2wqws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:50:37.936287 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:37.936269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-util" (OuterVolumeSpecName: "util") pod "88bc37cf-7ba8-406a-a15e-7ae9107572bc" (UID: "88bc37cf-7ba8-406a-a15e-7ae9107572bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:50:38.033978 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:38.033939    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wqws\" (UniqueName: \"kubernetes.io/projected/88bc37cf-7ba8-406a-a15e-7ae9107572bc-kube-api-access-2wqws\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:50:38.034110 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:38.033989    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:50:38.034110 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:38.033998    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bc37cf-7ba8-406a-a15e-7ae9107572bc-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:50:38.672748 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:38.672702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw" event={"ID":"88bc37cf-7ba8-406a-a15e-7ae9107572bc","Type":"ContainerDied","Data":"4d9852b7c3a5b7b6343ade8f6b10a010947d3cd98cf19d29c2fd9964f6e60399"}
Sep 15 12:50:38.672748 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:38.672729    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zcsrw"
Sep 15 12:50:38.672748 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:38.672754    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d9852b7c3a5b7b6343ade8f6b10a010947d3cd98cf19d29c2fd9964f6e60399"
Sep 15 12:50:43.596006 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:43.595978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:44.518504 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:44.518462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:45.979403 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979373    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"]
Sep 15 12:50:45.979780 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979666    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerName="extract"
Sep 15 12:50:45.979780 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979677    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerName="extract"
Sep 15 12:50:45.979780 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979688    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerName="pull"
Sep 15 12:50:45.979780 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979693    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerName="pull"
Sep 15 12:50:45.979780 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979700    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerName="util"
Sep 15 12:50:45.979780 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979705    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerName="util"
Sep 15 12:50:45.979780 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.979751    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="88bc37cf-7ba8-406a-a15e-7ae9107572bc" containerName="extract"
Sep 15 12:50:45.984506 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.984490    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:45.987514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.987492    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p8brq\""
Sep 15 12:50:45.987790 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.987776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 12:50:45.988187 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.988169    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 12:50:45.997300 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:45.997276    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"]
Sep 15 12:50:46.093271 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.093227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qg77\" (UniqueName: \"kubernetes.io/projected/7d250e50-f5d0-4f1b-96b7-c0d19a95cf66-kube-api-access-5qg77\") pod \"cert-manager-operator-controller-manager-55c444bf86-gmmhl\" (UID: \"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:46.093271 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.093273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d250e50-f5d0-4f1b-96b7-c0d19a95cf66-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gmmhl\" (UID: \"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:46.193940 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.193904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qg77\" (UniqueName: \"kubernetes.io/projected/7d250e50-f5d0-4f1b-96b7-c0d19a95cf66-kube-api-access-5qg77\") pod \"cert-manager-operator-controller-manager-55c444bf86-gmmhl\" (UID: \"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:46.194127 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.193949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d250e50-f5d0-4f1b-96b7-c0d19a95cf66-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gmmhl\" (UID: \"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:46.194338 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.194322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d250e50-f5d0-4f1b-96b7-c0d19a95cf66-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gmmhl\" (UID: \"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:46.205237 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.205210    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qg77\" (UniqueName: \"kubernetes.io/projected/7d250e50-f5d0-4f1b-96b7-c0d19a95cf66-kube-api-access-5qg77\") pod \"cert-manager-operator-controller-manager-55c444bf86-gmmhl\" (UID: \"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:46.293842 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.293761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"
Sep 15 12:50:46.575594 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.575567    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl"]
Sep 15 12:50:46.577869 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:50:46.577835    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d250e50_f5d0_4f1b_96b7_c0d19a95cf66.slice/crio-2a357a5121c2e10fa5e661bc447aa4b6536d35ebd38ad00b6eed892c80674e52 WatchSource:0}: Error finding container 2a357a5121c2e10fa5e661bc447aa4b6536d35ebd38ad00b6eed892c80674e52: Status 404 returned error can't find the container with id 2a357a5121c2e10fa5e661bc447aa4b6536d35ebd38ad00b6eed892c80674e52
Sep 15 12:50:46.704897 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:46.704862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl" event={"ID":"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66","Type":"ContainerStarted","Data":"2a357a5121c2e10fa5e661bc447aa4b6536d35ebd38ad00b6eed892c80674e52"}
Sep 15 12:50:47.405186 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:47.405109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:47.506825 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:47.506768    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:49.540480 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:49.540443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:49.638788 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:49.638753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:49.719082 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:49.719045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl" event={"ID":"7d250e50-f5d0-4f1b-96b7-c0d19a95cf66","Type":"ContainerStarted","Data":"15178b6b64a6cbbdc8b7c3274ee93589cece58235e4fc306e2eb7b3164088c21"}
Sep 15 12:50:49.745805 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:49.745752    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gmmhl" podStartSLOduration=2.461172803 podStartE2EDuration="4.745735472s" totalImagesPullingTime="2.284562669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:50:49.743544073 +0000 UTC m=+355.106275672" watchObservedRunningTime="2026-09-15 12:50:49.745735472 +0000 UTC m=+355.108467070"
Sep 15 12:50:50.145326 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.145289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:50.305105 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.305069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:50.402438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.402363    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"]
Sep 15 12:50:50.405770 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.405752    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.409696 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.409665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvskx\""
Sep 15 12:50:50.409935 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.409917    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 12:50:50.410574 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.410562    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 12:50:50.422485 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.422458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.422619 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.422510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrn8t\" (UniqueName: \"kubernetes.io/projected/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-kube-api-access-qrn8t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.422619 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.422546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.427107 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.427080    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"]
Sep 15 12:50:50.523029 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.522955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.523195 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.523063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrn8t\" (UniqueName: \"kubernetes.io/projected/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-kube-api-access-qrn8t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.523195 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.523097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.523342 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.523323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.523451 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.523421    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.544303 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.544274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrn8t\" (UniqueName: \"kubernetes.io/projected/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-kube-api-access-qrn8t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.547168 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.547142    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jvz47"]
Sep 15 12:50:50.550481 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.550462    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.553182 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.553163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 12:50:50.553320 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.553304    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 12:50:50.553390 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.553355    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bngql\""
Sep 15 12:50:50.575519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.575489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jvz47"]
Sep 15 12:50:50.623701 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.623658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66p5d\" (UniqueName: \"kubernetes.io/projected/e0e0a010-379e-4d23-82a8-578e24bc7920-kube-api-access-66p5d\") pod \"cert-manager-webhook-6486ffd997-jvz47\" (UID: \"e0e0a010-379e-4d23-82a8-578e24bc7920\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.623883 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.623756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e0a010-379e-4d23-82a8-578e24bc7920-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jvz47\" (UID: \"e0e0a010-379e-4d23-82a8-578e24bc7920\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.715025 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.714994    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:50.724210 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.724185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66p5d\" (UniqueName: \"kubernetes.io/projected/e0e0a010-379e-4d23-82a8-578e24bc7920-kube-api-access-66p5d\") pod \"cert-manager-webhook-6486ffd997-jvz47\" (UID: \"e0e0a010-379e-4d23-82a8-578e24bc7920\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.724331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.724234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e0a010-379e-4d23-82a8-578e24bc7920-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jvz47\" (UID: \"e0e0a010-379e-4d23-82a8-578e24bc7920\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.733388 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.733365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66p5d\" (UniqueName: \"kubernetes.io/projected/e0e0a010-379e-4d23-82a8-578e24bc7920-kube-api-access-66p5d\") pod \"cert-manager-webhook-6486ffd997-jvz47\" (UID: \"e0e0a010-379e-4d23-82a8-578e24bc7920\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.734600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.734577    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e0a010-379e-4d23-82a8-578e24bc7920-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jvz47\" (UID: \"e0e0a010-379e-4d23-82a8-578e24bc7920\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.859714 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.859678    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:50:50.997933 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:50.997905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"]
Sep 15 12:50:51.000402 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:50:51.000373    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf690a01b_bf07_48e4_9e46_d3eb0cde48ed.slice/crio-ef1cb6d2c9a87eb8fa20a2b09d2ea4a824bd46ca5a2248e894d5cc78ac8784de WatchSource:0}: Error finding container ef1cb6d2c9a87eb8fa20a2b09d2ea4a824bd46ca5a2248e894d5cc78ac8784de: Status 404 returned error can't find the container with id ef1cb6d2c9a87eb8fa20a2b09d2ea4a824bd46ca5a2248e894d5cc78ac8784de
Sep 15 12:50:51.136183 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:51.136160    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jvz47"]
Sep 15 12:50:51.160911 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:50:51.160877    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0e0a010_379e_4d23_82a8_578e24bc7920.slice/crio-5090f802736dbc1abc68ad364faa5fdf1ca25dec66ab795c35e9687064750c03 WatchSource:0}: Error finding container 5090f802736dbc1abc68ad364faa5fdf1ca25dec66ab795c35e9687064750c03: Status 404 returned error can't find the container with id 5090f802736dbc1abc68ad364faa5fdf1ca25dec66ab795c35e9687064750c03
Sep 15 12:50:51.597414 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:51.597378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:51.728318 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:51.728282    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47" event={"ID":"e0e0a010-379e-4d23-82a8-578e24bc7920","Type":"ContainerStarted","Data":"5090f802736dbc1abc68ad364faa5fdf1ca25dec66ab795c35e9687064750c03"}
Sep 15 12:50:51.729730 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:51.729703    2562 generic.go:356] "Generic (PLEG): container finished" podID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerID="a66f91142418ddb53ba18b1a1825096545dc03f24f3241899a19e2e152dadcfc" exitCode=0
Sep 15 12:50:51.729844 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:51.729740    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8" event={"ID":"f690a01b-bf07-48e4-9e46-d3eb0cde48ed","Type":"ContainerDied","Data":"a66f91142418ddb53ba18b1a1825096545dc03f24f3241899a19e2e152dadcfc"}
Sep 15 12:50:51.729844 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:51.729777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8" event={"ID":"f690a01b-bf07-48e4-9e46-d3eb0cde48ed","Type":"ContainerStarted","Data":"ef1cb6d2c9a87eb8fa20a2b09d2ea4a824bd46ca5a2248e894d5cc78ac8784de"}
Sep 15 12:50:51.974905 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:51.974867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:53.989028 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:53.988943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:54.089626 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:54.089583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:50:54.743898 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:54.743871    2562 generic.go:356] "Generic (PLEG): container finished" podID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerID="852d39365811ca6668cfc9d5bdb1785c61817b5c6a75473fa971b98f24c83e39" exitCode=0
Sep 15 12:50:54.744082 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:54.743925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8" event={"ID":"f690a01b-bf07-48e4-9e46-d3eb0cde48ed","Type":"ContainerDied","Data":"852d39365811ca6668cfc9d5bdb1785c61817b5c6a75473fa971b98f24c83e39"}
Sep 15 12:50:55.750125 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:55.750086    2562 generic.go:356] "Generic (PLEG): container finished" podID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerID="82f0dc50a1b94bd281b6f4dfd3e628806ce3f515db89468288d5688f8c9c41d0" exitCode=0
Sep 15 12:50:55.750513 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:55.750172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8" event={"ID":"f690a01b-bf07-48e4-9e46-d3eb0cde48ed","Type":"ContainerDied","Data":"82f0dc50a1b94bd281b6f4dfd3e628806ce3f515db89468288d5688f8c9c41d0"}
Sep 15 12:50:56.877602 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:56.877579    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:56.970141 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:56.970105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-bundle\") pod \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") "
Sep 15 12:50:56.970324 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:56.970161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrn8t\" (UniqueName: \"kubernetes.io/projected/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-kube-api-access-qrn8t\") pod \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") "
Sep 15 12:50:56.970324 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:56.970189    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-util\") pod \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\" (UID: \"f690a01b-bf07-48e4-9e46-d3eb0cde48ed\") "
Sep 15 12:50:56.970582 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:56.970553    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-bundle" (OuterVolumeSpecName: "bundle") pod "f690a01b-bf07-48e4-9e46-d3eb0cde48ed" (UID: "f690a01b-bf07-48e4-9e46-d3eb0cde48ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:50:56.972255 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:56.972229    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-kube-api-access-qrn8t" (OuterVolumeSpecName: "kube-api-access-qrn8t") pod "f690a01b-bf07-48e4-9e46-d3eb0cde48ed" (UID: "f690a01b-bf07-48e4-9e46-d3eb0cde48ed"). InnerVolumeSpecName "kube-api-access-qrn8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:50:56.976622 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:56.976591    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-util" (OuterVolumeSpecName: "util") pod "f690a01b-bf07-48e4-9e46-d3eb0cde48ed" (UID: "f690a01b-bf07-48e4-9e46-d3eb0cde48ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:50:57.070869 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:57.070786    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:50:57.070869 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:57.070818    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrn8t\" (UniqueName: \"kubernetes.io/projected/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-kube-api-access-qrn8t\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:50:57.070869 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:57.070828    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f690a01b-bf07-48e4-9e46-d3eb0cde48ed-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:50:57.759701 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:57.759670    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8"
Sep 15 12:50:57.759902 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:57.759703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftkvv8" event={"ID":"f690a01b-bf07-48e4-9e46-d3eb0cde48ed","Type":"ContainerDied","Data":"ef1cb6d2c9a87eb8fa20a2b09d2ea4a824bd46ca5a2248e894d5cc78ac8784de"}
Sep 15 12:50:57.759902 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:50:57.759753    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef1cb6d2c9a87eb8fa20a2b09d2ea4a824bd46ca5a2248e894d5cc78ac8784de"
Sep 15 12:51:00.349715 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:00.349681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:02.218316 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218283    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qpsl6"]
Sep 15 12:51:02.218665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218548    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerName="util"
Sep 15 12:51:02.218665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218558    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerName="util"
Sep 15 12:51:02.218665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218569    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerName="extract"
Sep 15 12:51:02.218665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218575    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerName="extract"
Sep 15 12:51:02.218665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218592    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerName="pull"
Sep 15 12:51:02.218665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218597    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerName="pull"
Sep 15 12:51:02.218665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.218644    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f690a01b-bf07-48e4-9e46-d3eb0cde48ed" containerName="extract"
Sep 15 12:51:02.221419 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.221402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.224271 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.224254    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k7567\""
Sep 15 12:51:02.232417 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.232397    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qpsl6"]
Sep 15 12:51:02.310014 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.309950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq9vb\" (UniqueName: \"kubernetes.io/projected/529440d2-7d95-455d-a82b-daa0b03932ce-kube-api-access-wq9vb\") pod \"cert-manager-55b4d954d5-qpsl6\" (UID: \"529440d2-7d95-455d-a82b-daa0b03932ce\") " pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.310166 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.310065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/529440d2-7d95-455d-a82b-daa0b03932ce-bound-sa-token\") pod \"cert-manager-55b4d954d5-qpsl6\" (UID: \"529440d2-7d95-455d-a82b-daa0b03932ce\") " pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.335814 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.335738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:02.405612 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.405578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:02.410562 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.410540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9vb\" (UniqueName: \"kubernetes.io/projected/529440d2-7d95-455d-a82b-daa0b03932ce-kube-api-access-wq9vb\") pod \"cert-manager-55b4d954d5-qpsl6\" (UID: \"529440d2-7d95-455d-a82b-daa0b03932ce\") " pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.410662 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.410622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/529440d2-7d95-455d-a82b-daa0b03932ce-bound-sa-token\") pod \"cert-manager-55b4d954d5-qpsl6\" (UID: \"529440d2-7d95-455d-a82b-daa0b03932ce\") " pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.423532 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.423507    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/529440d2-7d95-455d-a82b-daa0b03932ce-bound-sa-token\") pod \"cert-manager-55b4d954d5-qpsl6\" (UID: \"529440d2-7d95-455d-a82b-daa0b03932ce\") " pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.423804 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.423783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9vb\" (UniqueName: \"kubernetes.io/projected/529440d2-7d95-455d-a82b-daa0b03932ce-kube-api-access-wq9vb\") pod \"cert-manager-55b4d954d5-qpsl6\" (UID: \"529440d2-7d95-455d-a82b-daa0b03932ce\") " pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.530204 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.530165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qpsl6"
Sep 15 12:51:02.782517 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.782487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47" event={"ID":"e0e0a010-379e-4d23-82a8-578e24bc7920","Type":"ContainerStarted","Data":"b26cdb3137c3dddcf87f6d284bd5563910cf04398f426e650576da08d8577795"}
Sep 15 12:51:02.782686 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.782605    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:51:02.811486 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.811461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qpsl6"]
Sep 15 12:51:02.813327 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:02.813298    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod529440d2_7d95_455d_a82b_daa0b03932ce.slice/crio-f08acdcedb9e3e8e974ff3bb969a775e98b724a2ac2099c285122a2169e86bb5 WatchSource:0}: Error finding container f08acdcedb9e3e8e974ff3bb969a775e98b724a2ac2099c285122a2169e86bb5: Status 404 returned error can't find the container with id f08acdcedb9e3e8e974ff3bb969a775e98b724a2ac2099c285122a2169e86bb5
Sep 15 12:51:02.861428 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:02.861386    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47" podStartSLOduration=1.956904564 podStartE2EDuration="12.861368926s" totalImagesPullingTime="10.904464362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:02.850747187 +0000 UTC m=+368.213478786" watchObservedRunningTime="2026-09-15 12:51:02.861368926 +0000 UTC m=+368.224100526"
Sep 15 12:51:03.788923 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:03.788881    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qpsl6" event={"ID":"529440d2-7d95-455d-a82b-daa0b03932ce","Type":"ContainerStarted","Data":"fc7b6e71278847c9ceef2db528a6c79563d9c565f8db9d86c63a39230365a454"}
Sep 15 12:51:03.788923 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:03.788930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qpsl6" event={"ID":"529440d2-7d95-455d-a82b-daa0b03932ce","Type":"ContainerStarted","Data":"f08acdcedb9e3e8e974ff3bb969a775e98b724a2ac2099c285122a2169e86bb5"}
Sep 15 12:51:03.809429 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:03.809379    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qpsl6" podStartSLOduration=1.809363683 podStartE2EDuration="1.809363683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:03.807205737 +0000 UTC m=+369.169937335" watchObservedRunningTime="2026-09-15 12:51:03.809363683 +0000 UTC m=+369.172095283"
Sep 15 12:51:04.443132 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:04.443096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:04.543455 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:04.543418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:06.632282 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.632252    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"]
Sep 15 12:51:06.688252 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.688220    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"]
Sep 15 12:51:06.688410 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.688309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:06.693413 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.693390    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 12:51:06.693603 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.693584    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g57cx\""
Sep 15 12:51:06.694019 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.693999    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 12:51:06.746702 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.746668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7tjn\" (UniqueName: \"kubernetes.io/projected/09638324-98e3-4a71-b97c-38004a2d3ac6-kube-api-access-t7tjn\") pod \"openshift-lws-operator-fd8ccff4c-5fjrt\" (UID: \"09638324-98e3-4a71-b97c-38004a2d3ac6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:06.746868 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.746754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09638324-98e3-4a71-b97c-38004a2d3ac6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fjrt\" (UID: \"09638324-98e3-4a71-b97c-38004a2d3ac6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:06.847748 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.847712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09638324-98e3-4a71-b97c-38004a2d3ac6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fjrt\" (UID: \"09638324-98e3-4a71-b97c-38004a2d3ac6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:06.847893 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.847773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7tjn\" (UniqueName: \"kubernetes.io/projected/09638324-98e3-4a71-b97c-38004a2d3ac6-kube-api-access-t7tjn\") pod \"openshift-lws-operator-fd8ccff4c-5fjrt\" (UID: \"09638324-98e3-4a71-b97c-38004a2d3ac6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:06.848225 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.848203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09638324-98e3-4a71-b97c-38004a2d3ac6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fjrt\" (UID: \"09638324-98e3-4a71-b97c-38004a2d3ac6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:06.857682 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.857651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7tjn\" (UniqueName: \"kubernetes.io/projected/09638324-98e3-4a71-b97c-38004a2d3ac6-kube-api-access-t7tjn\") pod \"openshift-lws-operator-fd8ccff4c-5fjrt\" (UID: \"09638324-98e3-4a71-b97c-38004a2d3ac6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:06.997278 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:06.997247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"
Sep 15 12:51:07.293298 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:07.293276    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt"]
Sep 15 12:51:07.295556 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:07.295529    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09638324_98e3_4a71_b97c_38004a2d3ac6.slice/crio-63c8dd2702f69d2a2df1e8073877e37a6e385727bbaf56e70d48cc8062c5194e WatchSource:0}: Error finding container 63c8dd2702f69d2a2df1e8073877e37a6e385727bbaf56e70d48cc8062c5194e: Status 404 returned error can't find the container with id 63c8dd2702f69d2a2df1e8073877e37a6e385727bbaf56e70d48cc8062c5194e
Sep 15 12:51:07.811339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:07.811306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt" event={"ID":"09638324-98e3-4a71-b97c-38004a2d3ac6","Type":"ContainerStarted","Data":"63c8dd2702f69d2a2df1e8073877e37a6e385727bbaf56e70d48cc8062c5194e"}
Sep 15 12:51:08.792066 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:08.792033    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jvz47"
Sep 15 12:51:09.822661 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:09.822624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt" event={"ID":"09638324-98e3-4a71-b97c-38004a2d3ac6","Type":"ContainerStarted","Data":"90ceae17458021bf454cda0f38212f9926a41980186e77d276b6a3f09dc54276"}
Sep 15 12:51:09.852375 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:09.852328    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fjrt" podStartSLOduration=2.19796202 podStartE2EDuration="3.852312465s" totalImagesPullingTime="1.654350445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:09.850330206 +0000 UTC m=+375.213061801" watchObservedRunningTime="2026-09-15 12:51:09.852312465 +0000 UTC m=+375.215044065"
Sep 15 12:51:10.643101 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:10.643066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:10.743707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:10.743672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:12.593687 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:12.593645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:14.009425 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.009391    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"]
Sep 15 12:51:14.012815 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.012797    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.015852 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.015832    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 12:51:14.016109 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.016093    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 12:51:14.017165 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.017147    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvskx\""
Sep 15 12:51:14.022673 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.022646    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"]
Sep 15 12:51:14.104663 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.104633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.104836 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.104673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.104836 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.104699    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x662\" (UniqueName: \"kubernetes.io/projected/8cb2cae5-c274-4d21-bfab-07f198c1dc92-kube-api-access-6x662\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.205827 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.205793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.206007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.205839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.206007 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.205884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x662\" (UniqueName: \"kubernetes.io/projected/8cb2cae5-c274-4d21-bfab-07f198c1dc92-kube-api-access-6x662\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.206188 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.206172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.206247 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.206191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.217025 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.216999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x662\" (UniqueName: \"kubernetes.io/projected/8cb2cae5-c274-4d21-bfab-07f198c1dc92-kube-api-access-6x662\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.322125 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.322053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:14.593957 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.593933    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"]
Sep 15 12:51:14.596113 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:14.596088    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb2cae5_c274_4d21_bfab_07f198c1dc92.slice/crio-6652f9fa45317a4f8214d3fbc44b54329b6c93f0c528b53b64ac04eb07c06085 WatchSource:0}: Error finding container 6652f9fa45317a4f8214d3fbc44b54329b6c93f0c528b53b64ac04eb07c06085: Status 404 returned error can't find the container with id 6652f9fa45317a4f8214d3fbc44b54329b6c93f0c528b53b64ac04eb07c06085
Sep 15 12:51:14.846270 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.846191    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerID="14411fdfc69a56c49ba2798c87961aca90248b26bb83cdf4bd9cd6319840db35" exitCode=0
Sep 15 12:51:14.846270 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.846252    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8" event={"ID":"8cb2cae5-c274-4d21-bfab-07f198c1dc92","Type":"ContainerDied","Data":"14411fdfc69a56c49ba2798c87961aca90248b26bb83cdf4bd9cd6319840db35"}
Sep 15 12:51:14.846421 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:14.846295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8" event={"ID":"8cb2cae5-c274-4d21-bfab-07f198c1dc92","Type":"ContainerStarted","Data":"6652f9fa45317a4f8214d3fbc44b54329b6c93f0c528b53b64ac04eb07c06085"}
Sep 15 12:51:15.852273 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:15.852190    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerID="bf3b45231acff2d60457260916389fde72be641da3eb3119f797e8a98510530e" exitCode=0
Sep 15 12:51:15.852634 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:15.852278    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8" event={"ID":"8cb2cae5-c274-4d21-bfab-07f198c1dc92","Type":"ContainerDied","Data":"bf3b45231acff2d60457260916389fde72be641da3eb3119f797e8a98510530e"}
Sep 15 12:51:16.858764 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:16.858727    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerID="10965cb25661f632c235c08c2d14bfed817f183c0f5ce8ef464a387f0c21e2db" exitCode=0
Sep 15 12:51:16.859287 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:16.858808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8" event={"ID":"8cb2cae5-c274-4d21-bfab-07f198c1dc92","Type":"ContainerDied","Data":"10965cb25661f632c235c08c2d14bfed817f183c0f5ce8ef464a387f0c21e2db"}
Sep 15 12:51:17.987221 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:17.987196    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:18.036775 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.036750    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-bundle\") pod \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") "
Sep 15 12:51:18.036896 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.036803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x662\" (UniqueName: \"kubernetes.io/projected/8cb2cae5-c274-4d21-bfab-07f198c1dc92-kube-api-access-6x662\") pod \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") "
Sep 15 12:51:18.036896 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.036837    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-util\") pod \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\" (UID: \"8cb2cae5-c274-4d21-bfab-07f198c1dc92\") "
Sep 15 12:51:18.037829 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.037778    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-bundle" (OuterVolumeSpecName: "bundle") pod "8cb2cae5-c274-4d21-bfab-07f198c1dc92" (UID: "8cb2cae5-c274-4d21-bfab-07f198c1dc92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:51:18.044180 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.044103    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cb2cae5-c274-4d21-bfab-07f198c1dc92-kube-api-access-6x662" (OuterVolumeSpecName: "kube-api-access-6x662") pod "8cb2cae5-c274-4d21-bfab-07f198c1dc92" (UID: "8cb2cae5-c274-4d21-bfab-07f198c1dc92"). InnerVolumeSpecName "kube-api-access-6x662". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:51:18.044674 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.044627    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-util" (OuterVolumeSpecName: "util") pod "8cb2cae5-c274-4d21-bfab-07f198c1dc92" (UID: "8cb2cae5-c274-4d21-bfab-07f198c1dc92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:51:18.137422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.137323    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x662\" (UniqueName: \"kubernetes.io/projected/8cb2cae5-c274-4d21-bfab-07f198c1dc92-kube-api-access-6x662\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:18.137422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.137366    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:18.137422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.137381    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cb2cae5-c274-4d21-bfab-07f198c1dc92-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:18.869459 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.869423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8" event={"ID":"8cb2cae5-c274-4d21-bfab-07f198c1dc92","Type":"ContainerDied","Data":"6652f9fa45317a4f8214d3fbc44b54329b6c93f0c528b53b64ac04eb07c06085"}
Sep 15 12:51:18.869623 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.869475    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6652f9fa45317a4f8214d3fbc44b54329b6c93f0c528b53b64ac04eb07c06085"
Sep 15 12:51:18.869623 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:18.869435    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbbp8"
Sep 15 12:51:21.732842 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.732808    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d848f7b8f-csn67"]
Sep 15 12:51:21.733217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.733091    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerName="util"
Sep 15 12:51:21.733217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.733103    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerName="util"
Sep 15 12:51:21.733217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.733115    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerName="extract"
Sep 15 12:51:21.733217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.733121    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerName="extract"
Sep 15 12:51:21.733217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.733128    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerName="pull"
Sep 15 12:51:21.733217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.733133    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerName="pull"
Sep 15 12:51:21.733217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.733200    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cb2cae5-c274-4d21-bfab-07f198c1dc92" containerName="extract"
Sep 15 12:51:21.736184 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.736167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.764027 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.764001    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d848f7b8f-csn67"]
Sep 15 12:51:21.803561 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.803531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:21.866617 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.866589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5df09846-c7e0-46ea-8579-58b1a80385d3-console-oauth-config\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.866755 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.866635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-service-ca\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.866755 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.866685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-trusted-ca-bundle\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.866755 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.866729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5df09846-c7e0-46ea-8579-58b1a80385d3-console-serving-cert\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.866861 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.866758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr4zc\" (UniqueName: \"kubernetes.io/projected/5df09846-c7e0-46ea-8579-58b1a80385d3-kube-api-access-kr4zc\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.866861 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.866814    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-console-config\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.866861 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.866828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-oauth-serving-cert\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.875225 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.875198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:21.967480 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.967431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-console-config\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.967480 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.967473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-oauth-serving-cert\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.967721 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.967499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5df09846-c7e0-46ea-8579-58b1a80385d3-console-oauth-config\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.967721 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.967539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-service-ca\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.967721 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.967556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-trusted-ca-bundle\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.967721 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.967586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5df09846-c7e0-46ea-8579-58b1a80385d3-console-serving-cert\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.967721 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.967623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr4zc\" (UniqueName: \"kubernetes.io/projected/5df09846-c7e0-46ea-8579-58b1a80385d3-kube-api-access-kr4zc\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.968347 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.968319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-console-config\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.968347 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.968344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-service-ca\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.968347 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.968319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-oauth-serving-cert\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.968544 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.968435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5df09846-c7e0-46ea-8579-58b1a80385d3-trusted-ca-bundle\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.970029 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.970010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5df09846-c7e0-46ea-8579-58b1a80385d3-console-oauth-config\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.970137 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.970119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5df09846-c7e0-46ea-8579-58b1a80385d3-console-serving-cert\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:21.978112 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:21.978094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr4zc\" (UniqueName: \"kubernetes.io/projected/5df09846-c7e0-46ea-8579-58b1a80385d3-kube-api-access-kr4zc\") pod \"console-5d848f7b8f-csn67\" (UID: \"5df09846-c7e0-46ea-8579-58b1a80385d3\") " pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:22.045193 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:22.045115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:22.322132 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:22.321995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d848f7b8f-csn67"]
Sep 15 12:51:22.324123 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:22.324093    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df09846_c7e0_46ea_8579_58b1a80385d3.slice/crio-7ada22adb731e7336f39fa79850d3b8a2810e1f826123036522dc5c3f933032e WatchSource:0}: Error finding container 7ada22adb731e7336f39fa79850d3b8a2810e1f826123036522dc5c3f933032e: Status 404 returned error can't find the container with id 7ada22adb731e7336f39fa79850d3b8a2810e1f826123036522dc5c3f933032e
Sep 15 12:51:22.887352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:22.887309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d848f7b8f-csn67" event={"ID":"5df09846-c7e0-46ea-8579-58b1a80385d3","Type":"ContainerStarted","Data":"fdd8fa379b5fcb0b919b2d5fc9f0173e55fb86b11311fcb985550bc37a5e4298"}
Sep 15 12:51:22.887796 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:22.887360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d848f7b8f-csn67" event={"ID":"5df09846-c7e0-46ea-8579-58b1a80385d3","Type":"ContainerStarted","Data":"7ada22adb731e7336f39fa79850d3b8a2810e1f826123036522dc5c3f933032e"}
Sep 15 12:51:22.926902 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:22.926850    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d848f7b8f-csn67" podStartSLOduration=1.926832424 podStartE2EDuration="1.926832424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:22.925952602 +0000 UTC m=+388.288684202" watchObservedRunningTime="2026-09-15 12:51:22.926832424 +0000 UTC m=+388.289564023"
Sep 15 12:51:24.003023 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.002989    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"]
Sep 15 12:51:24.006288 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.006272    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.009879 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.009854    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvskx\""
Sep 15 12:51:24.012418 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.012396    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 12:51:24.012530 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.012400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 12:51:24.029840 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.029811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"]
Sep 15 12:51:24.085864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.085831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.085864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.085864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.086092 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.085885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq5n8\" (UniqueName: \"kubernetes.io/projected/4139ff36-f065-4731-9c56-8152f2f25eb6-kube-api-access-mq5n8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.186431 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.186379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.186431 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.186433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.186677 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.186453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq5n8\" (UniqueName: \"kubernetes.io/projected/4139ff36-f065-4731-9c56-8152f2f25eb6-kube-api-access-mq5n8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.186866 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.186842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.186939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.186850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.198598 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.198575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq5n8\" (UniqueName: \"kubernetes.io/projected/4139ff36-f065-4731-9c56-8152f2f25eb6-kube-api-access-mq5n8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.316062 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.315982    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:24.598180 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.598156    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"]
Sep 15 12:51:24.600075 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:24.600051    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4139ff36_f065_4731_9c56_8152f2f25eb6.slice/crio-8420cacb0a90c2a0070d6647226f686356b09662b64fa89b58077764f48585e9 WatchSource:0}: Error finding container 8420cacb0a90c2a0070d6647226f686356b09662b64fa89b58077764f48585e9: Status 404 returned error can't find the container with id 8420cacb0a90c2a0070d6647226f686356b09662b64fa89b58077764f48585e9
Sep 15 12:51:24.896998 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.896894    2562 generic.go:356] "Generic (PLEG): container finished" podID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerID="50e434cfa3626378ce77c641648bf6802cb51795c1ef632b76d82083405168cb" exitCode=0
Sep 15 12:51:24.896998 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.896936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq" event={"ID":"4139ff36-f065-4731-9c56-8152f2f25eb6","Type":"ContainerDied","Data":"50e434cfa3626378ce77c641648bf6802cb51795c1ef632b76d82083405168cb"}
Sep 15 12:51:24.897178 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:24.896999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq" event={"ID":"4139ff36-f065-4731-9c56-8152f2f25eb6","Type":"ContainerStarted","Data":"8420cacb0a90c2a0070d6647226f686356b09662b64fa89b58077764f48585e9"}
Sep 15 12:51:25.153446 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:25.153368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:25.352812 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:25.352775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:25.844318 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:25.844280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:25.903442 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:25.903364    2562 generic.go:356] "Generic (PLEG): container finished" podID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerID="ec03b6ead44e95f6f544662833e0eb0e1a96b8485f74335c88ae25d95deb95f4" exitCode=0
Sep 15 12:51:25.903569 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:25.903447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq" event={"ID":"4139ff36-f065-4731-9c56-8152f2f25eb6","Type":"ContainerDied","Data":"ec03b6ead44e95f6f544662833e0eb0e1a96b8485f74335c88ae25d95deb95f4"}
Sep 15 12:51:26.071949 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:51:26.071922    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4139ff36_f065_4731_9c56_8152f2f25eb6.slice/crio-d405e7e7cdf38d23cb9264898cbb17d41fcce0e771341fd12fbc8187aab965ad.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 12:51:26.381534 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.381503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:26.629773 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.629738    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"]
Sep 15 12:51:26.632947 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.632906    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.638126 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.638058    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g67c7\""
Sep 15 12:51:26.638289 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.638270    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 12:51:26.638369 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.638286    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 12:51:26.638369 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.638339    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 12:51:26.638474 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.638367    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 12:51:26.672751 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.672724    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"]
Sep 15 12:51:26.691797 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.691764    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:26.705578 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.705555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a353736b-020d-49ac-bc12-3c41d7515d17-tmp\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.705648 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.705583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a353736b-020d-49ac-bc12-3c41d7515d17-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.705648 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.705623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a353736b-020d-49ac-bc12-3c41d7515d17-manifests\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.705737 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.705693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a353736b-020d-49ac-bc12-3c41d7515d17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.705778 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.705737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snsgs\" (UniqueName: \"kubernetes.io/projected/a353736b-020d-49ac-bc12-3c41d7515d17-kube-api-access-snsgs\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.806298 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.806260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a353736b-020d-49ac-bc12-3c41d7515d17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.806298 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.806300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snsgs\" (UniqueName: \"kubernetes.io/projected/a353736b-020d-49ac-bc12-3c41d7515d17-kube-api-access-snsgs\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.806586 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.806370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a353736b-020d-49ac-bc12-3c41d7515d17-tmp\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.806586 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.806389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a353736b-020d-49ac-bc12-3c41d7515d17-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.806586 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.806432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a353736b-020d-49ac-bc12-3c41d7515d17-manifests\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.806831 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.806801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a353736b-020d-49ac-bc12-3c41d7515d17-manifests\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.808592 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.808562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a353736b-020d-49ac-bc12-3c41d7515d17-tmp\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.808818 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.808802    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a353736b-020d-49ac-bc12-3c41d7515d17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.808911 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.808890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a353736b-020d-49ac-bc12-3c41d7515d17-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.824742 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.824719    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snsgs\" (UniqueName: \"kubernetes.io/projected/a353736b-020d-49ac-bc12-3c41d7515d17-kube-api-access-snsgs\") pod \"opendatahub-operator-controller-manager-79946fddd6-z4rkw\" (UID: \"a353736b-020d-49ac-bc12-3c41d7515d17\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:26.906997 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.906885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:26.910465 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.910442    2562 generic.go:356] "Generic (PLEG): container finished" podID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerID="d405e7e7cdf38d23cb9264898cbb17d41fcce0e771341fd12fbc8187aab965ad" exitCode=0
Sep 15 12:51:26.910567 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.910505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq" event={"ID":"4139ff36-f065-4731-9c56-8152f2f25eb6","Type":"ContainerDied","Data":"d405e7e7cdf38d23cb9264898cbb17d41fcce0e771341fd12fbc8187aab965ad"}
Sep 15 12:51:26.942347 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:26.942322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:27.006376 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:27.006337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:27.220877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:27.220855    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"]
Sep 15 12:51:27.223580 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:27.223554    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda353736b_020d_49ac_bc12_3c41d7515d17.slice/crio-093c79b2acc6d4048ebd97814a93c548935642a2630d7134380bcf89e3d0b9e3 WatchSource:0}: Error finding container 093c79b2acc6d4048ebd97814a93c548935642a2630d7134380bcf89e3d0b9e3: Status 404 returned error can't find the container with id 093c79b2acc6d4048ebd97814a93c548935642a2630d7134380bcf89e3d0b9e3
Sep 15 12:51:27.318154 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:27.318120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:27.431020 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:27.430988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:27.916634 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:27.916597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw" event={"ID":"a353736b-020d-49ac-bc12-3c41d7515d17","Type":"ContainerStarted","Data":"093c79b2acc6d4048ebd97814a93c548935642a2630d7134380bcf89e3d0b9e3"}
Sep 15 12:51:28.038934 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.038908    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:28.117379 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.117331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-bundle\") pod \"4139ff36-f065-4731-9c56-8152f2f25eb6\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") "
Sep 15 12:51:28.117379 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.117385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq5n8\" (UniqueName: \"kubernetes.io/projected/4139ff36-f065-4731-9c56-8152f2f25eb6-kube-api-access-mq5n8\") pod \"4139ff36-f065-4731-9c56-8152f2f25eb6\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") "
Sep 15 12:51:28.117772 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.117461    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-util\") pod \"4139ff36-f065-4731-9c56-8152f2f25eb6\" (UID: \"4139ff36-f065-4731-9c56-8152f2f25eb6\") "
Sep 15 12:51:28.118351 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.118317    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-bundle" (OuterVolumeSpecName: "bundle") pod "4139ff36-f065-4731-9c56-8152f2f25eb6" (UID: "4139ff36-f065-4731-9c56-8152f2f25eb6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:51:28.120109 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.120081    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4139ff36-f065-4731-9c56-8152f2f25eb6-kube-api-access-mq5n8" (OuterVolumeSpecName: "kube-api-access-mq5n8") pod "4139ff36-f065-4731-9c56-8152f2f25eb6" (UID: "4139ff36-f065-4731-9c56-8152f2f25eb6"). InnerVolumeSpecName "kube-api-access-mq5n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:51:28.125468 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.125438    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-util" (OuterVolumeSpecName: "util") pod "4139ff36-f065-4731-9c56-8152f2f25eb6" (UID: "4139ff36-f065-4731-9c56-8152f2f25eb6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:51:28.218514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.218430    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:28.218514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.218471    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq5n8\" (UniqueName: \"kubernetes.io/projected/4139ff36-f065-4731-9c56-8152f2f25eb6-kube-api-access-mq5n8\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:28.218514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.218488    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4139ff36-f065-4731-9c56-8152f2f25eb6-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:28.926542 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.926507    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq"
Sep 15 12:51:28.926542 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.926524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02dcrq" event={"ID":"4139ff36-f065-4731-9c56-8152f2f25eb6","Type":"ContainerDied","Data":"8420cacb0a90c2a0070d6647226f686356b09662b64fa89b58077764f48585e9"}
Sep 15 12:51:28.927026 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:28.926573    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8420cacb0a90c2a0070d6647226f686356b09662b64fa89b58077764f48585e9"
Sep 15 12:51:30.938006 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:30.937957    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw" event={"ID":"a353736b-020d-49ac-bc12-3c41d7515d17","Type":"ContainerStarted","Data":"b323f17c5802e7e05311434234e88b518c6384582717ed5b48a8dea09d677393"}
Sep 15 12:51:31.947115 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:31.947080    2562 generic.go:356] "Generic (PLEG): container finished" podID="a353736b-020d-49ac-bc12-3c41d7515d17" containerID="b323f17c5802e7e05311434234e88b518c6384582717ed5b48a8dea09d677393" exitCode=0
Sep 15 12:51:31.947585 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:31.947128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw" event={"ID":"a353736b-020d-49ac-bc12-3c41d7515d17","Type":"ContainerDied","Data":"b323f17c5802e7e05311434234e88b518c6384582717ed5b48a8dea09d677393"}
Sep 15 12:51:32.046329 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:32.046293    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:32.046527 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:32.046359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:32.050869 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:32.050845    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:32.953650 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:32.953604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw" event={"ID":"a353736b-020d-49ac-bc12-3c41d7515d17","Type":"ContainerStarted","Data":"b215bbea2fc4a0c6370be2e6f60ad0de4d2e63196ac4eb4b5e928f9afc663cad"}
Sep 15 12:51:32.954137 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:32.953920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:32.957646 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:32.957622    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d848f7b8f-csn67"
Sep 15 12:51:32.988261 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:32.988205    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw" podStartSLOduration=2.3298677039999998 podStartE2EDuration="6.988189906s" totalImagesPullingTime="3.565048161s" totalInitContainerRuntime="1.093274041s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:32.986313743 +0000 UTC m=+398.349045344" watchObservedRunningTime="2026-09-15 12:51:32.988189906 +0000 UTC m=+398.350921505"
Sep 15 12:51:33.047784 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:33.047754    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6578f45bb9-dqtfm"]
Sep 15 12:51:33.223533 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:33.223427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:33.432640 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:33.432611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:36.677901 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:36.677849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:36.801350 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:36.801314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:40.503235 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:40.503199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:40.670325 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:40.670288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:43.960733 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:43.960704    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-z4rkw"
Sep 15 12:51:45.942765 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:45.942723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:46.087508 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.087474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:46.363998 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.363897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:46.530164 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530131    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"]
Sep 15 12:51:46.530434 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530422    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerName="extract"
Sep 15 12:51:46.530479 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530436    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerName="extract"
Sep 15 12:51:46.530479 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530447    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerName="pull"
Sep 15 12:51:46.530479 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530452    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerName="pull"
Sep 15 12:51:46.530479 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530472    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerName="util"
Sep 15 12:51:46.530479 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530479    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerName="util"
Sep 15 12:51:46.530635 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.530529    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4139ff36-f065-4731-9c56-8152f2f25eb6" containerName="extract"
Sep 15 12:51:46.538075 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.538055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.551783 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.551761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 12:51:46.552667 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.552650    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 12:51:46.552753 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.552735    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 12:51:46.562245 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.562218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 12:51:46.566840 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.566806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"]
Sep 15 12:51:46.637600 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.637476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:46.669937 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.669904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72313d42-b2b9-4024-a745-0b84fba93f1c-tls-certs\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.670104 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.669987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcvjk\" (UniqueName: \"kubernetes.io/projected/72313d42-b2b9-4024-a745-0b84fba93f1c-kube-api-access-wcvjk\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.670104 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.670022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72313d42-b2b9-4024-a745-0b84fba93f1c-tmp\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.771253 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.771217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcvjk\" (UniqueName: \"kubernetes.io/projected/72313d42-b2b9-4024-a745-0b84fba93f1c-kube-api-access-wcvjk\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.771417 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.771261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72313d42-b2b9-4024-a745-0b84fba93f1c-tmp\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.771417 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.771385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72313d42-b2b9-4024-a745-0b84fba93f1c-tls-certs\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.773337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.773310    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72313d42-b2b9-4024-a745-0b84fba93f1c-tmp\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.773705 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.773688    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72313d42-b2b9-4024-a745-0b84fba93f1c-tls-certs\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.788432 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.788404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcvjk\" (UniqueName: \"kubernetes.io/projected/72313d42-b2b9-4024-a745-0b84fba93f1c-kube-api-access-wcvjk\") pod \"kube-auth-proxy-7cfb95df68-nnz8j\" (UID: \"72313d42-b2b9-4024-a745-0b84fba93f1c\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:46.847870 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:46.847838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"
Sep 15 12:51:47.140444 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:47.140416    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j"]
Sep 15 12:51:47.142589 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:47.142560    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72313d42_b2b9_4024_a745_0b84fba93f1c.slice/crio-b51e463c76062b659d2beb06ea7d2ae0575ff90102f41adf7d8b4a08848ef8d6 WatchSource:0}: Error finding container b51e463c76062b659d2beb06ea7d2ae0575ff90102f41adf7d8b4a08848ef8d6: Status 404 returned error can't find the container with id b51e463c76062b659d2beb06ea7d2ae0575ff90102f41adf7d8b4a08848ef8d6
Sep 15 12:51:48.026728 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:48.026686    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j" event={"ID":"72313d42-b2b9-4024-a745-0b84fba93f1c","Type":"ContainerStarted","Data":"b51e463c76062b659d2beb06ea7d2ae0575ff90102f41adf7d8b4a08848ef8d6"}
Sep 15 12:51:48.247132 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:48.247102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:48.352021 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:48.351928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:48.442408 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:48.442354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:48.508596 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:48.508551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:49.762000 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:49.761951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:50.034519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:50.034434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:50.038097 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:50.038070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j" event={"ID":"72313d42-b2b9-4024-a745-0b84fba93f1c","Type":"ContainerStarted","Data":"92731121fbfc78f7678175b39fbc93c9e9f2ca9a23f4e4d10b5d917c5ccbe6da"}
Sep 15 12:51:50.073232 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:50.073189    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-nnz8j" podStartSLOduration=1.403863512 podStartE2EDuration="4.073175473s" totalImagesPullingTime="2.669311961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:50.072998254 +0000 UTC m=+415.435729847" watchObservedRunningTime="2026-09-15 12:51:50.073175473 +0000 UTC m=+415.435907072"
Sep 15 12:51:50.259848 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:50.259811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:53.286842 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:53.286814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:53.867734 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:53.867702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:54.016096 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:54.016061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:54.257325 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:54.257285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:54.347122 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:54.347092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:57.109933 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.109901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:57.660673 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.660629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:57.706467 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.706434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-phl5g"]
Sep 15 12:51:57.711258 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.711243    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:57.715008 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.714986    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 12:51:57.715427 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.715409    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-j4sl2\""
Sep 15 12:51:57.726681 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.726655    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-phl5g"]
Sep 15 12:51:57.761529 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.761494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:57.862979 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.862940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc6db00-906e-412e-a058-3aec25177aa9-tls-certs\") pod \"model-serving-api-54d89bd5fc-phl5g\" (UID: \"1dc6db00-906e-412e-a058-3aec25177aa9\") " pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:57.863141 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.862995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpszn\" (UniqueName: \"kubernetes.io/projected/1dc6db00-906e-412e-a058-3aec25177aa9-kube-api-access-lpszn\") pod \"model-serving-api-54d89bd5fc-phl5g\" (UID: \"1dc6db00-906e-412e-a058-3aec25177aa9\") " pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:57.963944 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.963912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc6db00-906e-412e-a058-3aec25177aa9-tls-certs\") pod \"model-serving-api-54d89bd5fc-phl5g\" (UID: \"1dc6db00-906e-412e-a058-3aec25177aa9\") " pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:57.964085 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.963979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpszn\" (UniqueName: \"kubernetes.io/projected/1dc6db00-906e-412e-a058-3aec25177aa9-kube-api-access-lpszn\") pod \"model-serving-api-54d89bd5fc-phl5g\" (UID: \"1dc6db00-906e-412e-a058-3aec25177aa9\") " pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:57.964129 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:51:57.964083    2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 15 12:51:57.964174 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:51:57.964162    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc6db00-906e-412e-a058-3aec25177aa9-tls-certs podName:1dc6db00-906e-412e-a058-3aec25177aa9 nodeName:}" failed. No retries permitted until 2026-09-15 12:51:58.464141936 +0000 UTC m=+423.826873515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1dc6db00-906e-412e-a058-3aec25177aa9-tls-certs") pod "model-serving-api-54d89bd5fc-phl5g" (UID: "1dc6db00-906e-412e-a058-3aec25177aa9") : secret "model-serving-api-tls" not found
Sep 15 12:51:57.973054 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:57.973027    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpszn\" (UniqueName: \"kubernetes.io/projected/1dc6db00-906e-412e-a058-3aec25177aa9-kube-api-access-lpszn\") pod \"model-serving-api-54d89bd5fc-phl5g\" (UID: \"1dc6db00-906e-412e-a058-3aec25177aa9\") " pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:58.070167 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.070128    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6578f45bb9-dqtfm" podUID="aff22913-aba8-4a49-8b43-09a915062caa" containerName="console" containerID="cri-o://a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f" gracePeriod=15
Sep 15 12:51:58.210867 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.210836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:51:58.314342 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.314320    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:51:58.469122 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469092    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krt8m\" (UniqueName: \"kubernetes.io/projected/aff22913-aba8-4a49-8b43-09a915062caa-kube-api-access-krt8m\") pod \"aff22913-aba8-4a49-8b43-09a915062caa\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") "
Sep 15 12:51:58.469305 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469134    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-service-ca\") pod \"aff22913-aba8-4a49-8b43-09a915062caa\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") "
Sep 15 12:51:58.469305 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469199    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-oauth-serving-cert\") pod \"aff22913-aba8-4a49-8b43-09a915062caa\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") "
Sep 15 12:51:58.469305 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469218    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-serving-cert\") pod \"aff22913-aba8-4a49-8b43-09a915062caa\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") "
Sep 15 12:51:58.469519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-trusted-ca-bundle\") pod \"aff22913-aba8-4a49-8b43-09a915062caa\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") "
Sep 15 12:51:58.469519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-console-config\") pod \"aff22913-aba8-4a49-8b43-09a915062caa\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") "
Sep 15 12:51:58.469519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469418    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-oauth-config\") pod \"aff22913-aba8-4a49-8b43-09a915062caa\" (UID: \"aff22913-aba8-4a49-8b43-09a915062caa\") "
Sep 15 12:51:58.469687 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc6db00-906e-412e-a058-3aec25177aa9-tls-certs\") pod \"model-serving-api-54d89bd5fc-phl5g\" (UID: \"1dc6db00-906e-412e-a058-3aec25177aa9\") " pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:58.469746 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469712    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-service-ca" (OuterVolumeSpecName: "service-ca") pod "aff22913-aba8-4a49-8b43-09a915062caa" (UID: "aff22913-aba8-4a49-8b43-09a915062caa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:51:58.469873 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469844    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aff22913-aba8-4a49-8b43-09a915062caa" (UID: "aff22913-aba8-4a49-8b43-09a915062caa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:51:58.469873 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469854    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aff22913-aba8-4a49-8b43-09a915062caa" (UID: "aff22913-aba8-4a49-8b43-09a915062caa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:51:58.470064 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.469844    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-console-config" (OuterVolumeSpecName: "console-config") pod "aff22913-aba8-4a49-8b43-09a915062caa" (UID: "aff22913-aba8-4a49-8b43-09a915062caa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:51:58.471484 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.471453    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aff22913-aba8-4a49-8b43-09a915062caa" (UID: "aff22913-aba8-4a49-8b43-09a915062caa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:51:58.471841 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.471819    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aff22913-aba8-4a49-8b43-09a915062caa" (UID: "aff22913-aba8-4a49-8b43-09a915062caa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:51:58.471841 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.471832    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff22913-aba8-4a49-8b43-09a915062caa-kube-api-access-krt8m" (OuterVolumeSpecName: "kube-api-access-krt8m") pod "aff22913-aba8-4a49-8b43-09a915062caa" (UID: "aff22913-aba8-4a49-8b43-09a915062caa"). InnerVolumeSpecName "kube-api-access-krt8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:51:58.472044 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.472026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc6db00-906e-412e-a058-3aec25177aa9-tls-certs\") pod \"model-serving-api-54d89bd5fc-phl5g\" (UID: \"1dc6db00-906e-412e-a058-3aec25177aa9\") " pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:58.571169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.571073    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-oauth-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:58.571169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.571106    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krt8m\" (UniqueName: \"kubernetes.io/projected/aff22913-aba8-4a49-8b43-09a915062caa-kube-api-access-krt8m\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:58.571169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.571119    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:58.571169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.571131    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-oauth-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:58.571169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.571143    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aff22913-aba8-4a49-8b43-09a915062caa-console-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:58.571169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.571155    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-trusted-ca-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:58.571169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.571166    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aff22913-aba8-4a49-8b43-09a915062caa-console-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:51:58.621348 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.621306    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:51:58.894371 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:58.894295    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-phl5g"]
Sep 15 12:51:58.897243 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:51:58.897219    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc6db00_906e_412e_a058_3aec25177aa9.slice/crio-8503e20d6496d3781d4aa4031037e1985670a69f7632e03922316b4366432845 WatchSource:0}: Error finding container 8503e20d6496d3781d4aa4031037e1985670a69f7632e03922316b4366432845: Status 404 returned error can't find the container with id 8503e20d6496d3781d4aa4031037e1985670a69f7632e03922316b4366432845
Sep 15 12:51:59.079102 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.079061    2562 generic.go:356] "Generic (PLEG): container finished" podID="aff22913-aba8-4a49-8b43-09a915062caa" containerID="a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f" exitCode=0
Sep 15 12:51:59.079269 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.079108    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6578f45bb9-dqtfm"
Sep 15 12:51:59.079269 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.079132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6578f45bb9-dqtfm" event={"ID":"aff22913-aba8-4a49-8b43-09a915062caa","Type":"ContainerDied","Data":"a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f"}
Sep 15 12:51:59.079269 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.079182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6578f45bb9-dqtfm" event={"ID":"aff22913-aba8-4a49-8b43-09a915062caa","Type":"ContainerDied","Data":"4943a994b140233d79b27f8f6266cb29f4661561dfefe6509b47025c2e6ad936"}
Sep 15 12:51:59.079269 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.079197    2562 scope.go:117] "RemoveContainer" containerID="a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f"
Sep 15 12:51:59.080644 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.080619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-phl5g" event={"ID":"1dc6db00-906e-412e-a058-3aec25177aa9","Type":"ContainerStarted","Data":"8503e20d6496d3781d4aa4031037e1985670a69f7632e03922316b4366432845"}
Sep 15 12:51:59.088311 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.088292    2562 scope.go:117] "RemoveContainer" containerID="a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f"
Sep 15 12:51:59.088610 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:51:59.088584    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f\": container with ID starting with a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f not found: ID does not exist" containerID="a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f"
Sep 15 12:51:59.088665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.088615    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f"} err="failed to get container status \"a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f\": rpc error: code = NotFound desc = could not find container \"a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f\": container with ID starting with a8c5d5705d044459724254aed89fd229917b983d932887650e45a6385b8dc96f not found: ID does not exist"
Sep 15 12:51:59.104639 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.104616    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6578f45bb9-dqtfm"]
Sep 15 12:51:59.111240 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.111206    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6578f45bb9-dqtfm"]
Sep 15 12:51:59.262384 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:51:59.262346    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff22913-aba8-4a49-8b43-09a915062caa" path="/var/lib/kubelet/pods/aff22913-aba8-4a49-8b43-09a915062caa/volumes"
Sep 15 12:52:02.098079 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:02.098047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-phl5g" event={"ID":"1dc6db00-906e-412e-a058-3aec25177aa9","Type":"ContainerStarted","Data":"6c6a2c654758e3903bb75c684a7ee936a2c4d4b2aa6cd97cccc795de15857f51"}
Sep 15 12:52:02.098523 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:02.098143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:52:02.120404 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:02.120342    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-phl5g" podStartSLOduration=2.74388654 podStartE2EDuration="5.120325285s" totalImagesPullingTime="2.376438745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:52:02.118686909 +0000 UTC m=+427.481418518" watchObservedRunningTime="2026-09-15 12:52:02.120325285 +0000 UTC m=+427.483056884"
Sep 15 12:52:04.672426 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.672392    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"]
Sep 15 12:52:04.672860 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.672688    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff22913-aba8-4a49-8b43-09a915062caa" containerName="console"
Sep 15 12:52:04.672860 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.672698    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff22913-aba8-4a49-8b43-09a915062caa" containerName="console"
Sep 15 12:52:04.672860 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.672751    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff22913-aba8-4a49-8b43-09a915062caa" containerName="console"
Sep 15 12:52:04.675763 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.675747    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.678886 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.678861    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 12:52:04.678886 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.678880    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 12:52:04.679209 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.678936    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 12:52:04.679209 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.679150    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gdw9j\""
Sep 15 12:52:04.687249 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.687227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"]
Sep 15 12:52:04.725277 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.725246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7532f9b4-39b6-44d8-ab5f-b30931cddb20-metrics-cert\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.725433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.725296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7532f9b4-39b6-44d8-ab5f-b30931cddb20-manager-config\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.725433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.725326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c9xc\" (UniqueName: \"kubernetes.io/projected/7532f9b4-39b6-44d8-ab5f-b30931cddb20-kube-api-access-5c9xc\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.725433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.725399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7532f9b4-39b6-44d8-ab5f-b30931cddb20-cert\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.825852 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.825816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7532f9b4-39b6-44d8-ab5f-b30931cddb20-cert\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.826069 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.825875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7532f9b4-39b6-44d8-ab5f-b30931cddb20-metrics-cert\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.826069 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.825918    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7532f9b4-39b6-44d8-ab5f-b30931cddb20-manager-config\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.826069 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.825960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c9xc\" (UniqueName: \"kubernetes.io/projected/7532f9b4-39b6-44d8-ab5f-b30931cddb20-kube-api-access-5c9xc\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.826606 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.826577    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7532f9b4-39b6-44d8-ab5f-b30931cddb20-manager-config\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.828324 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.828298    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7532f9b4-39b6-44d8-ab5f-b30931cddb20-metrics-cert\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.828427 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.828329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7532f9b4-39b6-44d8-ab5f-b30931cddb20-cert\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.845513 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.845492    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c9xc\" (UniqueName: \"kubernetes.io/projected/7532f9b4-39b6-44d8-ab5f-b30931cddb20-kube-api-access-5c9xc\") pod \"lws-controller-manager-c5fdc7d8d-lhcsm\" (UID: \"7532f9b4-39b6-44d8-ab5f-b30931cddb20\") " pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:04.985071 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:04.984987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:05.260506 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:52:05.260481    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7532f9b4_39b6_44d8_ab5f_b30931cddb20.slice/crio-774b04bd61be97e99dc246a421dc24d8f143583858fbebd51e1cec4f67396075 WatchSource:0}: Error finding container 774b04bd61be97e99dc246a421dc24d8f143583858fbebd51e1cec4f67396075: Status 404 returned error can't find the container with id 774b04bd61be97e99dc246a421dc24d8f143583858fbebd51e1cec4f67396075
Sep 15 12:52:05.262234 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:05.262205    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"]
Sep 15 12:52:06.119981 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:06.119933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm" event={"ID":"7532f9b4-39b6-44d8-ab5f-b30931cddb20","Type":"ContainerStarted","Data":"774b04bd61be97e99dc246a421dc24d8f143583858fbebd51e1cec4f67396075"}
Sep 15 12:52:07.126568 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:07.126471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm" event={"ID":"7532f9b4-39b6-44d8-ab5f-b30931cddb20","Type":"ContainerStarted","Data":"a42a19f92a284ce59b1c87030258400c36aaf3b7b6d9808835cd624a2abb04e7"}
Sep 15 12:52:07.126926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:07.126569    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:07.178349 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:07.178291    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm" podStartSLOduration=1.665155957 podStartE2EDuration="3.178274785s" totalImagesPullingTime="1.513118828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:52:07.177243664 +0000 UTC m=+432.539975259" watchObservedRunningTime="2026-09-15 12:52:07.178274785 +0000 UTC m=+432.541006383"
Sep 15 12:52:08.112488 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:08.112454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:52:08.272756 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:08.272726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:52:08.408718 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:08.408635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:52:09.182523 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:09.182486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:52:09.262705 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:09.262673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:52:13.107139 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:13.107108    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-phl5g"
Sep 15 12:52:18.136458 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:18.136382    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c5fdc7d8d-lhcsm"
Sep 15 12:52:53.651350 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:53.651318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:52:58.213504 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:58.213459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:52:58.382545 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:52:58.382504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:03.385094 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.385064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"]
Sep 15 12:53:03.389776 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.389756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.392824 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.392804    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvskx\""
Sep 15 12:53:03.392931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.392829    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 12:53:03.393907 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.393884    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 12:53:03.398958 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.398938    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"]
Sep 15 12:53:03.405908 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.405881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprc2\" (UniqueName: \"kubernetes.io/projected/383591b0-941d-4e01-90d0-956b7822a721-kube-api-access-hprc2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.406033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.405944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.406033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.405995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.490693 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.490653    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"]
Sep 15 12:53:03.494202 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.494183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.507148 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.507331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.507331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.507331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.507331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhrps\" (UniqueName: \"kubernetes.io/projected/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-kube-api-access-dhrps\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.507534 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprc2\" (UniqueName: \"kubernetes.io/projected/383591b0-941d-4e01-90d0-956b7822a721-kube-api-access-hprc2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.507588 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.507588 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.507560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.511615 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.511587    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"]
Sep 15 12:53:03.525313 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.525284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprc2\" (UniqueName: \"kubernetes.io/projected/383591b0-941d-4e01-90d0-956b7822a721-kube-api-access-hprc2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.607917 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.607880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.608104 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.607932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.608104 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.607975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhrps\" (UniqueName: \"kubernetes.io/projected/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-kube-api-access-dhrps\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.608367 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.608346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.608404 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.608361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.620738 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.620704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhrps\" (UniqueName: \"kubernetes.io/projected/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-kube-api-access-dhrps\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.624451 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.624425    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"]
Sep 15 12:53:03.628684 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.628665    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.646030 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.645942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"]
Sep 15 12:53:03.699982 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.699926    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:03.709167 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.709140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.709285 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.709178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.709285 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.709266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww96z\" (UniqueName: \"kubernetes.io/projected/899682c0-92fd-4a95-88ba-045cee416925-kube-api-access-ww96z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.751249 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.751219    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"]
Sep 15 12:53:03.755586 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.755561    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.785304 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.785266    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"]
Sep 15 12:53:03.802858 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.802826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:03.809943 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.809922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl8dn\" (UniqueName: \"kubernetes.io/projected/66cddc1a-4952-4982-8256-2fadeb1a22ff-kube-api-access-nl8dn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.810035 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.809953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww96z\" (UniqueName: \"kubernetes.io/projected/899682c0-92fd-4a95-88ba-045cee416925-kube-api-access-ww96z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.810077 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.810059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.810144 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.810128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.810183 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.810160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.810234 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.810192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.810474 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.810458    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.810549 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.810504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.832537 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.832506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww96z\" (UniqueName: \"kubernetes.io/projected/899682c0-92fd-4a95-88ba-045cee416925-kube-api-access-ww96z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.910686 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.910581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.910686 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.910675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.910871 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.910729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl8dn\" (UniqueName: \"kubernetes.io/projected/66cddc1a-4952-4982-8256-2fadeb1a22ff-kube-api-access-nl8dn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.911104 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.911085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.911145 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.911105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.929814 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.929790    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl8dn\" (UniqueName: \"kubernetes.io/projected/66cddc1a-4952-4982-8256-2fadeb1a22ff-kube-api-access-nl8dn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:03.937648 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.937629    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:03.982896 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:03.982868    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"]
Sep 15 12:53:03.985392 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:53:03.985365    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383591b0_941d_4e01_90d0_956b7822a721.slice/crio-6871dcd0e3090dc00d4e465ed91bca1dfb63143d2d407d2181c11d74728b3d77 WatchSource:0}: Error finding container 6871dcd0e3090dc00d4e465ed91bca1dfb63143d2d407d2181c11d74728b3d77: Status 404 returned error can't find the container with id 6871dcd0e3090dc00d4e465ed91bca1dfb63143d2d407d2181c11d74728b3d77
Sep 15 12:53:04.066418 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.066383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:04.097663 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.097633    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"]
Sep 15 12:53:04.127300 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:53:04.127252    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e9ae1c_e383_43cf_a2a4_79ef470d8773.slice/crio-c8077fbb53f47848ee91687fffff35cfa326c52c5e83d76c09a166c4941f5f29 WatchSource:0}: Error finding container c8077fbb53f47848ee91687fffff35cfa326c52c5e83d76c09a166c4941f5f29: Status 404 returned error can't find the container with id c8077fbb53f47848ee91687fffff35cfa326c52c5e83d76c09a166c4941f5f29
Sep 15 12:53:04.228661 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.228638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"]
Sep 15 12:53:04.282835 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:53:04.282808    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899682c0_92fd_4a95_88ba_045cee416925.slice/crio-0feead22cd1332407b1472e648ea904bc6271bbdaee5301d0ba2bed8453f964a WatchSource:0}: Error finding container 0feead22cd1332407b1472e648ea904bc6271bbdaee5301d0ba2bed8453f964a: Status 404 returned error can't find the container with id 0feead22cd1332407b1472e648ea904bc6271bbdaee5301d0ba2bed8453f964a
Sep 15 12:53:04.355113 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.355089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"]
Sep 15 12:53:04.358725 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:53:04.358698    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66cddc1a_4952_4982_8256_2fadeb1a22ff.slice/crio-b506516ad812f830df983be51cf69ffd6694e2f0cef546943bb51dfd73459c7f WatchSource:0}: Error finding container b506516ad812f830df983be51cf69ffd6694e2f0cef546943bb51dfd73459c7f: Status 404 returned error can't find the container with id b506516ad812f830df983be51cf69ffd6694e2f0cef546943bb51dfd73459c7f
Sep 15 12:53:04.406273 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.406239    2562 generic.go:356] "Generic (PLEG): container finished" podID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerID="309c427c604d538ede2ebafc4ee23c005682b4fb1137b452fb1d4e72ce240590" exitCode=0
Sep 15 12:53:04.406681 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.406324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp" event={"ID":"c0e9ae1c-e383-43cf-a2a4-79ef470d8773","Type":"ContainerDied","Data":"309c427c604d538ede2ebafc4ee23c005682b4fb1137b452fb1d4e72ce240590"}
Sep 15 12:53:04.406681 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.406374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp" event={"ID":"c0e9ae1c-e383-43cf-a2a4-79ef470d8773","Type":"ContainerStarted","Data":"c8077fbb53f47848ee91687fffff35cfa326c52c5e83d76c09a166c4941f5f29"}
Sep 15 12:53:04.408147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.407956    2562 generic.go:356] "Generic (PLEG): container finished" podID="899682c0-92fd-4a95-88ba-045cee416925" containerID="abb1567c84758314a7138794a4addab70fd16cc429b1492dceabcc995d97ef10" exitCode=0
Sep 15 12:53:04.408147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.408011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z" event={"ID":"899682c0-92fd-4a95-88ba-045cee416925","Type":"ContainerDied","Data":"abb1567c84758314a7138794a4addab70fd16cc429b1492dceabcc995d97ef10"}
Sep 15 12:53:04.408147 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.408072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z" event={"ID":"899682c0-92fd-4a95-88ba-045cee416925","Type":"ContainerStarted","Data":"0feead22cd1332407b1472e648ea904bc6271bbdaee5301d0ba2bed8453f964a"}
Sep 15 12:53:04.409468 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.409399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv" event={"ID":"66cddc1a-4952-4982-8256-2fadeb1a22ff","Type":"ContainerStarted","Data":"b506516ad812f830df983be51cf69ffd6694e2f0cef546943bb51dfd73459c7f"}
Sep 15 12:53:04.411285 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.411261    2562 generic.go:356] "Generic (PLEG): container finished" podID="383591b0-941d-4e01-90d0-956b7822a721" containerID="83d7020341ac224b07cc473aff210cb54a29593ede841b716aa4ec9a9a4474ad" exitCode=0
Sep 15 12:53:04.411368 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.411309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg" event={"ID":"383591b0-941d-4e01-90d0-956b7822a721","Type":"ContainerDied","Data":"83d7020341ac224b07cc473aff210cb54a29593ede841b716aa4ec9a9a4474ad"}
Sep 15 12:53:04.411368 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:04.411341    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg" event={"ID":"383591b0-941d-4e01-90d0-956b7822a721","Type":"ContainerStarted","Data":"6871dcd0e3090dc00d4e465ed91bca1dfb63143d2d407d2181c11d74728b3d77"}
Sep 15 12:53:05.417456 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:05.417424    2562 generic.go:356] "Generic (PLEG): container finished" podID="899682c0-92fd-4a95-88ba-045cee416925" containerID="8be024795caf29c9af02dc06763c5d83403bf093ddd640698927a925a8ae22d3" exitCode=0
Sep 15 12:53:05.417798 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:05.417494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z" event={"ID":"899682c0-92fd-4a95-88ba-045cee416925","Type":"ContainerDied","Data":"8be024795caf29c9af02dc06763c5d83403bf093ddd640698927a925a8ae22d3"}
Sep 15 12:53:05.419083 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:05.419061    2562 generic.go:356] "Generic (PLEG): container finished" podID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerID="e7c5cdb60efc340ee9bd96a3b58bc34564605cf55bc1bbf442e4ad0c9474344a" exitCode=0
Sep 15 12:53:05.419157 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:05.419135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv" event={"ID":"66cddc1a-4952-4982-8256-2fadeb1a22ff","Type":"ContainerDied","Data":"e7c5cdb60efc340ee9bd96a3b58bc34564605cf55bc1bbf442e4ad0c9474344a"}
Sep 15 12:53:06.426572 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:06.426543    2562 generic.go:356] "Generic (PLEG): container finished" podID="899682c0-92fd-4a95-88ba-045cee416925" containerID="9fdb1b3a1697f0dd98f2cb1e96ab828f81f8480d4564d0d189afbff2796e7f1d" exitCode=0
Sep 15 12:53:06.426956 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:06.426619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z" event={"ID":"899682c0-92fd-4a95-88ba-045cee416925","Type":"ContainerDied","Data":"9fdb1b3a1697f0dd98f2cb1e96ab828f81f8480d4564d0d189afbff2796e7f1d"}
Sep 15 12:53:06.428429 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:06.428405    2562 generic.go:356] "Generic (PLEG): container finished" podID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerID="c821ad415cfd09af43d2916e76a2a8ca9b574d55e94e71a55a93649afeb3bd0f" exitCode=0
Sep 15 12:53:06.428544 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:06.428482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv" event={"ID":"66cddc1a-4952-4982-8256-2fadeb1a22ff","Type":"ContainerDied","Data":"c821ad415cfd09af43d2916e76a2a8ca9b574d55e94e71a55a93649afeb3bd0f"}
Sep 15 12:53:06.430243 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:06.430225    2562 generic.go:356] "Generic (PLEG): container finished" podID="383591b0-941d-4e01-90d0-956b7822a721" containerID="529625feeb8eb857ef1bff50bb55503fb449d1f856ae30d9ebcead831afeed2c" exitCode=0
Sep 15 12:53:06.430340 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:06.430253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg" event={"ID":"383591b0-941d-4e01-90d0-956b7822a721","Type":"ContainerDied","Data":"529625feeb8eb857ef1bff50bb55503fb449d1f856ae30d9ebcead831afeed2c"}
Sep 15 12:53:07.437265 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.437231    2562 generic.go:356] "Generic (PLEG): container finished" podID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerID="59c840241820cc60971bc1d5fd12e1e018af360565be6835e06608f54cf5a67b" exitCode=0
Sep 15 12:53:07.437663 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.437306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv" event={"ID":"66cddc1a-4952-4982-8256-2fadeb1a22ff","Type":"ContainerDied","Data":"59c840241820cc60971bc1d5fd12e1e018af360565be6835e06608f54cf5a67b"}
Sep 15 12:53:07.439273 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.439247    2562 generic.go:356] "Generic (PLEG): container finished" podID="383591b0-941d-4e01-90d0-956b7822a721" containerID="807b1c1908c84bbc6283c4d6fdc94456a188d762377e422ca1215eba9feb11ad" exitCode=0
Sep 15 12:53:07.439360 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.439287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg" event={"ID":"383591b0-941d-4e01-90d0-956b7822a721","Type":"ContainerDied","Data":"807b1c1908c84bbc6283c4d6fdc94456a188d762377e422ca1215eba9feb11ad"}
Sep 15 12:53:07.440895 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.440876    2562 generic.go:356] "Generic (PLEG): container finished" podID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerID="a45e7aecb0fd9959afb0f8d9d578bafa64ed97ec591e94fbb19541a529503093" exitCode=0
Sep 15 12:53:07.440991 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.440956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp" event={"ID":"c0e9ae1c-e383-43cf-a2a4-79ef470d8773","Type":"ContainerDied","Data":"a45e7aecb0fd9959afb0f8d9d578bafa64ed97ec591e94fbb19541a529503093"}
Sep 15 12:53:07.578735 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.578709    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:07.637725 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.637692    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww96z\" (UniqueName: \"kubernetes.io/projected/899682c0-92fd-4a95-88ba-045cee416925-kube-api-access-ww96z\") pod \"899682c0-92fd-4a95-88ba-045cee416925\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") "
Sep 15 12:53:07.639698 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.639676    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899682c0-92fd-4a95-88ba-045cee416925-kube-api-access-ww96z" (OuterVolumeSpecName: "kube-api-access-ww96z") pod "899682c0-92fd-4a95-88ba-045cee416925" (UID: "899682c0-92fd-4a95-88ba-045cee416925"). InnerVolumeSpecName "kube-api-access-ww96z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:53:07.738789 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.738705    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-bundle\") pod \"899682c0-92fd-4a95-88ba-045cee416925\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") "
Sep 15 12:53:07.738789 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.738747    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-util\") pod \"899682c0-92fd-4a95-88ba-045cee416925\" (UID: \"899682c0-92fd-4a95-88ba-045cee416925\") "
Sep 15 12:53:07.739038 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.738891    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww96z\" (UniqueName: \"kubernetes.io/projected/899682c0-92fd-4a95-88ba-045cee416925-kube-api-access-ww96z\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:07.739321 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.739295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-bundle" (OuterVolumeSpecName: "bundle") pod "899682c0-92fd-4a95-88ba-045cee416925" (UID: "899682c0-92fd-4a95-88ba-045cee416925"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:07.743766 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.743741    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-util" (OuterVolumeSpecName: "util") pod "899682c0-92fd-4a95-88ba-045cee416925" (UID: "899682c0-92fd-4a95-88ba-045cee416925"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:07.839729 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.839687    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:07.839729 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:07.839721    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/899682c0-92fd-4a95-88ba-045cee416925-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:08.453069 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.453036    2562 generic.go:356] "Generic (PLEG): container finished" podID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerID="0da1d8c0380a00d00c348d08587af99e33b8cd8c72b106c63dcba67dd84e05c8" exitCode=0
Sep 15 12:53:08.453494 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.453119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp" event={"ID":"c0e9ae1c-e383-43cf-a2a4-79ef470d8773","Type":"ContainerDied","Data":"0da1d8c0380a00d00c348d08587af99e33b8cd8c72b106c63dcba67dd84e05c8"}
Sep 15 12:53:08.454932 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.454902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z" event={"ID":"899682c0-92fd-4a95-88ba-045cee416925","Type":"ContainerDied","Data":"0feead22cd1332407b1472e648ea904bc6271bbdaee5301d0ba2bed8453f964a"}
Sep 15 12:53:08.455059 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.454948    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0feead22cd1332407b1472e648ea904bc6271bbdaee5301d0ba2bed8453f964a"
Sep 15 12:53:08.455212 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.455200    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxhk4z"
Sep 15 12:53:08.585126 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.585090    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:08.607469 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.607441    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:08.647242 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.647209    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-util\") pod \"66cddc1a-4952-4982-8256-2fadeb1a22ff\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") "
Sep 15 12:53:08.647411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.647289    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-bundle\") pod \"383591b0-941d-4e01-90d0-956b7822a721\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") "
Sep 15 12:53:08.647411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.647317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl8dn\" (UniqueName: \"kubernetes.io/projected/66cddc1a-4952-4982-8256-2fadeb1a22ff-kube-api-access-nl8dn\") pod \"66cddc1a-4952-4982-8256-2fadeb1a22ff\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") "
Sep 15 12:53:08.647411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.647341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hprc2\" (UniqueName: \"kubernetes.io/projected/383591b0-941d-4e01-90d0-956b7822a721-kube-api-access-hprc2\") pod \"383591b0-941d-4e01-90d0-956b7822a721\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") "
Sep 15 12:53:08.647411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.647375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-bundle\") pod \"66cddc1a-4952-4982-8256-2fadeb1a22ff\" (UID: \"66cddc1a-4952-4982-8256-2fadeb1a22ff\") "
Sep 15 12:53:08.647411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.647403    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-util\") pod \"383591b0-941d-4e01-90d0-956b7822a721\" (UID: \"383591b0-941d-4e01-90d0-956b7822a721\") "
Sep 15 12:53:08.647910 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.647882    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-bundle" (OuterVolumeSpecName: "bundle") pod "383591b0-941d-4e01-90d0-956b7822a721" (UID: "383591b0-941d-4e01-90d0-956b7822a721"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:08.648230 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.648195    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-bundle" (OuterVolumeSpecName: "bundle") pod "66cddc1a-4952-4982-8256-2fadeb1a22ff" (UID: "66cddc1a-4952-4982-8256-2fadeb1a22ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:08.650175 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.650138    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/383591b0-941d-4e01-90d0-956b7822a721-kube-api-access-hprc2" (OuterVolumeSpecName: "kube-api-access-hprc2") pod "383591b0-941d-4e01-90d0-956b7822a721" (UID: "383591b0-941d-4e01-90d0-956b7822a721"). InnerVolumeSpecName "kube-api-access-hprc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:53:08.650257 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.650243    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66cddc1a-4952-4982-8256-2fadeb1a22ff-kube-api-access-nl8dn" (OuterVolumeSpecName: "kube-api-access-nl8dn") pod "66cddc1a-4952-4982-8256-2fadeb1a22ff" (UID: "66cddc1a-4952-4982-8256-2fadeb1a22ff"). InnerVolumeSpecName "kube-api-access-nl8dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:53:08.654123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.654071    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-util" (OuterVolumeSpecName: "util") pod "66cddc1a-4952-4982-8256-2fadeb1a22ff" (UID: "66cddc1a-4952-4982-8256-2fadeb1a22ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:08.655725 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.655693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-util" (OuterVolumeSpecName: "util") pod "383591b0-941d-4e01-90d0-956b7822a721" (UID: "383591b0-941d-4e01-90d0-956b7822a721"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:08.748236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.748157    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:08.748236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.748183    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl8dn\" (UniqueName: \"kubernetes.io/projected/66cddc1a-4952-4982-8256-2fadeb1a22ff-kube-api-access-nl8dn\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:08.748236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.748193    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprc2\" (UniqueName: \"kubernetes.io/projected/383591b0-941d-4e01-90d0-956b7822a721-kube-api-access-hprc2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:08.748236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.748202    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:08.748236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.748211    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/383591b0-941d-4e01-90d0-956b7822a721-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:08.748236 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:08.748218    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66cddc1a-4952-4982-8256-2fadeb1a22ff-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:09.462532 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.462503    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv"
Sep 15 12:53:09.462977 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.462508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6p88mv" event={"ID":"66cddc1a-4952-4982-8256-2fadeb1a22ff","Type":"ContainerDied","Data":"b506516ad812f830df983be51cf69ffd6694e2f0cef546943bb51dfd73459c7f"}
Sep 15 12:53:09.462977 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.462663    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b506516ad812f830df983be51cf69ffd6694e2f0cef546943bb51dfd73459c7f"
Sep 15 12:53:09.464528 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.464507    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg"
Sep 15 12:53:09.464625 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.464561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kd6wg" event={"ID":"383591b0-941d-4e01-90d0-956b7822a721","Type":"ContainerDied","Data":"6871dcd0e3090dc00d4e465ed91bca1dfb63143d2d407d2181c11d74728b3d77"}
Sep 15 12:53:09.464625 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.464594    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6871dcd0e3090dc00d4e465ed91bca1dfb63143d2d407d2181c11d74728b3d77"
Sep 15 12:53:09.596570 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.596542    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:09.656711 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.656675    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhrps\" (UniqueName: \"kubernetes.io/projected/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-kube-api-access-dhrps\") pod \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") "
Sep 15 12:53:09.656879 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.656740    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-util\") pod \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") "
Sep 15 12:53:09.656944 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.656875    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-bundle\") pod \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\" (UID: \"c0e9ae1c-e383-43cf-a2a4-79ef470d8773\") "
Sep 15 12:53:09.657618 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.657594    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-bundle" (OuterVolumeSpecName: "bundle") pod "c0e9ae1c-e383-43cf-a2a4-79ef470d8773" (UID: "c0e9ae1c-e383-43cf-a2a4-79ef470d8773"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:09.658821 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.658802    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-kube-api-access-dhrps" (OuterVolumeSpecName: "kube-api-access-dhrps") pod "c0e9ae1c-e383-43cf-a2a4-79ef470d8773" (UID: "c0e9ae1c-e383-43cf-a2a4-79ef470d8773"). InnerVolumeSpecName "kube-api-access-dhrps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:53:09.663179 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.663154    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-util" (OuterVolumeSpecName: "util") pod "c0e9ae1c-e383-43cf-a2a4-79ef470d8773" (UID: "c0e9ae1c-e383-43cf-a2a4-79ef470d8773"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:53:09.758466 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.758427    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:09.758466 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.758458    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:09.758466 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:09.758468    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhrps\" (UniqueName: \"kubernetes.io/projected/c0e9ae1c-e383-43cf-a2a4-79ef470d8773-kube-api-access-dhrps\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:53:10.471084 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:10.471056    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp"
Sep 15 12:53:10.471454 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:10.471055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agggrp" event={"ID":"c0e9ae1c-e383-43cf-a2a4-79ef470d8773","Type":"ContainerDied","Data":"c8077fbb53f47848ee91687fffff35cfa326c52c5e83d76c09a166c4941f5f29"}
Sep 15 12:53:10.471454 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:10.471174    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8077fbb53f47848ee91687fffff35cfa326c52c5e83d76c09a166c4941f5f29"
Sep 15 12:53:14.640143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:14.640093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:15.453402 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:15.453368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:18.732703 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:18.732657    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:19.216836 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:19.216808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:19.428847 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:19.428814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:20.524867 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:20.524828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:21.112111 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:21.112080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:21.473323 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:21.473287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:21.697475 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:21.697442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:23.319468 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:23.319441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:23.663256 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:23.663166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:24.045712 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:24.045678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:24.388127 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:24.388049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:24.686616 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:24.686582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:28.910901 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:28.910868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:29.051353 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:29.051318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:29.328269 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:29.328236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:29.478556 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:29.478519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:33.085314 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:33.085279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:33.208733 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:33.208698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:35.103316 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:35.103264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:35.334027 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:35.333985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:36.090086 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:36.090050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:36.193112 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:36.193075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:40.945427 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:40.945395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:41.043154 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:41.043121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:41.143130 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:41.143100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:48.003909 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:48.003813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:48.105657 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:48.105618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:49.030655 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:49.030626    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:49.156839 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:49.156789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:51.850530 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:51.850495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:51.953750 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:51.953710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:54.519138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:54.519102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:54.635364 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:54.635335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:56.834060 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:56.834019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:53:56.937196 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:53:56.937161    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:00.628252 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:00.628188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:00.727633 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:00.727597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:00.827710 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:00.827672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:13.854004 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:13.853961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:14.078797 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:14.078767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:16.533087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:16.533045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:16.661422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:16.661370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:17.306688 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.306650    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bv2ph"]
Sep 15 12:54:17.307027 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307010    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerName="util"
Sep 15 12:54:17.307027 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307028    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerName="util"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307040    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerName="extract"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307048    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerName="extract"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307060    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899682c0-92fd-4a95-88ba-045cee416925" containerName="util"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307069    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="899682c0-92fd-4a95-88ba-045cee416925" containerName="util"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307080    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerName="extract"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307089    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerName="extract"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307100    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerName="pull"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307108    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerName="pull"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307124    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899682c0-92fd-4a95-88ba-045cee416925" containerName="extract"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307132    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="899682c0-92fd-4a95-88ba-045cee416925" containerName="extract"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307143    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="383591b0-941d-4e01-90d0-956b7822a721" containerName="pull"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307151    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="383591b0-941d-4e01-90d0-956b7822a721" containerName="pull"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307160    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="383591b0-941d-4e01-90d0-956b7822a721" containerName="extract"
Sep 15 12:54:17.307173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307168    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="383591b0-941d-4e01-90d0-956b7822a721" containerName="extract"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307181    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899682c0-92fd-4a95-88ba-045cee416925" containerName="pull"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307188    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="899682c0-92fd-4a95-88ba-045cee416925" containerName="pull"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307198    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerName="pull"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307206    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerName="pull"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307222    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="383591b0-941d-4e01-90d0-956b7822a721" containerName="util"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307231    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="383591b0-941d-4e01-90d0-956b7822a721" containerName="util"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307243    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerName="util"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307251    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerName="util"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307328    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="66cddc1a-4952-4982-8256-2fadeb1a22ff" containerName="extract"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307340    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="899682c0-92fd-4a95-88ba-045cee416925" containerName="extract"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307350    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="383591b0-941d-4e01-90d0-956b7822a721" containerName="extract"
Sep 15 12:54:17.307822 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.307360    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0e9ae1c-e383-43cf-a2a4-79ef470d8773" containerName="extract"
Sep 15 12:54:17.310578 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.310558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph"
Sep 15 12:54:17.313517 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.313498    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zpqxm\""
Sep 15 12:54:17.313602 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.313499    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 12:54:17.314555 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.314538    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 12:54:17.326113 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.326080    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bv2ph"]
Sep 15 12:54:17.406422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.406386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qdk\" (UniqueName: \"kubernetes.io/projected/75d490ae-8cd1-4bff-ad75-85aedae567a9-kube-api-access-27qdk\") pod \"authorino-7bcfd8f9cd-bv2ph\" (UID: \"75d490ae-8cd1-4bff-ad75-85aedae567a9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph"
Sep 15 12:54:17.428786 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.428752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-h25qb"]
Sep 15 12:54:17.431990 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.431956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-h25qb"
Sep 15 12:54:17.444004 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.443981    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-h25qb"]
Sep 15 12:54:17.507597 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.507567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qdk\" (UniqueName: \"kubernetes.io/projected/75d490ae-8cd1-4bff-ad75-85aedae567a9-kube-api-access-27qdk\") pod \"authorino-7bcfd8f9cd-bv2ph\" (UID: \"75d490ae-8cd1-4bff-ad75-85aedae567a9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph"
Sep 15 12:54:17.507773 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.507610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tblk\" (UniqueName: \"kubernetes.io/projected/94ae34ba-b12c-407e-b0e9-be0f6a71981f-kube-api-access-6tblk\") pod \"authorino-59c974bd48-h25qb\" (UID: \"94ae34ba-b12c-407e-b0e9-be0f6a71981f\") " pod="kuadrant-system/authorino-59c974bd48-h25qb"
Sep 15 12:54:17.521014 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.520990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qdk\" (UniqueName: \"kubernetes.io/projected/75d490ae-8cd1-4bff-ad75-85aedae567a9-kube-api-access-27qdk\") pod \"authorino-7bcfd8f9cd-bv2ph\" (UID: \"75d490ae-8cd1-4bff-ad75-85aedae567a9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph"
Sep 15 12:54:17.608386 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.608302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tblk\" (UniqueName: \"kubernetes.io/projected/94ae34ba-b12c-407e-b0e9-be0f6a71981f-kube-api-access-6tblk\") pod \"authorino-59c974bd48-h25qb\" (UID: \"94ae34ba-b12c-407e-b0e9-be0f6a71981f\") " pod="kuadrant-system/authorino-59c974bd48-h25qb"
Sep 15 12:54:17.618682 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.618655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tblk\" (UniqueName: \"kubernetes.io/projected/94ae34ba-b12c-407e-b0e9-be0f6a71981f-kube-api-access-6tblk\") pod \"authorino-59c974bd48-h25qb\" (UID: \"94ae34ba-b12c-407e-b0e9-be0f6a71981f\") " pod="kuadrant-system/authorino-59c974bd48-h25qb"
Sep 15 12:54:17.619381 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.619364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph"
Sep 15 12:54:17.741046 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.741013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-h25qb"
Sep 15 12:54:17.902417 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:17.902387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bv2ph"]
Sep 15 12:54:17.903411 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:54:17.903389    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75d490ae_8cd1_4bff_ad75_85aedae567a9.slice/crio-af1b0e28e0167f9d6b1a2e4bc5772f8583c194688126434bccb8ed128f962777 WatchSource:0}: Error finding container af1b0e28e0167f9d6b1a2e4bc5772f8583c194688126434bccb8ed128f962777: Status 404 returned error can't find the container with id af1b0e28e0167f9d6b1a2e4bc5772f8583c194688126434bccb8ed128f962777
Sep 15 12:54:18.016611 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:18.016579    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-h25qb"]
Sep 15 12:54:18.019793 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:54:18.019766    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ae34ba_b12c_407e_b0e9_be0f6a71981f.slice/crio-ae9eb8e4e2ff053f0ce53ef56b32b5ce325d420cfa890d7c49992b5e9878efa5 WatchSource:0}: Error finding container ae9eb8e4e2ff053f0ce53ef56b32b5ce325d420cfa890d7c49992b5e9878efa5: Status 404 returned error can't find the container with id ae9eb8e4e2ff053f0ce53ef56b32b5ce325d420cfa890d7c49992b5e9878efa5
Sep 15 12:54:18.809227 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:18.809174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-h25qb" event={"ID":"94ae34ba-b12c-407e-b0e9-be0f6a71981f","Type":"ContainerStarted","Data":"ae9eb8e4e2ff053f0ce53ef56b32b5ce325d420cfa890d7c49992b5e9878efa5"}
Sep 15 12:54:18.811157 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:18.811114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph" event={"ID":"75d490ae-8cd1-4bff-ad75-85aedae567a9","Type":"ContainerStarted","Data":"af1b0e28e0167f9d6b1a2e4bc5772f8583c194688126434bccb8ed128f962777"}
Sep 15 12:54:18.964130 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:18.964089    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:19.069157 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:19.069010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:21.828165 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:21.828134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph" event={"ID":"75d490ae-8cd1-4bff-ad75-85aedae567a9","Type":"ContainerStarted","Data":"687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9"}
Sep 15 12:54:21.829673 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:21.829642    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-h25qb" event={"ID":"94ae34ba-b12c-407e-b0e9-be0f6a71981f","Type":"ContainerStarted","Data":"0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff"}
Sep 15 12:54:21.861703 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:21.861639    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph" podStartSLOduration=1.9752547649999999 podStartE2EDuration="4.861625223s" totalImagesPullingTime="2.886370458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:54:21.859241469 +0000 UTC m=+567.221973068" watchObservedRunningTime="2026-09-15 12:54:21.861625223 +0000 UTC m=+567.224356822"
Sep 15 12:54:21.886903 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:21.886855    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-h25qb" podStartSLOduration=2.105631443 podStartE2EDuration="4.886840325s" totalImagesPullingTime="2.781208882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:54:21.885645404 +0000 UTC m=+567.248376999" watchObservedRunningTime="2026-09-15 12:54:21.886840325 +0000 UTC m=+567.249571972"
Sep 15 12:54:21.932446 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:21.932412    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bv2ph"]
Sep 15 12:54:23.844170 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:23.844125    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph" podUID="75d490ae-8cd1-4bff-ad75-85aedae567a9" containerName="authorino" containerID="cri-o://687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9" gracePeriod=30
Sep 15 12:54:24.084433 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.084411    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph"
Sep 15 12:54:24.162248 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.162160    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27qdk\" (UniqueName: \"kubernetes.io/projected/75d490ae-8cd1-4bff-ad75-85aedae567a9-kube-api-access-27qdk\") pod \"75d490ae-8cd1-4bff-ad75-85aedae567a9\" (UID: \"75d490ae-8cd1-4bff-ad75-85aedae567a9\") "
Sep 15 12:54:24.164346 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.164319    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d490ae-8cd1-4bff-ad75-85aedae567a9-kube-api-access-27qdk" (OuterVolumeSpecName: "kube-api-access-27qdk") pod "75d490ae-8cd1-4bff-ad75-85aedae567a9" (UID: "75d490ae-8cd1-4bff-ad75-85aedae567a9"). InnerVolumeSpecName "kube-api-access-27qdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:54:24.263563 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.263526    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27qdk\" (UniqueName: \"kubernetes.io/projected/75d490ae-8cd1-4bff-ad75-85aedae567a9-kube-api-access-27qdk\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:54:24.850656 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.850622    2562 generic.go:356] "Generic (PLEG): container finished" podID="75d490ae-8cd1-4bff-ad75-85aedae567a9" containerID="687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9" exitCode=0
Sep 15 12:54:24.850656 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.850661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph" event={"ID":"75d490ae-8cd1-4bff-ad75-85aedae567a9","Type":"ContainerDied","Data":"687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9"}
Sep 15 12:54:24.851230 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.850668    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph"
Sep 15 12:54:24.851230 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.850692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bv2ph" event={"ID":"75d490ae-8cd1-4bff-ad75-85aedae567a9","Type":"ContainerDied","Data":"af1b0e28e0167f9d6b1a2e4bc5772f8583c194688126434bccb8ed128f962777"}
Sep 15 12:54:24.851230 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.850711    2562 scope.go:117] "RemoveContainer" containerID="687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9"
Sep 15 12:54:24.859391 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.859370    2562 scope.go:117] "RemoveContainer" containerID="687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9"
Sep 15 12:54:24.859649 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:54:24.859631    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9\": container with ID starting with 687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9 not found: ID does not exist" containerID="687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9"
Sep 15 12:54:24.859695 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.859657    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9"} err="failed to get container status \"687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9\": rpc error: code = NotFound desc = could not find container \"687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9\": container with ID starting with 687cc638967a63abb5795470e378e321df4e729f718598c5d9f6997f22606ca9 not found: ID does not exist"
Sep 15 12:54:24.874319 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.874293    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bv2ph"]
Sep 15 12:54:24.880033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:24.880012    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bv2ph"]
Sep 15 12:54:25.262551 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:25.262524    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d490ae-8cd1-4bff-ad75-85aedae567a9" path="/var/lib/kubelet/pods/75d490ae-8cd1-4bff-ad75-85aedae567a9/volumes"
Sep 15 12:54:32.585777 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:32.585739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:32.688094 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:32.688059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:33.073376 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:33.073338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:43.247874 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.247830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:43.466228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.466195    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-98kz5"]
Sep 15 12:54:43.466542 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.466529    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d490ae-8cd1-4bff-ad75-85aedae567a9" containerName="authorino"
Sep 15 12:54:43.466594 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.466546    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d490ae-8cd1-4bff-ad75-85aedae567a9" containerName="authorino"
Sep 15 12:54:43.466626 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.466604    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d490ae-8cd1-4bff-ad75-85aedae567a9" containerName="authorino"
Sep 15 12:54:43.470772 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.470751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-98kz5"
Sep 15 12:54:43.484490 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.478071    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-98kz5"]
Sep 15 12:54:43.511677 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.511598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hwds\" (UniqueName: \"kubernetes.io/projected/973adcbf-bebf-48fb-a567-8af17b691024-kube-api-access-8hwds\") pod \"authorino-557f876f69-98kz5\" (UID: \"973adcbf-bebf-48fb-a567-8af17b691024\") " pod="kuadrant-system/authorino-557f876f69-98kz5"
Sep 15 12:54:43.552851 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.552810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:43.613040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.613000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hwds\" (UniqueName: \"kubernetes.io/projected/973adcbf-bebf-48fb-a567-8af17b691024-kube-api-access-8hwds\") pod \"authorino-557f876f69-98kz5\" (UID: \"973adcbf-bebf-48fb-a567-8af17b691024\") " pod="kuadrant-system/authorino-557f876f69-98kz5"
Sep 15 12:54:43.620506 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.620475    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-98kz5"]
Sep 15 12:54:43.620742 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:54:43.620721    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8hwds], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-98kz5" podUID="973adcbf-bebf-48fb-a567-8af17b691024"
Sep 15 12:54:43.623038 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.623020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hwds\" (UniqueName: \"kubernetes.io/projected/973adcbf-bebf-48fb-a567-8af17b691024-kube-api-access-8hwds\") pod \"authorino-557f876f69-98kz5\" (UID: \"973adcbf-bebf-48fb-a567-8af17b691024\") " pod="kuadrant-system/authorino-557f876f69-98kz5"
Sep 15 12:54:43.647888 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.647858    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hsw79"]
Sep 15 12:54:43.651034 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.651018    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.653666 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.653635    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 15 12:54:43.661652 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.661630    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hsw79"]
Sep 15 12:54:43.696144 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.696111    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hsw79"]
Sep 15 12:54:43.696358 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:54:43.696337    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lrk6b tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-hsw79" podUID="3b5b93bc-58f5-4931-a8b4-128ad31ccb52"
Sep 15 12:54:43.713956 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.713932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrk6b\" (UniqueName: \"kubernetes.io/projected/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-kube-api-access-lrk6b\") pod \"authorino-6d4dfc649f-hsw79\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") " pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.714082 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.714045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-tls-cert\") pod \"authorino-6d4dfc649f-hsw79\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") " pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.728581 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.728553    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74dcd8467d-qdrvf"]
Sep 15 12:54:43.731783 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.731765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:43.745354 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.745333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74dcd8467d-qdrvf"]
Sep 15 12:54:43.815224 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.815137    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-tls-cert\") pod \"authorino-6d4dfc649f-hsw79\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") " pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.815224 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.815175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-tls-cert\") pod \"authorino-74dcd8467d-qdrvf\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") " pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:43.815224 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.815197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrk6b\" (UniqueName: \"kubernetes.io/projected/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-kube-api-access-lrk6b\") pod \"authorino-6d4dfc649f-hsw79\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") " pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.815458 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.815258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bkvf\" (UniqueName: \"kubernetes.io/projected/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-kube-api-access-4bkvf\") pod \"authorino-74dcd8467d-qdrvf\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") " pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:43.817509 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.817482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-tls-cert\") pod \"authorino-6d4dfc649f-hsw79\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") " pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.823471 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.823445    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrk6b\" (UniqueName: \"kubernetes.io/projected/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-kube-api-access-lrk6b\") pod \"authorino-6d4dfc649f-hsw79\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") " pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.916589 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.916547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bkvf\" (UniqueName: \"kubernetes.io/projected/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-kube-api-access-4bkvf\") pod \"authorino-74dcd8467d-qdrvf\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") " pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:43.916769 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.916639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-tls-cert\") pod \"authorino-74dcd8467d-qdrvf\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") " pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:43.919028 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.919005    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-tls-cert\") pod \"authorino-74dcd8467d-qdrvf\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") " pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:43.927193 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.927171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bkvf\" (UniqueName: \"kubernetes.io/projected/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-kube-api-access-4bkvf\") pod \"authorino-74dcd8467d-qdrvf\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") " pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:43.944533 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.944506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.944655 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.944506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-98kz5"
Sep 15 12:54:43.951497 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.951473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:43.954126 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:43.954110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-98kz5"
Sep 15 12:54:44.017491 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.017464    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-tls-cert\") pod \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") "
Sep 15 12:54:44.017641 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.017500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hwds\" (UniqueName: \"kubernetes.io/projected/973adcbf-bebf-48fb-a567-8af17b691024-kube-api-access-8hwds\") pod \"973adcbf-bebf-48fb-a567-8af17b691024\" (UID: \"973adcbf-bebf-48fb-a567-8af17b691024\") "
Sep 15 12:54:44.017641 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.017553    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrk6b\" (UniqueName: \"kubernetes.io/projected/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-kube-api-access-lrk6b\") pod \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\" (UID: \"3b5b93bc-58f5-4931-a8b4-128ad31ccb52\") "
Sep 15 12:54:44.019578 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.019544    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3b5b93bc-58f5-4931-a8b4-128ad31ccb52" (UID: "3b5b93bc-58f5-4931-a8b4-128ad31ccb52"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:54:44.019684 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.019589    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-kube-api-access-lrk6b" (OuterVolumeSpecName: "kube-api-access-lrk6b") pod "3b5b93bc-58f5-4931-a8b4-128ad31ccb52" (UID: "3b5b93bc-58f5-4931-a8b4-128ad31ccb52"). InnerVolumeSpecName "kube-api-access-lrk6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:54:44.019684 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.019610    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973adcbf-bebf-48fb-a567-8af17b691024-kube-api-access-8hwds" (OuterVolumeSpecName: "kube-api-access-8hwds") pod "973adcbf-bebf-48fb-a567-8af17b691024" (UID: "973adcbf-bebf-48fb-a567-8af17b691024"). InnerVolumeSpecName "kube-api-access-8hwds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:54:44.040404 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.040386    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:54:44.118499 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.118470    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-tls-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:54:44.118499 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.118496    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hwds\" (UniqueName: \"kubernetes.io/projected/973adcbf-bebf-48fb-a567-8af17b691024-kube-api-access-8hwds\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:54:44.118651 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.118507    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrk6b\" (UniqueName: \"kubernetes.io/projected/3b5b93bc-58f5-4931-a8b4-128ad31ccb52-kube-api-access-lrk6b\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:54:44.315219 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.315187    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74dcd8467d-qdrvf"]
Sep 15 12:54:44.317774 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:54:44.317747    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29bf2a4a_c36d_43aa_96df_e9c3ff5f9b28.slice/crio-739d5131464d69691d4d256ce87f689e4d14ab207ba272f506ae58910a66a1ae WatchSource:0}: Error finding container 739d5131464d69691d4d256ce87f689e4d14ab207ba272f506ae58910a66a1ae: Status 404 returned error can't find the container with id 739d5131464d69691d4d256ce87f689e4d14ab207ba272f506ae58910a66a1ae
Sep 15 12:54:44.951957 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.951920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74dcd8467d-qdrvf" event={"ID":"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28","Type":"ContainerStarted","Data":"739d5131464d69691d4d256ce87f689e4d14ab207ba272f506ae58910a66a1ae"}
Sep 15 12:54:44.952143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.952001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-98kz5"
Sep 15 12:54:44.952143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:44.952014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hsw79"
Sep 15 12:54:45.024824 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.024791    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-98kz5"]
Sep 15 12:54:45.036133 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.036101    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-98kz5"]
Sep 15 12:54:45.094625 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.094594    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hsw79"]
Sep 15 12:54:45.101624 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.101595    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hsw79"]
Sep 15 12:54:45.261840 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.261767    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b5b93bc-58f5-4931-a8b4-128ad31ccb52" path="/var/lib/kubelet/pods/3b5b93bc-58f5-4931-a8b4-128ad31ccb52/volumes"
Sep 15 12:54:45.262014 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.262001    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="973adcbf-bebf-48fb-a567-8af17b691024" path="/var/lib/kubelet/pods/973adcbf-bebf-48fb-a567-8af17b691024/volumes"
Sep 15 12:54:45.958777 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.958740    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74dcd8467d-qdrvf" event={"ID":"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28","Type":"ContainerStarted","Data":"857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351"}
Sep 15 12:54:45.979087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:45.979036    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74dcd8467d-qdrvf" podStartSLOduration=2.36272738 podStartE2EDuration="2.979020708s" totalImagesPullingTime="616.293328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:54:45.978526118 +0000 UTC m=+591.341257716" watchObservedRunningTime="2026-09-15 12:54:45.979020708 +0000 UTC m=+591.341752326"
Sep 15 12:54:46.005015 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.004984    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-h25qb"]
Sep 15 12:54:46.005178 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.005157    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-h25qb" podUID="94ae34ba-b12c-407e-b0e9-be0f6a71981f" containerName="authorino" containerID="cri-o://0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff" gracePeriod=30
Sep 15 12:54:46.246485 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.246458    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-h25qb"
Sep 15 12:54:46.335658 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.335627    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tblk\" (UniqueName: \"kubernetes.io/projected/94ae34ba-b12c-407e-b0e9-be0f6a71981f-kube-api-access-6tblk\") pod \"94ae34ba-b12c-407e-b0e9-be0f6a71981f\" (UID: \"94ae34ba-b12c-407e-b0e9-be0f6a71981f\") "
Sep 15 12:54:46.337677 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.337640    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ae34ba-b12c-407e-b0e9-be0f6a71981f-kube-api-access-6tblk" (OuterVolumeSpecName: "kube-api-access-6tblk") pod "94ae34ba-b12c-407e-b0e9-be0f6a71981f" (UID: "94ae34ba-b12c-407e-b0e9-be0f6a71981f"). InnerVolumeSpecName "kube-api-access-6tblk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:54:46.436112 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.436081    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tblk\" (UniqueName: \"kubernetes.io/projected/94ae34ba-b12c-407e-b0e9-be0f6a71981f-kube-api-access-6tblk\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:54:46.968219 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.968187    2562 generic.go:356] "Generic (PLEG): container finished" podID="94ae34ba-b12c-407e-b0e9-be0f6a71981f" containerID="0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff" exitCode=0
Sep 15 12:54:46.968671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.968230    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-h25qb"
Sep 15 12:54:46.968671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.968279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-h25qb" event={"ID":"94ae34ba-b12c-407e-b0e9-be0f6a71981f","Type":"ContainerDied","Data":"0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff"}
Sep 15 12:54:46.968671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.968317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-h25qb" event={"ID":"94ae34ba-b12c-407e-b0e9-be0f6a71981f","Type":"ContainerDied","Data":"ae9eb8e4e2ff053f0ce53ef56b32b5ce325d420cfa890d7c49992b5e9878efa5"}
Sep 15 12:54:46.968671 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.968334    2562 scope.go:117] "RemoveContainer" containerID="0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff"
Sep 15 12:54:46.977816 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.977802    2562 scope.go:117] "RemoveContainer" containerID="0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff"
Sep 15 12:54:46.978164 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:54:46.978142    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff\": container with ID starting with 0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff not found: ID does not exist" containerID="0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff"
Sep 15 12:54:46.978246 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.978169    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff"} err="failed to get container status \"0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff\": rpc error: code = NotFound desc = could not find container \"0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff\": container with ID starting with 0d7fb76d0566f255e08b076234f064d5c24fb28ae31a0d2d906e8fadee29f8ff not found: ID does not exist"
Sep 15 12:54:46.991699 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.991676    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-h25qb"]
Sep 15 12:54:46.995725 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:46.995700    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-h25qb"]
Sep 15 12:54:47.261707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:47.261624    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ae34ba-b12c-407e-b0e9-be0f6a71981f" path="/var/lib/kubelet/pods/94ae34ba-b12c-407e-b0e9-be0f6a71981f/volumes"
Sep 15 12:54:50.876400 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:50.876368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:50.966058 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:50.966022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:51.027940 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:51.027903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:51.111562 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:51.111526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:51.216252 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:51.216217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:55.211329 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:55.211306    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:54:55.216435 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:55.216412    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:54:57.322187 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:57.322143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:54:57.428657 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:54:57.428624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:02.947323 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:02.947288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:06.796890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:06.796852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:26.987655 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:26.987571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:29.116252 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.116218    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"]
Sep 15 12:55:29.116620 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.116521    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ae34ba-b12c-407e-b0e9-be0f6a71981f" containerName="authorino"
Sep 15 12:55:29.116620 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.116531    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ae34ba-b12c-407e-b0e9-be0f6a71981f" containerName="authorino"
Sep 15 12:55:29.116620 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.116595    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ae34ba-b12c-407e-b0e9-be0f6a71981f" containerName="authorino"
Sep 15 12:55:29.119384 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.119368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.122011 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.121990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kldb5\""
Sep 15 12:55:29.122119 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.122047    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 12:55:29.138212 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.138189    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"]
Sep 15 12:55:29.198773 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.198739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4m4\" (UniqueName: \"kubernetes.io/projected/c6234b8f-9049-4f77-a297-a359d40ba616-kube-api-access-nl4m4\") pod \"payload-pre-processing-59fbc47bf8-zsbgn\" (UID: \"c6234b8f-9049-4f77-a297-a359d40ba616\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.198954 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.198810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6234b8f-9049-4f77-a297-a359d40ba616-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zsbgn\" (UID: \"c6234b8f-9049-4f77-a297-a359d40ba616\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.300034 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.299960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4m4\" (UniqueName: \"kubernetes.io/projected/c6234b8f-9049-4f77-a297-a359d40ba616-kube-api-access-nl4m4\") pod \"payload-pre-processing-59fbc47bf8-zsbgn\" (UID: \"c6234b8f-9049-4f77-a297-a359d40ba616\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.300229 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.300093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6234b8f-9049-4f77-a297-a359d40ba616-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zsbgn\" (UID: \"c6234b8f-9049-4f77-a297-a359d40ba616\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.300958 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.300931    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6234b8f-9049-4f77-a297-a359d40ba616-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zsbgn\" (UID: \"c6234b8f-9049-4f77-a297-a359d40ba616\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.304110 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.304083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:29.308337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.308314    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4m4\" (UniqueName: \"kubernetes.io/projected/c6234b8f-9049-4f77-a297-a359d40ba616-kube-api-access-nl4m4\") pod \"payload-pre-processing-59fbc47bf8-zsbgn\" (UID: \"c6234b8f-9049-4f77-a297-a359d40ba616\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.428956 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.428915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:29.733427 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.733400    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"]
Sep 15 12:55:29.735585 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:55:29.735560    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6234b8f_9049_4f77_a297_a359d40ba616.slice/crio-247d9f57132970d660cb8b4ff55d7cc9c55900b3d1043278e2b2fce4fdb67c48 WatchSource:0}: Error finding container 247d9f57132970d660cb8b4ff55d7cc9c55900b3d1043278e2b2fce4fdb67c48: Status 404 returned error can't find the container with id 247d9f57132970d660cb8b4ff55d7cc9c55900b3d1043278e2b2fce4fdb67c48
Sep 15 12:55:29.737419 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:29.737401    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:55:30.189409 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:30.189378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn" event={"ID":"c6234b8f-9049-4f77-a297-a359d40ba616","Type":"ContainerStarted","Data":"247d9f57132970d660cb8b4ff55d7cc9c55900b3d1043278e2b2fce4fdb67c48"}
Sep 15 12:55:31.196312 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:31.196274    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn" event={"ID":"c6234b8f-9049-4f77-a297-a359d40ba616","Type":"ContainerStarted","Data":"329e9d0c3e9de6f7d42234143b2b7f27a6ca98e02d5038ee60349b07d66a09b7"}
Sep 15 12:55:31.196688 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:31.196420    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:31.218781 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:31.218729    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn" podStartSLOduration=0.883149207 podStartE2EDuration="2.218711427s" totalImagesPullingTime="1.33556222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:55:31.217775471 +0000 UTC m=+636.580507072" watchObservedRunningTime="2026-09-15 12:55:31.218711427 +0000 UTC m=+636.581443008"
Sep 15 12:55:39.222786 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:39.222748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:39.324821 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:39.324785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:42.204423 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:42.204389    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zsbgn"
Sep 15 12:55:46.014355 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:46.014314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:46.084665 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:46.084639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:55:51.107989 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:55:51.107928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:56:00.807890 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:00.807854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:56:07.923767 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:07.923733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:56:11.289874 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.289840    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"]
Sep 15 12:56:11.294228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.294209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.298759 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.298699    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 12:56:11.298759 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.298710    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 12:56:11.298980 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.298786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 15 12:56:11.298980 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.298795    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6p47f\""
Sep 15 12:56:11.304194 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.304172    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"]
Sep 15 12:56:11.366091 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.366053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.366091 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.366099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mvst\" (UniqueName: \"kubernetes.io/projected/3702dcb8-619a-4635-9da2-299a69e72c40-kube-api-access-9mvst\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.366295 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.366194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.366295 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.366228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.366295 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.366249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3702dcb8-619a-4635-9da2-299a69e72c40-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.366295 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.366284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.377877 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.377847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:56:11.466864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.466826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.466864 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.466867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.467117 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.466899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3702dcb8-619a-4635-9da2-299a69e72c40-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.467117 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.466930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.467117 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.467101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.467246 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.467145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvst\" (UniqueName: \"kubernetes.io/projected/3702dcb8-619a-4635-9da2-299a69e72c40-kube-api-access-9mvst\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.467301 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.467284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.467352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.467331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.467352 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.467344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.469212 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.469191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3702dcb8-619a-4635-9da2-299a69e72c40-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.469450 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.469432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3702dcb8-619a-4635-9da2-299a69e72c40-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.476263 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.476240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mvst\" (UniqueName: \"kubernetes.io/projected/3702dcb8-619a-4635-9da2-299a69e72c40-kube-api-access-9mvst\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h4sdl\" (UID: \"3702dcb8-619a-4635-9da2-299a69e72c40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.605095 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.604999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:11.891588 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:11.891557    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"]
Sep 15 12:56:11.893082 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:56:11.893048    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3702dcb8_619a_4635_9da2_299a69e72c40.slice/crio-f7c7951aeda1d071adc8145bc878019da6799cb6697f66070c54755f0619ecf5 WatchSource:0}: Error finding container f7c7951aeda1d071adc8145bc878019da6799cb6697f66070c54755f0619ecf5: Status 404 returned error can't find the container with id f7c7951aeda1d071adc8145bc878019da6799cb6697f66070c54755f0619ecf5
Sep 15 12:56:12.405455 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:12.405400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl" event={"ID":"3702dcb8-619a-4635-9da2-299a69e72c40","Type":"ContainerStarted","Data":"f7c7951aeda1d071adc8145bc878019da6799cb6697f66070c54755f0619ecf5"}
Sep 15 12:56:13.412623 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:13.412532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl" event={"ID":"3702dcb8-619a-4635-9da2-299a69e72c40","Type":"ContainerStarted","Data":"deb4329666171d32f83fed63f91969e930a23d179219f1109db5c79a904efff2"}
Sep 15 12:56:13.436360 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:13.436298    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl" podStartSLOduration=1.225581519 podStartE2EDuration="2.436279024s" totalImagesPullingTime="1.210697505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:56:13.434509315 +0000 UTC m=+678.797240915" watchObservedRunningTime="2026-09-15 12:56:13.436279024 +0000 UTC m=+678.799010663"
Sep 15 12:56:21.605882 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:21.605841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:21.606303 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:21.605912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:21.618555 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:21.618528    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:22.471715 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:22.471681    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h4sdl"
Sep 15 12:56:23.909528 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:23.909478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:56:28.318936 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:28.318901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:56:42.090388 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.090348    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"]
Sep 15 12:56:42.093936 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.093914    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.096905 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.096886    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 15 12:56:42.104445 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.104424    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"]
Sep 15 12:56:42.191323 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.191276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:56:42.235259 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.235229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.235405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.235266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzzcb\" (UniqueName: \"kubernetes.io/projected/2cc5b859-dcff-41ca-b011-8a31ef693ee8-kube-api-access-xzzcb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.235405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.235348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.235405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.235375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.235528 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.235408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.235528 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.235444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5b859-dcff-41ca-b011-8a31ef693ee8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.336833 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.336806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.336833 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.336838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.337093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.336867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.337093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.336894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5b859-dcff-41ca-b011-8a31ef693ee8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.337093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.336958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.337093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.337006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzzcb\" (UniqueName: \"kubernetes.io/projected/2cc5b859-dcff-41ca-b011-8a31ef693ee8-kube-api-access-xzzcb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.337336 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.337315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.337407 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.337358    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.337407 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.337389    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.339075 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.339050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cc5b859-dcff-41ca-b011-8a31ef693ee8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.339321 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.339302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5b859-dcff-41ca-b011-8a31ef693ee8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.344889 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.344848    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzzcb\" (UniqueName: \"kubernetes.io/projected/2cc5b859-dcff-41ca-b011-8a31ef693ee8-kube-api-access-xzzcb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t\" (UID: \"2cc5b859-dcff-41ca-b011-8a31ef693ee8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.403782 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.403749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:42.681143 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:42.681117    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"]
Sep 15 12:56:42.683112 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:56:42.683086    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cc5b859_dcff_41ca_b011_8a31ef693ee8.slice/crio-f9eb558c54dc941a8384061d3c5d85663dbab8c285bc6f980b84c85345ab2fb5 WatchSource:0}: Error finding container f9eb558c54dc941a8384061d3c5d85663dbab8c285bc6f980b84c85345ab2fb5: Status 404 returned error can't find the container with id f9eb558c54dc941a8384061d3c5d85663dbab8c285bc6f980b84c85345ab2fb5
Sep 15 12:56:43.573073 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:43.573040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t" event={"ID":"2cc5b859-dcff-41ca-b011-8a31ef693ee8","Type":"ContainerStarted","Data":"a22dd25acd61b1b07a68f266cd143e603e7927d673d7d17c1aff04e99f0d145b"}
Sep 15 12:56:43.573473 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:43.573079    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t" event={"ID":"2cc5b859-dcff-41ca-b011-8a31ef693ee8","Type":"ContainerStarted","Data":"f9eb558c54dc941a8384061d3c5d85663dbab8c285bc6f980b84c85345ab2fb5"}
Sep 15 12:56:43.592438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:43.592389    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t" podStartSLOduration=1.377227092 podStartE2EDuration="1.592373378s" totalImagesPullingTime="215.146286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:56:43.591695122 +0000 UTC m=+708.954426721" watchObservedRunningTime="2026-09-15 12:56:43.592373378 +0000 UTC m=+708.955104977"
Sep 15 12:56:52.404759 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:52.404656    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:52.404759 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:52.404747    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:52.417087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:52.417061    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:56:52.630569 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:56:52.630540    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t"
Sep 15 12:57:40.708962 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:40.708925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:57:40.809917 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:40.809877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:57:51.459765 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.459728    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-648d6585f5-nll68"]
Sep 15 12:57:51.462876 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.462860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:51.473519 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.473496    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-648d6585f5-nll68"]
Sep 15 12:57:51.614064 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.614030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79057d7a-8b7c-4e50-97b2-fa61646845db-tls-cert\") pod \"authorino-648d6585f5-nll68\" (UID: \"79057d7a-8b7c-4e50-97b2-fa61646845db\") " pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:51.614237 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.614069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf4tp\" (UniqueName: \"kubernetes.io/projected/79057d7a-8b7c-4e50-97b2-fa61646845db-kube-api-access-xf4tp\") pod \"authorino-648d6585f5-nll68\" (UID: \"79057d7a-8b7c-4e50-97b2-fa61646845db\") " pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:51.715084 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.714997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79057d7a-8b7c-4e50-97b2-fa61646845db-tls-cert\") pod \"authorino-648d6585f5-nll68\" (UID: \"79057d7a-8b7c-4e50-97b2-fa61646845db\") " pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:51.715084 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.715036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf4tp\" (UniqueName: \"kubernetes.io/projected/79057d7a-8b7c-4e50-97b2-fa61646845db-kube-api-access-xf4tp\") pod \"authorino-648d6585f5-nll68\" (UID: \"79057d7a-8b7c-4e50-97b2-fa61646845db\") " pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:51.717320 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.717300    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79057d7a-8b7c-4e50-97b2-fa61646845db-tls-cert\") pod \"authorino-648d6585f5-nll68\" (UID: \"79057d7a-8b7c-4e50-97b2-fa61646845db\") " pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:51.724002 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.723961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf4tp\" (UniqueName: \"kubernetes.io/projected/79057d7a-8b7c-4e50-97b2-fa61646845db-kube-api-access-xf4tp\") pod \"authorino-648d6585f5-nll68\" (UID: \"79057d7a-8b7c-4e50-97b2-fa61646845db\") " pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:51.771015 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:51.770959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-648d6585f5-nll68"
Sep 15 12:57:52.044712 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:52.044683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-648d6585f5-nll68"]
Sep 15 12:57:52.045449 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:57:52.045424    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79057d7a_8b7c_4e50_97b2_fa61646845db.slice/crio-00ef35607e32bc5f7b9f913a2ce53f09606e9fc403b16f0574734907c11d6c94 WatchSource:0}: Error finding container 00ef35607e32bc5f7b9f913a2ce53f09606e9fc403b16f0574734907c11d6c94: Status 404 returned error can't find the container with id 00ef35607e32bc5f7b9f913a2ce53f09606e9fc403b16f0574734907c11d6c94
Sep 15 12:57:52.925576 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:52.925537    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-648d6585f5-nll68" event={"ID":"79057d7a-8b7c-4e50-97b2-fa61646845db","Type":"ContainerStarted","Data":"00ef35607e32bc5f7b9f913a2ce53f09606e9fc403b16f0574734907c11d6c94"}
Sep 15 12:57:54.941217 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:54.941167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-648d6585f5-nll68" event={"ID":"79057d7a-8b7c-4e50-97b2-fa61646845db","Type":"ContainerStarted","Data":"7d0dc68ec4d1c688547e53a6eeb3892c433206904f9490e9b22a1c4db9fc1f5d"}
Sep 15 12:57:54.963896 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:54.963826    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-648d6585f5-nll68" podStartSLOduration=1.385584508 podStartE2EDuration="3.963802798s" totalImagesPullingTime="2.57821829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:57:54.961711488 +0000 UTC m=+780.324443087" watchObservedRunningTime="2026-09-15 12:57:54.963802798 +0000 UTC m=+780.326534398"
Sep 15 12:57:54.993189 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:54.993151    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74dcd8467d-qdrvf"]
Sep 15 12:57:54.993394 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:54.993367    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-74dcd8467d-qdrvf" podUID="29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" containerName="authorino" containerID="cri-o://857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351" gracePeriod=30
Sep 15 12:57:55.248977 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.248938    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:57:55.348849 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.348798    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-tls-cert\") pod \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") "
Sep 15 12:57:55.349044 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.348902    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bkvf\" (UniqueName: \"kubernetes.io/projected/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-kube-api-access-4bkvf\") pod \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\" (UID: \"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28\") "
Sep 15 12:57:55.350950 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.350908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-kube-api-access-4bkvf" (OuterVolumeSpecName: "kube-api-access-4bkvf") pod "29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" (UID: "29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28"). InnerVolumeSpecName "kube-api-access-4bkvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:57:55.359825 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.359790    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" (UID: "29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:57:55.449882 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.449851    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bkvf\" (UniqueName: \"kubernetes.io/projected/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-kube-api-access-4bkvf\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:57:55.449882 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.449880    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28-tls-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:57:55.532251 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.532107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:57:55.622540 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.622507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:57:55.948036 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.947998    2562 generic.go:356] "Generic (PLEG): container finished" podID="29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" containerID="857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351" exitCode=0
Sep 15 12:57:55.948489 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.948078    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74dcd8467d-qdrvf"
Sep 15 12:57:55.948489 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.948080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74dcd8467d-qdrvf" event={"ID":"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28","Type":"ContainerDied","Data":"857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351"}
Sep 15 12:57:55.948489 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.948197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74dcd8467d-qdrvf" event={"ID":"29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28","Type":"ContainerDied","Data":"739d5131464d69691d4d256ce87f689e4d14ab207ba272f506ae58910a66a1ae"}
Sep 15 12:57:55.948489 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.948217    2562 scope.go:117] "RemoveContainer" containerID="857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351"
Sep 15 12:57:55.957321 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.957301    2562 scope.go:117] "RemoveContainer" containerID="857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351"
Sep 15 12:57:55.957622 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:57:55.957604    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351\": container with ID starting with 857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351 not found: ID does not exist" containerID="857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351"
Sep 15 12:57:55.957696 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.957631    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351"} err="failed to get container status \"857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351\": rpc error: code = NotFound desc = could not find container \"857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351\": container with ID starting with 857dbbaeae662252b8adc351bdcaadf63d29c0505e44a4251ef719368d3fd351 not found: ID does not exist"
Sep 15 12:57:55.985010 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.984975    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74dcd8467d-qdrvf"]
Sep 15 12:57:55.992349 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:55.992314    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74dcd8467d-qdrvf"]
Sep 15 12:57:56.670436 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:56.670405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:57:56.772942 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:56.772907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:57:57.264699 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:57:57.264655    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" path="/var/lib/kubelet/pods/29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28/volumes"
Sep 15 12:58:13.609942 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:13.609902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:13.711827 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:13.711788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:13.810996 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:13.810947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:13.978545 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:13.978518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:14.076434 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:14.076397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:14.165591 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:14.165551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:14.443698 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:14.443659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:14.544164 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:14.544122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:14.614915 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:14.614878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:14.958280 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:14.958248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:15.053405 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.053371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:15.401912 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.401819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:15.552130 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.552098    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7780-bf2a96"]
Sep 15 12:58:15.552425 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.552413    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" containerName="authorino"
Sep 15 12:58:15.552469 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.552427    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" containerName="authorino"
Sep 15 12:58:15.552508 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.552486    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="29bf2a4a-c36d-43aa-96df-e9c3ff5f9b28" containerName="authorino"
Sep 15 12:58:15.556718 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.556699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:15.559618 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.559598    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8hhg6\""
Sep 15 12:58:15.563201 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.563176    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7780-bf2a96"]
Sep 15 12:58:15.624691 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.624653    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq86s\" (UniqueName: \"kubernetes.io/projected/ee5e9ccb-c374-49ae-8a42-009cdd1b184b-kube-api-access-vq86s\") pod \"test-curl-7780-bf2a96\" (UID: \"ee5e9ccb-c374-49ae-8a42-009cdd1b184b\") " pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:15.725592 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.725559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq86s\" (UniqueName: \"kubernetes.io/projected/ee5e9ccb-c374-49ae-8a42-009cdd1b184b-kube-api-access-vq86s\") pod \"test-curl-7780-bf2a96\" (UID: \"ee5e9ccb-c374-49ae-8a42-009cdd1b184b\") " pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:15.735221 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.735192    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq86s\" (UniqueName: \"kubernetes.io/projected/ee5e9ccb-c374-49ae-8a42-009cdd1b184b-kube-api-access-vq86s\") pod \"test-curl-7780-bf2a96\" (UID: \"ee5e9ccb-c374-49ae-8a42-009cdd1b184b\") " pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:15.866617 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:15.866580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:16.153838 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:16.153809    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7780-bf2a96"]
Sep 15 12:58:16.155955 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:16.155919    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5e9ccb_c374_49ae_8a42_009cdd1b184b.slice/crio-52594d119b53ac9edb26775ed9f28966bb8c9a47b4d3bd649ecac08d5c925312 WatchSource:0}: Error finding container 52594d119b53ac9edb26775ed9f28966bb8c9a47b4d3bd649ecac08d5c925312: Status 404 returned error can't find the container with id 52594d119b53ac9edb26775ed9f28966bb8c9a47b4d3bd649ecac08d5c925312
Sep 15 12:58:16.639113 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:16.639083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:16.739184 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:16.739154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:17.060753 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:17.060719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7780-bf2a96" event={"ID":"ee5e9ccb-c374-49ae-8a42-009cdd1b184b","Type":"ContainerStarted","Data":"52594d119b53ac9edb26775ed9f28966bb8c9a47b4d3bd649ecac08d5c925312"}
Sep 15 12:58:17.923059 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:17.923024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:18.050156 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:18.050123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:18.148944 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:18.148913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:18.387080 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:18.386993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:18.858380 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:18.858347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:19.050323 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.050284    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"]
Sep 15 12:58:19.054866 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.054841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.057829 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.057807    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-2af9a3-dockercfg-hntrx\""
Sep 15 12:58:19.057947 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.057844    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-2af9a3\""
Sep 15 12:58:19.065573 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.065545    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"]
Sep 15 12:58:19.095880 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.095843    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"]
Sep 15 12:58:19.105167 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.105137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.114018 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.113926    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"]
Sep 15 12:58:19.156108 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.156069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvmx\" (UniqueName: \"kubernetes.io/projected/b9243bf1-65f7-48e4-88ea-581ac2539cdc-kube-api-access-slvmx\") pod \"payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp\" (UID: \"b9243bf1-65f7-48e4-88ea-581ac2539cdc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.156283 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.156132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmdn8\" (UniqueName: \"kubernetes.io/projected/80158ddc-cd5f-4cc2-be1d-3710aa7d8380-kube-api-access-tmdn8\") pod \"payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4\" (UID: \"80158ddc-cd5f-4cc2-be1d-3710aa7d8380\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.156283 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.156202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80158ddc-cd5f-4cc2-be1d-3710aa7d8380-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4\" (UID: \"80158ddc-cd5f-4cc2-be1d-3710aa7d8380\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.156283 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.156233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9243bf1-65f7-48e4-88ea-581ac2539cdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp\" (UID: \"b9243bf1-65f7-48e4-88ea-581ac2539cdc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.256758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.256717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvmx\" (UniqueName: \"kubernetes.io/projected/b9243bf1-65f7-48e4-88ea-581ac2539cdc-kube-api-access-slvmx\") pod \"payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp\" (UID: \"b9243bf1-65f7-48e4-88ea-581ac2539cdc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.256931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.256821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmdn8\" (UniqueName: \"kubernetes.io/projected/80158ddc-cd5f-4cc2-be1d-3710aa7d8380-kube-api-access-tmdn8\") pod \"payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4\" (UID: \"80158ddc-cd5f-4cc2-be1d-3710aa7d8380\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.256931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.256864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80158ddc-cd5f-4cc2-be1d-3710aa7d8380-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4\" (UID: \"80158ddc-cd5f-4cc2-be1d-3710aa7d8380\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.256931 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.256891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9243bf1-65f7-48e4-88ea-581ac2539cdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp\" (UID: \"b9243bf1-65f7-48e4-88ea-581ac2539cdc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.257841 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.257820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80158ddc-cd5f-4cc2-be1d-3710aa7d8380-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4\" (UID: \"80158ddc-cd5f-4cc2-be1d-3710aa7d8380\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.257895 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.257842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9243bf1-65f7-48e4-88ea-581ac2539cdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp\" (UID: \"b9243bf1-65f7-48e4-88ea-581ac2539cdc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.273525 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.273486    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slvmx\" (UniqueName: \"kubernetes.io/projected/b9243bf1-65f7-48e4-88ea-581ac2539cdc-kube-api-access-slvmx\") pod \"payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp\" (UID: \"b9243bf1-65f7-48e4-88ea-581ac2539cdc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.274105 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.274087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmdn8\" (UniqueName: \"kubernetes.io/projected/80158ddc-cd5f-4cc2-be1d-3710aa7d8380-kube-api-access-tmdn8\") pod \"payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4\" (UID: \"80158ddc-cd5f-4cc2-be1d-3710aa7d8380\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.367160 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.367064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:19.416167 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.416132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:19.646335 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.646311    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"]
Sep 15 12:58:19.647862 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:19.647834    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9243bf1_65f7_48e4_88ea_581ac2539cdc.slice/crio-a665e5666bb20519594059acb8fd22c47bae351dabec13f6d49b909656eb14f0 WatchSource:0}: Error finding container a665e5666bb20519594059acb8fd22c47bae351dabec13f6d49b909656eb14f0: Status 404 returned error can't find the container with id a665e5666bb20519594059acb8fd22c47bae351dabec13f6d49b909656eb14f0
Sep 15 12:58:19.701293 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:19.701264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"]
Sep 15 12:58:19.703790 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:19.703764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80158ddc_cd5f_4cc2_be1d_3710aa7d8380.slice/crio-045a3e7b186c3f2ded1eb47212359baa4c8c26c1e4a9ac0cbafbca5ec237c66e WatchSource:0}: Error finding container 045a3e7b186c3f2ded1eb47212359baa4c8c26c1e4a9ac0cbafbca5ec237c66e: Status 404 returned error can't find the container with id 045a3e7b186c3f2ded1eb47212359baa4c8c26c1e4a9ac0cbafbca5ec237c66e
Sep 15 12:58:20.082442 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.082378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp" event={"ID":"b9243bf1-65f7-48e4-88ea-581ac2539cdc","Type":"ContainerStarted","Data":"1bae643ebd3a5a29c827bcf38213a7512300e19414406ae55a25093bdf75e343"}
Sep 15 12:58:20.082442 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.082449    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp" event={"ID":"b9243bf1-65f7-48e4-88ea-581ac2539cdc","Type":"ContainerStarted","Data":"a665e5666bb20519594059acb8fd22c47bae351dabec13f6d49b909656eb14f0"}
Sep 15 12:58:20.082926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.082567    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:20.084187 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.084160    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4" event={"ID":"80158ddc-cd5f-4cc2-be1d-3710aa7d8380","Type":"ContainerStarted","Data":"52e917f5e8700511343d2ab9d6a3e3e3d0a3147e710bda59e164bd00cb8cdd55"}
Sep 15 12:58:20.084314 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.084204    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:20.084314 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.084221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4" event={"ID":"80158ddc-cd5f-4cc2-be1d-3710aa7d8380","Type":"ContainerStarted","Data":"045a3e7b186c3f2ded1eb47212359baa4c8c26c1e4a9ac0cbafbca5ec237c66e"}
Sep 15 12:58:20.107776 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.107705    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp" podStartSLOduration=1.107681459 podStartE2EDuration="1.107681459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:20.106424904 +0000 UTC m=+805.469156498" watchObservedRunningTime="2026-09-15 12:58:20.107681459 +0000 UTC m=+805.470413063"
Sep 15 12:58:20.130714 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.130643    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4" podStartSLOduration=1.130620153 podStartE2EDuration="1.130620153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:20.129697782 +0000 UTC m=+805.492429380" watchObservedRunningTime="2026-09-15 12:58:20.130620153 +0000 UTC m=+805.493351754"
Sep 15 12:58:20.287916 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.287879    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"]
Sep 15 12:58:20.291360 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.291343    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.294308 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.294283    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-6c9f0b\""
Sep 15 12:58:20.294435 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.294318    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-6c9f0b-dockercfg-dpr9m\""
Sep 15 12:58:20.307142 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.307104    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"]
Sep 15 12:58:20.366695 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.366600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ddf8\" (UniqueName: \"kubernetes.io/projected/7be8861f-ae2b-49b8-9b0f-02d0ab7a631a-kube-api-access-2ddf8\") pod \"payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5\" (UID: \"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.366695 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.366654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be8861f-ae2b-49b8-9b0f-02d0ab7a631a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5\" (UID: \"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.468354 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.468303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ddf8\" (UniqueName: \"kubernetes.io/projected/7be8861f-ae2b-49b8-9b0f-02d0ab7a631a-kube-api-access-2ddf8\") pod \"payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5\" (UID: \"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.468534 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.468365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be8861f-ae2b-49b8-9b0f-02d0ab7a631a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5\" (UID: \"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.469155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.469137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be8861f-ae2b-49b8-9b0f-02d0ab7a631a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5\" (UID: \"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.477637 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.477609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ddf8\" (UniqueName: \"kubernetes.io/projected/7be8861f-ae2b-49b8-9b0f-02d0ab7a631a-kube-api-access-2ddf8\") pod \"payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5\" (UID: \"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.602025 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.601988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:20.848442 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.848407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:20.890263 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.890230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"]
Sep 15 12:58:20.891851 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:20.891824    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be8861f_ae2b_49b8_9b0f_02d0ab7a631a.slice/crio-ade2af425b07dcc571b9472148facde823b8804e1bb823b7a8a2c0d9303fb8ec WatchSource:0}: Error finding container ade2af425b07dcc571b9472148facde823b8804e1bb823b7a8a2c0d9303fb8ec: Status 404 returned error can't find the container with id ade2af425b07dcc571b9472148facde823b8804e1bb823b7a8a2c0d9303fb8ec
Sep 15 12:58:20.944939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:20.944904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:21.094456 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.094420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5" event={"ID":"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a","Type":"ContainerStarted","Data":"0981d2dc4817be5c42947b562b7b6d229c251e2e9cad9053e6400395e8aabcc4"}
Sep 15 12:58:21.094905 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.094484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5" event={"ID":"7be8861f-ae2b-49b8-9b0f-02d0ab7a631a","Type":"ContainerStarted","Data":"ade2af425b07dcc571b9472148facde823b8804e1bb823b7a8a2c0d9303fb8ec"}
Sep 15 12:58:21.094905 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.094683    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:21.117322 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.117255    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5" podStartSLOduration=1.1172305 podStartE2EDuration="1.1172305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:21.114012399 +0000 UTC m=+806.476743995" watchObservedRunningTime="2026-09-15 12:58:21.1172305 +0000 UTC m=+806.479962100"
Sep 15 12:58:21.353460 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.353420    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"]
Sep 15 12:58:21.360208 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.360176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.361446 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.361416    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"]
Sep 15 12:58:21.363215 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.363191    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-528f6b-dockercfg-j52dz\""
Sep 15 12:58:21.363418 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.363396    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-528f6b\""
Sep 15 12:58:21.364423 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.364402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:21.364823 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.364803    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.375488 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.375431    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"]
Sep 15 12:58:21.377563 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.377513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zvr\" (UniqueName: \"kubernetes.io/projected/1208ec3b-9e64-474e-8215-b4abfedad817-kube-api-access-79zvr\") pod \"payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr\" (UID: \"1208ec3b-9e64-474e-8215-b4abfedad817\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.377714 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.377612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mnlf\" (UniqueName: \"kubernetes.io/projected/5d98bcc8-73e3-4663-80c3-1f0c78154f9b-kube-api-access-8mnlf\") pod \"payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm\" (UID: \"5d98bcc8-73e3-4663-80c3-1f0c78154f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.377776 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.377723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1208ec3b-9e64-474e-8215-b4abfedad817-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr\" (UID: \"1208ec3b-9e64-474e-8215-b4abfedad817\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.378014 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.377943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d98bcc8-73e3-4663-80c3-1f0c78154f9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm\" (UID: \"5d98bcc8-73e3-4663-80c3-1f0c78154f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.381504 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.381473    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"]
Sep 15 12:58:21.440360 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.440324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:21.479732 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.479070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d98bcc8-73e3-4663-80c3-1f0c78154f9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm\" (UID: \"5d98bcc8-73e3-4663-80c3-1f0c78154f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.479732 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.479196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zvr\" (UniqueName: \"kubernetes.io/projected/1208ec3b-9e64-474e-8215-b4abfedad817-kube-api-access-79zvr\") pod \"payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr\" (UID: \"1208ec3b-9e64-474e-8215-b4abfedad817\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.479732 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.479229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mnlf\" (UniqueName: \"kubernetes.io/projected/5d98bcc8-73e3-4663-80c3-1f0c78154f9b-kube-api-access-8mnlf\") pod \"payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm\" (UID: \"5d98bcc8-73e3-4663-80c3-1f0c78154f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.479732 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.479303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1208ec3b-9e64-474e-8215-b4abfedad817-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr\" (UID: \"1208ec3b-9e64-474e-8215-b4abfedad817\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.480101 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.479955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d98bcc8-73e3-4663-80c3-1f0c78154f9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm\" (UID: \"5d98bcc8-73e3-4663-80c3-1f0c78154f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.480161 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.480133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1208ec3b-9e64-474e-8215-b4abfedad817-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr\" (UID: \"1208ec3b-9e64-474e-8215-b4abfedad817\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.488464 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.488439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mnlf\" (UniqueName: \"kubernetes.io/projected/5d98bcc8-73e3-4663-80c3-1f0c78154f9b-kube-api-access-8mnlf\") pod \"payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm\" (UID: \"5d98bcc8-73e3-4663-80c3-1f0c78154f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.488583 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.488520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zvr\" (UniqueName: \"kubernetes.io/projected/1208ec3b-9e64-474e-8215-b4abfedad817-kube-api-access-79zvr\") pod \"payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr\" (UID: \"1208ec3b-9e64-474e-8215-b4abfedad817\") " pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.683392 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.683350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:21.692011 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.691983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:21.811748 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:21.811706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:22.241131 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:22.241104    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"]
Sep 15 12:58:22.242880 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:22.242854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d98bcc8_73e3_4663_80c3_1f0c78154f9b.slice/crio-3a4861605b5fdc997e0aee4aef50c1dd23d2441e7733c5f016e0f13c779b9a29 WatchSource:0}: Error finding container 3a4861605b5fdc997e0aee4aef50c1dd23d2441e7733c5f016e0f13c779b9a29: Status 404 returned error can't find the container with id 3a4861605b5fdc997e0aee4aef50c1dd23d2441e7733c5f016e0f13c779b9a29
Sep 15 12:58:22.243540 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:22.243520    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"]
Sep 15 12:58:22.244595 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:22.244571    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1208ec3b_9e64_474e_8215_b4abfedad817.slice/crio-af22dc81f8baa4fdf4c0e28a07607e9d12d334b2eb387d81de4f24007a5e1d4b WatchSource:0}: Error finding container af22dc81f8baa4fdf4c0e28a07607e9d12d334b2eb387d81de4f24007a5e1d4b: Status 404 returned error can't find the container with id af22dc81f8baa4fdf4c0e28a07607e9d12d334b2eb387d81de4f24007a5e1d4b
Sep 15 12:58:22.684351 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:22.684321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:23.093161 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.093068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:23.111422 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.111376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7780-bf2a96" event={"ID":"ee5e9ccb-c374-49ae-8a42-009cdd1b184b","Type":"ContainerStarted","Data":"66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df"}
Sep 15 12:58:23.113173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.113142    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm" event={"ID":"5d98bcc8-73e3-4663-80c3-1f0c78154f9b","Type":"ContainerStarted","Data":"b214ade9d98c4f1dfcae851f201b28a7f3243d1e187d2d98477cecdde470b5a5"}
Sep 15 12:58:23.113337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.113197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm" event={"ID":"5d98bcc8-73e3-4663-80c3-1f0c78154f9b","Type":"ContainerStarted","Data":"3a4861605b5fdc997e0aee4aef50c1dd23d2441e7733c5f016e0f13c779b9a29"}
Sep 15 12:58:23.113337 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.113228    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:23.114846 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.114820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr" event={"ID":"1208ec3b-9e64-474e-8215-b4abfedad817","Type":"ContainerStarted","Data":"618beaee201cbde48623c3edb951122363531fcb8c43146630d68759ef0abbb0"}
Sep 15 12:58:23.114990 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.114870    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr" event={"ID":"1208ec3b-9e64-474e-8215-b4abfedad817","Type":"ContainerStarted","Data":"af22dc81f8baa4fdf4c0e28a07607e9d12d334b2eb387d81de4f24007a5e1d4b"}
Sep 15 12:58:23.114990 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.114900    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:23.132751 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.132699    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7780-bf2a96" podStartSLOduration=2.254664294 podStartE2EDuration="8.132681843s" totalImagesPullingTime="5.878017549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:23.131063903 +0000 UTC m=+808.493795506" watchObservedRunningTime="2026-09-15 12:58:23.132681843 +0000 UTC m=+808.495413441"
Sep 15 12:58:23.156266 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.156212    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr" podStartSLOduration=2.156196995 podStartE2EDuration="2.156196995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:23.155525385 +0000 UTC m=+808.518256985" watchObservedRunningTime="2026-09-15 12:58:23.156196995 +0000 UTC m=+808.518928594"
Sep 15 12:58:23.186926 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.186870    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm" podStartSLOduration=2.18684744 podStartE2EDuration="2.18684744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:23.186823804 +0000 UTC m=+808.549555429" watchObservedRunningTime="2026-09-15 12:58:23.18684744 +0000 UTC m=+808.549579038"
Sep 15 12:58:23.198622 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.198590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:23.403250 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.403152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:23.715832 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.715795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:23.855298 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.855253    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7780-bf2a96"]
Sep 15 12:58:23.857991 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.857955    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7780-bf2a96"]
Sep 15 12:58:23.922795 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.922767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:23.985628 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.985550    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7780-4152cb"]
Sep 15 12:58:23.986157 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.986141    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" containerName="test-curl-7780-bf2a96"
Sep 15 12:58:23.986204 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.986160    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" containerName="test-curl-7780-bf2a96"
Sep 15 12:58:23.986273 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.986263    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" containerName="test-curl-7780-bf2a96"
Sep 15 12:58:23.990153 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.989862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:23.992912 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:23.992889    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7780-4152cb"]
Sep 15 12:58:24.101586 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:24.101551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgqd\" (UniqueName: \"kubernetes.io/projected/b77f3df8-8e16-4a33-bbae-4d239fdb3c70-kube-api-access-4sgqd\") pod \"test-curl-7780-4152cb\" (UID: \"b77f3df8-8e16-4a33-bbae-4d239fdb3c70\") " pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:24.120264 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:24.120235    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7780-bf2a96" container="test-curl-7780-bf2a96"
Sep 15 12:58:24.164512 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:24.164479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:24.202799 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:24.202756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgqd\" (UniqueName: \"kubernetes.io/projected/b77f3df8-8e16-4a33-bbae-4d239fdb3c70-kube-api-access-4sgqd\") pod \"test-curl-7780-4152cb\" (UID: \"b77f3df8-8e16-4a33-bbae-4d239fdb3c70\") " pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:24.212535 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:24.212505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgqd\" (UniqueName: \"kubernetes.io/projected/b77f3df8-8e16-4a33-bbae-4d239fdb3c70-kube-api-access-4sgqd\") pod \"test-curl-7780-4152cb\" (UID: \"b77f3df8-8e16-4a33-bbae-4d239fdb3c70\") " pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:24.301018 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:24.300911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:24.572033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:24.572004    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7780-4152cb"]
Sep 15 12:58:24.574191 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:24.574162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb77f3df8_8e16_4a33_bbae_4d239fdb3c70.slice/crio-5aa6be7da60e524db6caad3233eca81cb3ebe17be383d4422c845c2b25700ce1 WatchSource:0}: Error finding container 5aa6be7da60e524db6caad3233eca81cb3ebe17be383d4422c845c2b25700ce1: Status 404 returned error can't find the container with id 5aa6be7da60e524db6caad3233eca81cb3ebe17be383d4422c845c2b25700ce1
Sep 15 12:58:25.127172 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:25.127118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7780-4152cb" event={"ID":"b77f3df8-8e16-4a33-bbae-4d239fdb3c70","Type":"ContainerStarted","Data":"9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b"}
Sep 15 12:58:25.127384 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:25.127183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7780-4152cb" event={"ID":"b77f3df8-8e16-4a33-bbae-4d239fdb3c70","Type":"ContainerStarted","Data":"5aa6be7da60e524db6caad3233eca81cb3ebe17be383d4422c845c2b25700ce1"}
Sep 15 12:58:25.127384 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:25.127214    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7780-bf2a96" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" containerName="test-curl-7780-bf2a96" containerID="cri-o://66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df" gracePeriod=2
Sep 15 12:58:25.150246 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:25.150185    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7780-4152cb" podStartSLOduration=2.150163367 podStartE2EDuration="2.150163367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:25.148304758 +0000 UTC m=+810.511036357" watchObservedRunningTime="2026-09-15 12:58:25.150163367 +0000 UTC m=+810.512894969"
Sep 15 12:58:25.151144 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:25.151110    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-bf2a96\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:25.153319 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:25.153295    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-bf2a96\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:25.261785 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:25.261743    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-bf2a96\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:25.401636 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:25.401545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:25.841614 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:25.841577    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7780-4152cb"]
Sep 15 12:58:25.860167 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:25.860132    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7780-4152cb"]
Sep 15 12:58:26.134209 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:26.134130    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7780-4152cb" container="test-curl-7780-4152cb"
Sep 15 12:58:26.177391 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:26.177352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:26.272321 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:26.272285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:26.407247 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:26.407163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:26.817865 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:26.817835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:26.946585 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:26.946548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:27.140560 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:27.140526    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7780-4152cb" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" containerName="test-curl-7780-4152cb" containerID="cri-o://9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b" gracePeriod=2
Sep 15 12:58:27.143159 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:27.143124    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-4152cb\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:27.299660 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:27.299613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:27.304017 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:27.303994    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:27.338230 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:27.338198    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq86s\" (UniqueName: \"kubernetes.io/projected/ee5e9ccb-c374-49ae-8a42-009cdd1b184b-kube-api-access-vq86s\") pod \"ee5e9ccb-c374-49ae-8a42-009cdd1b184b\" (UID: \"ee5e9ccb-c374-49ae-8a42-009cdd1b184b\") "
Sep 15 12:58:27.340413 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:27.340388    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5e9ccb-c374-49ae-8a42-009cdd1b184b-kube-api-access-vq86s" (OuterVolumeSpecName: "kube-api-access-vq86s") pod "ee5e9ccb-c374-49ae-8a42-009cdd1b184b" (UID: "ee5e9ccb-c374-49ae-8a42-009cdd1b184b"). InnerVolumeSpecName "kube-api-access-vq86s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:58:27.439031 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:27.438997    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq86s\" (UniqueName: \"kubernetes.io/projected/ee5e9ccb-c374-49ae-8a42-009cdd1b184b-kube-api-access-vq86s\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:58:27.804808 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:27.804718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:28.147465 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:28.147387    2562 generic.go:356] "Generic (PLEG): container finished" podID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" containerID="66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df" exitCode=137
Sep 15 12:58:28.147465 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:28.147427    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:28.147465 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:28.147465    2562 scope.go:117] "RemoveContainer" containerID="66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df"
Sep 15 12:58:28.156437 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:28.156418    2562 scope.go:117] "RemoveContainer" containerID="66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df"
Sep 15 12:58:28.156732 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:28.156716    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df\": container with ID starting with 66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df not found: ID does not exist" containerID="66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df"
Sep 15 12:58:28.156789 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:28.156771    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df"} err="failed to get container status \"66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df\": rpc error: code = NotFound desc = could not find container \"66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df\": container with ID starting with 66d8a7101c816ce1bcd428cc8070b6a74720973caf6c5ca380eb2e5260b026df not found: ID does not exist"
Sep 15 12:58:28.157883 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:28.157860    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-bf2a96\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" pod="opendatahub/test-curl-7780-bf2a96"
Sep 15 12:58:28.908283 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:28.908251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:29.264080 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.264042    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5e9ccb-c374-49ae-8a42-009cdd1b184b" path="/var/lib/kubelet/pods/ee5e9ccb-c374-49ae-8a42-009cdd1b184b/volumes"
Sep 15 12:58:29.318384 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.318358    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:29.358045 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.358015    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sgqd\" (UniqueName: \"kubernetes.io/projected/b77f3df8-8e16-4a33-bbae-4d239fdb3c70-kube-api-access-4sgqd\") pod \"b77f3df8-8e16-4a33-bbae-4d239fdb3c70\" (UID: \"b77f3df8-8e16-4a33-bbae-4d239fdb3c70\") "
Sep 15 12:58:29.360067 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.360032    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77f3df8-8e16-4a33-bbae-4d239fdb3c70-kube-api-access-4sgqd" (OuterVolumeSpecName: "kube-api-access-4sgqd") pod "b77f3df8-8e16-4a33-bbae-4d239fdb3c70" (UID: "b77f3df8-8e16-4a33-bbae-4d239fdb3c70"). InnerVolumeSpecName "kube-api-access-4sgqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:58:29.458848 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.458760    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sgqd\" (UniqueName: \"kubernetes.io/projected/b77f3df8-8e16-4a33-bbae-4d239fdb3c70-kube-api-access-4sgqd\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:58:29.710940 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.710851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:29.812384 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.812355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:29.927199 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:29.927161    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:30.101690 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.101587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:30.165227 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.165193    2562 generic.go:356] "Generic (PLEG): container finished" podID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" containerID="9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b" exitCode=137
Sep 15 12:58:30.165395 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.165240    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:30.165395 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.165292    2562 scope.go:117] "RemoveContainer" containerID="9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b"
Sep 15 12:58:30.174743 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.174727    2562 scope.go:117] "RemoveContainer" containerID="9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b"
Sep 15 12:58:30.175053 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:30.175032    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b\": container with ID starting with 9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b not found: ID does not exist" containerID="9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b"
Sep 15 12:58:30.175138 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.175060    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b"} err="failed to get container status \"9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b\": rpc error: code = NotFound desc = could not find container \"9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b\": container with ID starting with 9fb82b01096c5b7c9de8049460000c44bfac49d9ed0aa26558a6ac57de18440b not found: ID does not exist"
Sep 15 12:58:30.177124 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:30.177102    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-4152cb\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:30.501982 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.501940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:30.601065 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.601033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:30.748525 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.748484    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"]
Sep 15 12:58:30.748910 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.748892    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" containerName="test-curl-7780-4152cb"
Sep 15 12:58:30.748910 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.748912    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" containerName="test-curl-7780-4152cb"
Sep 15 12:58:30.749080 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.749003    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" containerName="test-curl-7780-4152cb"
Sep 15 12:58:30.753315 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.753265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:30.758887 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.758862    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-08701e10\""
Sep 15 12:58:30.761507 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.761487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-08701e10-dockercfg-pvnxb\""
Sep 15 12:58:30.779935 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.779905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"]
Sep 15 12:58:30.816885 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:30.816849    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-4152cb\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:30.841685 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.841646    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"]
Sep 15 12:58:30.845181 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.845164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:30.855456 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:30.855429    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-4152cb\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:30.866696 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.866665    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"]
Sep 15 12:58:30.871107 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.871077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:30.871226 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.871162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfkdr\" (UniqueName: \"kubernetes.io/projected/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-kube-api-access-cfkdr\") pod \"payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:30.972497 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.972465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfkdr\" (UniqueName: \"kubernetes.io/projected/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-kube-api-access-cfkdr\") pod \"payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:30.972695 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.972517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0edb9e1-936a-43c8-a664-1138929c3c56-plugins-config-volume\") pod \"payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") " pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:30.972695 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.972559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjsvr\" (UniqueName: \"kubernetes.io/projected/d0edb9e1-936a-43c8-a664-1138929c3c56-kube-api-access-wjsvr\") pod \"payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") " pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:30.972695 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.972596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:30.973278 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.973262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:30.995450 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:30.995418    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfkdr\" (UniqueName: \"kubernetes.io/projected/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-kube-api-access-cfkdr\") pod \"payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:31.063987 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.063867    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:31.073375 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.073345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0edb9e1-936a-43c8-a664-1138929c3c56-plugins-config-volume\") pod \"payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") " pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:31.073531 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.073393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjsvr\" (UniqueName: \"kubernetes.io/projected/d0edb9e1-936a-43c8-a664-1138929c3c56-kube-api-access-wjsvr\") pod \"payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") " pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:31.074257 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.074234    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0edb9e1-936a-43c8-a664-1138929c3c56-plugins-config-volume\") pod \"payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") " pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:31.083140 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.083113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjsvr\" (UniqueName: \"kubernetes.io/projected/d0edb9e1-936a-43c8-a664-1138929c3c56-kube-api-access-wjsvr\") pod \"payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") " pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:31.096641 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.096604    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp"
Sep 15 12:58:31.096924 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.096907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4"
Sep 15 12:58:31.117490 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:31.117453    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-4152cb\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:31.144154 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:58:31.144109    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7780-4152cb\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" pod="opendatahub/test-curl-7780-4152cb"
Sep 15 12:58:31.155322 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.155288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:31.264896 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.264867    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77f3df8-8e16-4a33-bbae-4d239fdb3c70" path="/var/lib/kubelet/pods/b77f3df8-8e16-4a33-bbae-4d239fdb3c70/volumes"
Sep 15 12:58:31.342756 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.342731    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"]
Sep 15 12:58:31.343934 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:31.343910    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb893ba39_e8ae_4a50_97e4_7cc7d0fb676a.slice/crio-fed84ca89a20650327d541521b004c322f1069a7a99ac5158625edc415fb6b7c WatchSource:0}: Error finding container fed84ca89a20650327d541521b004c322f1069a7a99ac5158625edc415fb6b7c: Status 404 returned error can't find the container with id fed84ca89a20650327d541521b004c322f1069a7a99ac5158625edc415fb6b7c
Sep 15 12:58:31.364875 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.364843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:31.446908 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:31.446877    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0edb9e1_936a_43c8_a664_1138929c3c56.slice/crio-b62c2a14ddefe497733aded720c61d068c3ef93eb171f82150998f219fe8dfa4 WatchSource:0}: Error finding container b62c2a14ddefe497733aded720c61d068c3ef93eb171f82150998f219fe8dfa4: Status 404 returned error can't find the container with id b62c2a14ddefe497733aded720c61d068c3ef93eb171f82150998f219fe8dfa4
Sep 15 12:58:31.447534 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.447505    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"]
Sep 15 12:58:31.464648 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.464618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:31.785933 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.785900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:31.885754 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.885709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:31.987660 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:31.987626    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:32.104375 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.104294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5"
Sep 15 12:58:32.183241 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.183204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm" event={"ID":"d0edb9e1-936a-43c8-a664-1138929c3c56","Type":"ContainerStarted","Data":"3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680"}
Sep 15 12:58:32.183450 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.183302    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:32.183450 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.183327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm" event={"ID":"d0edb9e1-936a-43c8-a664-1138929c3c56","Type":"ContainerStarted","Data":"b62c2a14ddefe497733aded720c61d068c3ef93eb171f82150998f219fe8dfa4"}
Sep 15 12:58:32.185126 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.185095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q" event={"ID":"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a","Type":"ContainerStarted","Data":"9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4"}
Sep 15 12:58:32.185271 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.185147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q" event={"ID":"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a","Type":"ContainerStarted","Data":"fed84ca89a20650327d541521b004c322f1069a7a99ac5158625edc415fb6b7c"}
Sep 15 12:58:32.185271 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.185176    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:32.205230 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.205179    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm" podStartSLOduration=2.205162029 podStartE2EDuration="2.205162029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:32.202704549 +0000 UTC m=+817.565436162" watchObservedRunningTime="2026-09-15 12:58:32.205162029 +0000 UTC m=+817.567893628"
Sep 15 12:58:32.224052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.223993    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q" podStartSLOduration=2.223977268 podStartE2EDuration="2.223977268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:32.221522373 +0000 UTC m=+817.584253984" watchObservedRunningTime="2026-09-15 12:58:32.223977268 +0000 UTC m=+817.586708858"
Sep 15 12:58:32.306024 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.305990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:32.412666 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.412566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:32.791098 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.791062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:32.891248 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.891215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:32.971712 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:32.971679    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:33.478054 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:33.478010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:34.122529 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:34.122500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm"
Sep 15 12:58:34.122987 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:34.122565    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr"
Sep 15 12:58:34.471194 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:34.471156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:34.566720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:34.566682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:34.856251 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:34.856158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:34.971032 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:34.970996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:35.065339 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.065299    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:35.106857 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.106774    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"]
Sep 15 12:58:35.110372 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.110353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.113214 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.113194    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-59f4a3\""
Sep 15 12:58:35.113326 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.113195    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-59f4a3-dockercfg-2flgq\""
Sep 15 12:58:35.123112 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.123089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"]
Sep 15 12:58:35.146227 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.146195    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"]
Sep 15 12:58:35.150208 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.150185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.161585 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.161564    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"]
Sep 15 12:58:35.209082 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.209052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d92eff55-17f3-4b71-982e-5f71628233df-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.209082 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.209085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9bwc\" (UniqueName: \"kubernetes.io/projected/d92eff55-17f3-4b71-982e-5f71628233df-kube-api-access-z9bwc\") pod \"payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.209301 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.209118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbzk7\" (UniqueName: \"kubernetes.io/projected/37673f72-5893-4155-b37b-5b1a33bb54b1-kube-api-access-tbzk7\") pod \"payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") " pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.209301 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.209248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37673f72-5893-4155-b37b-5b1a33bb54b1-plugins-config-volume\") pod \"payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") " pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.310105 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.310063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37673f72-5893-4155-b37b-5b1a33bb54b1-plugins-config-volume\") pod \"payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") " pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.310311 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.310131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d92eff55-17f3-4b71-982e-5f71628233df-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.310311 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.310152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9bwc\" (UniqueName: \"kubernetes.io/projected/d92eff55-17f3-4b71-982e-5f71628233df-kube-api-access-z9bwc\") pod \"payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.310311 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.310175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbzk7\" (UniqueName: \"kubernetes.io/projected/37673f72-5893-4155-b37b-5b1a33bb54b1-kube-api-access-tbzk7\") pod \"payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") " pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.310914 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.310889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37673f72-5893-4155-b37b-5b1a33bb54b1-plugins-config-volume\") pod \"payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") " pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.311030 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.310895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d92eff55-17f3-4b71-982e-5f71628233df-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.318815 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.318791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbzk7\" (UniqueName: \"kubernetes.io/projected/37673f72-5893-4155-b37b-5b1a33bb54b1-kube-api-access-tbzk7\") pod \"payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") " pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.318980 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.318944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9bwc\" (UniqueName: \"kubernetes.io/projected/d92eff55-17f3-4b71-982e-5f71628233df-kube-api-access-z9bwc\") pod \"payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.421196 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.421169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:35.439530 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.439496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:35.461075 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.461045    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:35.707309 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.707278    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"]
Sep 15 12:58:35.708384 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:35.708361    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37673f72_5893_4155_b37b_5b1a33bb54b1.slice/crio-2ae8ae32622ce7afc1b6512e8d81801eefa0177df58a2d4057f036bb64b9d764 WatchSource:0}: Error finding container 2ae8ae32622ce7afc1b6512e8d81801eefa0177df58a2d4057f036bb64b9d764: Status 404 returned error can't find the container with id 2ae8ae32622ce7afc1b6512e8d81801eefa0177df58a2d4057f036bb64b9d764
Sep 15 12:58:35.753478 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:35.753451    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"]
Sep 15 12:58:35.759181 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:35.759153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92eff55_17f3_4b71_982e_5f71628233df.slice/crio-8074104daab045f0fd5f8571b0e3a1002c7fa95c2c767a7b1373bedb6ca1855f WatchSource:0}: Error finding container 8074104daab045f0fd5f8571b0e3a1002c7fa95c2c767a7b1373bedb6ca1855f: Status 404 returned error can't find the container with id 8074104daab045f0fd5f8571b0e3a1002c7fa95c2c767a7b1373bedb6ca1855f
Sep 15 12:58:36.210349 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.210310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz" event={"ID":"d92eff55-17f3-4b71-982e-5f71628233df","Type":"ContainerStarted","Data":"0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80"}
Sep 15 12:58:36.210853 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.210379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz" event={"ID":"d92eff55-17f3-4b71-982e-5f71628233df","Type":"ContainerStarted","Data":"8074104daab045f0fd5f8571b0e3a1002c7fa95c2c767a7b1373bedb6ca1855f"}
Sep 15 12:58:36.210853 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.210494    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:36.212434 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.212400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs" event={"ID":"37673f72-5893-4155-b37b-5b1a33bb54b1","Type":"ContainerStarted","Data":"4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4"}
Sep 15 12:58:36.212546 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.212452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs" event={"ID":"37673f72-5893-4155-b37b-5b1a33bb54b1","Type":"ContainerStarted","Data":"2ae8ae32622ce7afc1b6512e8d81801eefa0177df58a2d4057f036bb64b9d764"}
Sep 15 12:58:36.212546 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.212493    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:36.229306 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.229249    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz" podStartSLOduration=1.229232458 podStartE2EDuration="1.229232458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:36.227777961 +0000 UTC m=+821.590509561" watchObservedRunningTime="2026-09-15 12:58:36.229232458 +0000 UTC m=+821.591964116"
Sep 15 12:58:36.247707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:36.247644    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs" podStartSLOduration=1.247627134 podStartE2EDuration="1.247627134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:36.245556776 +0000 UTC m=+821.608288375" watchObservedRunningTime="2026-09-15 12:58:36.247627134 +0000 UTC m=+821.610358770"
Sep 15 12:58:38.069961 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:38.069926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:38.153379 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:38.153339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:38.234865 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:38.234834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:38.410149 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:38.410042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:38.529893 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:38.529860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:38.684263 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:38.684226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:39.440798 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:39.440761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:40.329222 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:40.329189    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:41.311716 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:41.311681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:41.943879 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:41.943846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:42.045130 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:42.045096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:42.460266 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:42.460234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:43.192424 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:43.192392    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:58:43.192623 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:43.192490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:58:43.422370 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:43.422334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:44.267313 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:44.267282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:44.361503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:44.361469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:44.493389 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:44.493356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:44.594294 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:44.594202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:44.872745 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:44.872647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:44.971481 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:44.971446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:44.998378 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:44.998351    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"]
Sep 15 12:58:45.002696 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.002678    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.006238 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.006204    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1c35dd\""
Sep 15 12:58:45.022947 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.022922    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"]
Sep 15 12:58:45.097681 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.097634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f173d2d-91dc-4268-8485-0b542e6d82f1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg\" (UID: \"2f173d2d-91dc-4268-8485-0b542e6d82f1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.097873 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.097772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvww\" (UniqueName: \"kubernetes.io/projected/2f173d2d-91dc-4268-8485-0b542e6d82f1-kube-api-access-2bvww\") pod \"payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg\" (UID: \"2f173d2d-91dc-4268-8485-0b542e6d82f1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.199309 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.199270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f173d2d-91dc-4268-8485-0b542e6d82f1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg\" (UID: \"2f173d2d-91dc-4268-8485-0b542e6d82f1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.199514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.199366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvww\" (UniqueName: \"kubernetes.io/projected/2f173d2d-91dc-4268-8485-0b542e6d82f1-kube-api-access-2bvww\") pod \"payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg\" (UID: \"2f173d2d-91dc-4268-8485-0b542e6d82f1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.200025 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.200003    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f173d2d-91dc-4268-8485-0b542e6d82f1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg\" (UID: \"2f173d2d-91dc-4268-8485-0b542e6d82f1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.211036 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.211006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvww\" (UniqueName: \"kubernetes.io/projected/2f173d2d-91dc-4268-8485-0b542e6d82f1-kube-api-access-2bvww\") pod \"payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg\" (UID: \"2f173d2d-91dc-4268-8485-0b542e6d82f1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.313985 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.313937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:45.381338 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.381286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:45.590224 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:45.590184    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"]
Sep 15 12:58:45.591738 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:58:45.591713    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f173d2d_91dc_4268_8485_0b542e6d82f1.slice/crio-70dd8706da554a55345b16f23b445b0eaff1ab13ab11a00ba918af0d5cf0284d WatchSource:0}: Error finding container 70dd8706da554a55345b16f23b445b0eaff1ab13ab11a00ba918af0d5cf0284d: Status 404 returned error can't find the container with id 70dd8706da554a55345b16f23b445b0eaff1ab13ab11a00ba918af0d5cf0284d
Sep 15 12:58:46.284481 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:46.284450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg" event={"ID":"2f173d2d-91dc-4268-8485-0b542e6d82f1","Type":"ContainerStarted","Data":"6f641974cad3d092a0ea1b917009f7d30f9fa9c35c21bddf9525388779aa252c"}
Sep 15 12:58:46.284655 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:46.284498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg" event={"ID":"2f173d2d-91dc-4268-8485-0b542e6d82f1","Type":"ContainerStarted","Data":"70dd8706da554a55345b16f23b445b0eaff1ab13ab11a00ba918af0d5cf0284d"}
Sep 15 12:58:46.284707 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:46.284647    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:58:46.310484 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:46.310435    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg" podStartSLOduration=2.310419135 podStartE2EDuration="2.310419135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:46.308607655 +0000 UTC m=+831.671339254" watchObservedRunningTime="2026-09-15 12:58:46.310419135 +0000 UTC m=+831.673150733"
Sep 15 12:58:46.358984 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:46.358941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:47.102740 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:47.102709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:47.221065 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:47.221038    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 12:58:47.221264 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:47.221191    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 12:58:47.860435 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:47.860400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:48.824378 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:48.824346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:49.575247 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:49.575214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:50.425751 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:50.425705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:51.319480 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:51.319444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:55.392925 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:55.392884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:58:57.292786 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:58:57.292754    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg"
Sep 15 12:59:01.576844 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:01.576805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:02.259557 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.259516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:02.287385 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.287349    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"]
Sep 15 12:59:02.287647 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.287613    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm" podUID="d0edb9e1-936a-43c8-a664-1138929c3c56" containerName="payload-processing" containerID="cri-o://3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680" gracePeriod=30
Sep 15 12:59:02.299830 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.299802    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"]
Sep 15 12:59:02.300085 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.300033    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q" podUID="b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" containerName="payload-pre-processing" containerID="cri-o://9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4" gracePeriod=30
Sep 15 12:59:02.355426 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.355373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:02.427491 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.427460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:02.537883 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.537788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:02.576033 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.576007    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:59:02.579173 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.579154    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:59:02.657198 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.657169    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjsvr\" (UniqueName: \"kubernetes.io/projected/d0edb9e1-936a-43c8-a664-1138929c3c56-kube-api-access-wjsvr\") pod \"d0edb9e1-936a-43c8-a664-1138929c3c56\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") "
Sep 15 12:59:02.657198 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.657209    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0edb9e1-936a-43c8-a664-1138929c3c56-plugins-config-volume\") pod \"d0edb9e1-936a-43c8-a664-1138929c3c56\" (UID: \"d0edb9e1-936a-43c8-a664-1138929c3c56\") "
Sep 15 12:59:02.657514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.657256    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfkdr\" (UniqueName: \"kubernetes.io/projected/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-kube-api-access-cfkdr\") pod \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") "
Sep 15 12:59:02.657514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.657325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-plugins-config-volume\") pod \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\" (UID: \"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a\") "
Sep 15 12:59:02.658130 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.657958    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" (UID: "b893ba39-e8ae-4a50-97e4-7cc7d0fb676a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:59:02.658130 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.658046    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0edb9e1-936a-43c8-a664-1138929c3c56-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0edb9e1-936a-43c8-a664-1138929c3c56" (UID: "d0edb9e1-936a-43c8-a664-1138929c3c56"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:59:02.661137 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.661097    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0edb9e1-936a-43c8-a664-1138929c3c56-kube-api-access-wjsvr" (OuterVolumeSpecName: "kube-api-access-wjsvr") pod "d0edb9e1-936a-43c8-a664-1138929c3c56" (UID: "d0edb9e1-936a-43c8-a664-1138929c3c56"). InnerVolumeSpecName "kube-api-access-wjsvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:59:02.662857 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.662819    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-kube-api-access-cfkdr" (OuterVolumeSpecName: "kube-api-access-cfkdr") pod "b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" (UID: "b893ba39-e8ae-4a50-97e4-7cc7d0fb676a"). InnerVolumeSpecName "kube-api-access-cfkdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:59:02.675914 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.675842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:02.757977 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.757938    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjsvr\" (UniqueName: \"kubernetes.io/projected/d0edb9e1-936a-43c8-a664-1138929c3c56-kube-api-access-wjsvr\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:02.758155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.757999    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0edb9e1-936a-43c8-a664-1138929c3c56-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:02.758155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.758009    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfkdr\" (UniqueName: \"kubernetes.io/projected/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-kube-api-access-cfkdr\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:02.758155 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:02.758019    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:03.387806 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.387767    2562 generic.go:356] "Generic (PLEG): container finished" podID="b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" containerID="9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4" exitCode=0
Sep 15 12:59:03.387988 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.387813    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"
Sep 15 12:59:03.387988 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.387858    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q" event={"ID":"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a","Type":"ContainerDied","Data":"9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4"}
Sep 15 12:59:03.387988 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.387913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q" event={"ID":"b893ba39-e8ae-4a50-97e4-7cc7d0fb676a","Type":"ContainerDied","Data":"fed84ca89a20650327d541521b004c322f1069a7a99ac5158625edc415fb6b7c"}
Sep 15 12:59:03.387988 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.387941    2562 scope.go:117] "RemoveContainer" containerID="9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4"
Sep 15 12:59:03.389549 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.389526    2562 generic.go:356] "Generic (PLEG): container finished" podID="d0edb9e1-936a-43c8-a664-1138929c3c56" containerID="3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680" exitCode=0
Sep 15 12:59:03.389630 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.389559    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"
Sep 15 12:59:03.389630 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.389582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm" event={"ID":"d0edb9e1-936a-43c8-a664-1138929c3c56","Type":"ContainerDied","Data":"3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680"}
Sep 15 12:59:03.389630 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.389624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm" event={"ID":"d0edb9e1-936a-43c8-a664-1138929c3c56","Type":"ContainerDied","Data":"b62c2a14ddefe497733aded720c61d068c3ef93eb171f82150998f219fe8dfa4"}
Sep 15 12:59:03.397041 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.397024    2562 scope.go:117] "RemoveContainer" containerID="9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4"
Sep 15 12:59:03.397334 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:59:03.397313    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4\": container with ID starting with 9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4 not found: ID does not exist" containerID="9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4"
Sep 15 12:59:03.397428 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.397345    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4"} err="failed to get container status \"9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4\": rpc error: code = NotFound desc = could not find container \"9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4\": container with ID starting with 9ecf3314f77fc4c3bdd757d19708d3d356430b02c886ca5d2b099fc8d9a49de4 not found: ID does not exist"
Sep 15 12:59:03.397428 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.397364    2562 scope.go:117] "RemoveContainer" containerID="3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680"
Sep 15 12:59:03.405592 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.405561    2562 scope.go:117] "RemoveContainer" containerID="3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680"
Sep 15 12:59:03.405887 ip-10-0-143-85 kubenswrapper[2562]: E0915 12:59:03.405872    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680\": container with ID starting with 3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680 not found: ID does not exist" containerID="3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680"
Sep 15 12:59:03.405939 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.405893    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680"} err="failed to get container status \"3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680\": rpc error: code = NotFound desc = could not find container \"3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680\": container with ID starting with 3cf642455a92872eaa766cef991858d21da7adff0b9fbfe1aa14a4fe49738680 not found: ID does not exist"
Sep 15 12:59:03.411242 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.411218    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"]
Sep 15 12:59:03.416867 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.416820    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-08701e10-74bbd5cbf4-82s9q"]
Sep 15 12:59:03.430854 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.430825    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"]
Sep 15 12:59:03.436407 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:03.436380    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-08701e10-84d85fc587-qsbbm"]
Sep 15 12:59:05.262488 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:05.262456    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" path="/var/lib/kubelet/pods/b893ba39-e8ae-4a50-97e4-7cc7d0fb676a/volumes"
Sep 15 12:59:05.262854 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:05.262792    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0edb9e1-936a-43c8-a664-1138929c3c56" path="/var/lib/kubelet/pods/d0edb9e1-936a-43c8-a664-1138929c3c56/volumes"
Sep 15 12:59:05.560904 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:05.560809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:05.673275 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:05.673243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:05.827331 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:05.827244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:06.687705 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:06.687667    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:06.787512 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:06.787481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:07.768992 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:07.768945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:08.777903 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:08.777853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:08.880718 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:08.880678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:09.430688 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.430659    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"]
Sep 15 12:59:09.431054 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.431042    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0edb9e1-936a-43c8-a664-1138929c3c56" containerName="payload-processing"
Sep 15 12:59:09.431101 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.431055    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0edb9e1-936a-43c8-a664-1138929c3c56" containerName="payload-processing"
Sep 15 12:59:09.431101 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.431067    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" containerName="payload-pre-processing"
Sep 15 12:59:09.431101 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.431073    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" containerName="payload-pre-processing"
Sep 15 12:59:09.431207 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.431135    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0edb9e1-936a-43c8-a664-1138929c3c56" containerName="payload-processing"
Sep 15 12:59:09.431207 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.431148    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b893ba39-e8ae-4a50-97e4-7cc7d0fb676a" containerName="payload-pre-processing"
Sep 15 12:59:09.435486 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.435470    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.438619 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.438603    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-f78f068d\""
Sep 15 12:59:09.438832 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.438820    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-f78f068d-dockercfg-k2kxf\""
Sep 15 12:59:09.450758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.450732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"]
Sep 15 12:59:09.476884 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.476853    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"]
Sep 15 12:59:09.480340 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.480323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:09.493326 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.493300    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"]
Sep 15 12:59:09.512994 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.512948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:09.513124 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.513099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8n8h\" (UniqueName: \"kubernetes.io/projected/f1939240-778d-4309-afac-25dda4ea1ee5-kube-api-access-c8n8h\") pod \"payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") " pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.513166 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.513138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1939240-778d-4309-afac-25dda4ea1ee5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") " pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.513202 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.513189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smhbx\" (UniqueName: \"kubernetes.io/projected/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-kube-api-access-smhbx\") pod \"payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:09.614480 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.614444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8n8h\" (UniqueName: \"kubernetes.io/projected/f1939240-778d-4309-afac-25dda4ea1ee5-kube-api-access-c8n8h\") pod \"payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") " pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.614652 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.614486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1939240-778d-4309-afac-25dda4ea1ee5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") " pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.614652 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.614519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smhbx\" (UniqueName: \"kubernetes.io/projected/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-kube-api-access-smhbx\") pod \"payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:09.614652 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.614539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:09.615202 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.615186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:09.615258 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.615218    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1939240-778d-4309-afac-25dda4ea1ee5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") " pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.625040 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.625009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8n8h\" (UniqueName: \"kubernetes.io/projected/f1939240-778d-4309-afac-25dda4ea1ee5-kube-api-access-c8n8h\") pod \"payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") " pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.625292 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.625274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smhbx\" (UniqueName: \"kubernetes.io/projected/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-kube-api-access-smhbx\") pod \"payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:09.745905 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.745821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:09.790489 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:09.790453    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:10.027067 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.027038    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"]
Sep 15 12:59:10.027889 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:59:10.027860    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1939240_778d_4309_afac_25dda4ea1ee5.slice/crio-7287d9aa9c1be65c135cdd659e2092022074a0ccbaee094d66db38366ade6008 WatchSource:0}: Error finding container 7287d9aa9c1be65c135cdd659e2092022074a0ccbaee094d66db38366ade6008: Status 404 returned error can't find the container with id 7287d9aa9c1be65c135cdd659e2092022074a0ccbaee094d66db38366ade6008
Sep 15 12:59:10.075102 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.075074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"]
Sep 15 12:59:10.076224 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:59:10.076205    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0ddf2f_6c80_41d1_8e03_30c49ec1a4ba.slice/crio-b3c9665110f9d176b780d3b17e7d0034a0e6e4079c308380de7c5a56abfa2dab WatchSource:0}: Error finding container b3c9665110f9d176b780d3b17e7d0034a0e6e4079c308380de7c5a56abfa2dab: Status 404 returned error can't find the container with id b3c9665110f9d176b780d3b17e7d0034a0e6e4079c308380de7c5a56abfa2dab
Sep 15 12:59:10.433423 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.433370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r" event={"ID":"f1939240-778d-4309-afac-25dda4ea1ee5","Type":"ContainerStarted","Data":"6d00132dbd43c7185b7f7712e9184e2008859f09ee64d3438a01288c94b77f2f"}
Sep 15 12:59:10.433601 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.433453    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:10.433601 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.433483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r" event={"ID":"f1939240-778d-4309-afac-25dda4ea1ee5","Type":"ContainerStarted","Data":"7287d9aa9c1be65c135cdd659e2092022074a0ccbaee094d66db38366ade6008"}
Sep 15 12:59:10.435664 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.435641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck" event={"ID":"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba","Type":"ContainerStarted","Data":"22b8a7ebc11735fd8636730febec6b30eac6a59ad41d1042e7006183c557890f"}
Sep 15 12:59:10.435781 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.435680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck" event={"ID":"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba","Type":"ContainerStarted","Data":"b3c9665110f9d176b780d3b17e7d0034a0e6e4079c308380de7c5a56abfa2dab"}
Sep 15 12:59:10.435781 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.435773    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:10.453465 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.453390    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r" podStartSLOduration=1.453372741 podStartE2EDuration="1.453372741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:10.452902377 +0000 UTC m=+855.815633976" watchObservedRunningTime="2026-09-15 12:59:10.453372741 +0000 UTC m=+855.816104340"
Sep 15 12:59:10.473117 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:10.473054    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck" podStartSLOduration=1.473034305 podStartE2EDuration="1.473034305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:10.470543322 +0000 UTC m=+855.833274921" watchObservedRunningTime="2026-09-15 12:59:10.473034305 +0000 UTC m=+855.835765905"
Sep 15 12:59:11.428579 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:11.428536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:11.537267 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:11.537235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:11.631100 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:11.631064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:11.914589 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:11.914496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:12.514327 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:12.514295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:13.215078 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:13.215041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:13.916937 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:13.916902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:14.145650 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:14.145612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:15.044664 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:15.044624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:17.052702 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:17.052665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:17.152923 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:17.152889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:21.448345 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:21.448311    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:21.448740 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:21.448688    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:23.276390 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.276351    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"]
Sep 15 12:59:23.279803 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.279785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.283920 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.283887    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"openshift-service-ca.crt\""
Sep 15 12:59:23.284169 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.284153    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"kube-root-ca.crt\""
Sep 15 12:59:23.284450 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.284430    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"simulator-w4-2af9a3-kserve-self-signed-certs\""
Sep 15 12:59:23.284560 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.284430    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"default-dockercfg-b2lfg\""
Sep 15 12:59:23.291596 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.291574    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"]
Sep 15 12:59:23.336290 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.336249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-dshm\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.336463 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.336314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-tmp-dir\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.336463 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.336353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-home\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.336463 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.336424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-model-cache\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.336578 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.336468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzqh\" (UniqueName: \"kubernetes.io/projected/dcb9d878-6594-456d-a19f-629130b07f23-kube-api-access-fxzqh\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.336578 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.336501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb9d878-6594-456d-a19f-629130b07f23-tls-certs\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.437915 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.437881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-model-cache\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.437923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzqh\" (UniqueName: \"kubernetes.io/projected/dcb9d878-6594-456d-a19f-629130b07f23-kube-api-access-fxzqh\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.437986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb9d878-6594-456d-a19f-629130b07f23-tls-certs\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.438065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-dshm\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438093 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.438087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-tmp-dir\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.438143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-home\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438421 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.438396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-model-cache\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438512 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.438432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-home\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.438512 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.438495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-tmp-dir\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.440130 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.440113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-dshm\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.440411 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.440395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb9d878-6594-456d-a19f-629130b07f23-tls-certs\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.447697 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.447676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzqh\" (UniqueName: \"kubernetes.io/projected/dcb9d878-6594-456d-a19f-629130b07f23-kube-api-access-fxzqh\") pod \"simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") " pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.590738 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.590647    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:23.699025 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.698984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:23.865711 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:23.865679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"]
Sep 15 12:59:23.867604 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:59:23.867574    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcb9d878_6594_456d_a19f_629130b07f23.slice/crio-eb4ac66546164ee4c6b637aeee360f0f097583e59b0e8d6fc96efe6bebc0aff9 WatchSource:0}: Error finding container eb4ac66546164ee4c6b637aeee360f0f097583e59b0e8d6fc96efe6bebc0aff9: Status 404 returned error can't find the container with id eb4ac66546164ee4c6b637aeee360f0f097583e59b0e8d6fc96efe6bebc0aff9
Sep 15 12:59:24.524354 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:24.524315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z" event={"ID":"dcb9d878-6594-456d-a19f-629130b07f23","Type":"ContainerStarted","Data":"423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4"}
Sep 15 12:59:24.524354 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:24.524357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z" event={"ID":"dcb9d878-6594-456d-a19f-629130b07f23","Type":"ContainerStarted","Data":"eb4ac66546164ee4c6b637aeee360f0f097583e59b0e8d6fc96efe6bebc0aff9"}
Sep 15 12:59:24.544561 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:24.544513    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z" podStartSLOduration=1.5444990010000001 podStartE2EDuration="1.544499001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:24.542496704 +0000 UTC m=+869.905228302" watchObservedRunningTime="2026-09-15 12:59:24.544499001 +0000 UTC m=+869.907230601"
Sep 15 12:59:31.000820 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:31.000779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:32.108856 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:32.108809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:33.030233 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:33.030200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:33.461564 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:33.461520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:33.591377 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:33.591341    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:33.591377 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:33.591381    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:33.603912 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:33.603878    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:33.938087 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:33.938057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:34.584189 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:34.584152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:34.603459 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:34.603433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 12:59:34.679449 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:34.679421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:34.814720 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:34.814684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:35.026741 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:35.026702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:35.771556 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:35.771524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:36.722714 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:36.722674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:37.568803 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:37.568769    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:38.429599 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.429569    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"]
Sep 15 12:59:38.429838 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.429814    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r" podUID="f1939240-778d-4309-afac-25dda4ea1ee5" containerName="payload-processing" containerID="cri-o://6d00132dbd43c7185b7f7712e9184e2008859f09ee64d3438a01288c94b77f2f" gracePeriod=30
Sep 15 12:59:38.441613 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.441585    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"]
Sep 15 12:59:38.441845 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.441823    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck" podUID="7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" containerName="payload-pre-processing" containerID="cri-o://22b8a7ebc11735fd8636730febec6b30eac6a59ad41d1042e7006183c557890f" gracePeriod=30
Sep 15 12:59:38.618838 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.618809    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" containerID="22b8a7ebc11735fd8636730febec6b30eac6a59ad41d1042e7006183c557890f" exitCode=0
Sep 15 12:59:38.619301 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.618895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck" event={"ID":"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba","Type":"ContainerDied","Data":"22b8a7ebc11735fd8636730febec6b30eac6a59ad41d1042e7006183c557890f"}
Sep 15 12:59:38.620765 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.620738    2562 generic.go:356] "Generic (PLEG): container finished" podID="f1939240-778d-4309-afac-25dda4ea1ee5" containerID="6d00132dbd43c7185b7f7712e9184e2008859f09ee64d3438a01288c94b77f2f" exitCode=0
Sep 15 12:59:38.620887 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.620797    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r" event={"ID":"f1939240-778d-4309-afac-25dda4ea1ee5","Type":"ContainerDied","Data":"6d00132dbd43c7185b7f7712e9184e2008859f09ee64d3438a01288c94b77f2f"}
Sep 15 12:59:38.735677 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.735652    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:38.738260 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.738235    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:38.879598 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.879569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1939240-778d-4309-afac-25dda4ea1ee5-plugins-config-volume\") pod \"f1939240-778d-4309-afac-25dda4ea1ee5\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") "
Sep 15 12:59:38.879783 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.879615    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smhbx\" (UniqueName: \"kubernetes.io/projected/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-kube-api-access-smhbx\") pod \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") "
Sep 15 12:59:38.879783 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.879658    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-plugins-config-volume\") pod \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\" (UID: \"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba\") "
Sep 15 12:59:38.879783 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.879717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8n8h\" (UniqueName: \"kubernetes.io/projected/f1939240-778d-4309-afac-25dda4ea1ee5-kube-api-access-c8n8h\") pod \"f1939240-778d-4309-afac-25dda4ea1ee5\" (UID: \"f1939240-778d-4309-afac-25dda4ea1ee5\") "
Sep 15 12:59:38.879990 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.879951    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1939240-778d-4309-afac-25dda4ea1ee5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1939240-778d-4309-afac-25dda4ea1ee5" (UID: "f1939240-778d-4309-afac-25dda4ea1ee5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:59:38.880117 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.880094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" (UID: "7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:59:38.881838 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.881820    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1939240-778d-4309-afac-25dda4ea1ee5-kube-api-access-c8n8h" (OuterVolumeSpecName: "kube-api-access-c8n8h") pod "f1939240-778d-4309-afac-25dda4ea1ee5" (UID: "f1939240-778d-4309-afac-25dda4ea1ee5"). InnerVolumeSpecName "kube-api-access-c8n8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:59:38.881838 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.881826    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-kube-api-access-smhbx" (OuterVolumeSpecName: "kube-api-access-smhbx") pod "7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" (UID: "7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba"). InnerVolumeSpecName "kube-api-access-smhbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:59:38.981158 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.981074    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8n8h\" (UniqueName: \"kubernetes.io/projected/f1939240-778d-4309-afac-25dda4ea1ee5-kube-api-access-c8n8h\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:38.981158 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.981103    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1939240-778d-4309-afac-25dda4ea1ee5-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:38.981158 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.981113    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smhbx\" (UniqueName: \"kubernetes.io/projected/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-kube-api-access-smhbx\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:38.981158 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:38.981123    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 12:59:39.629356 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.629262    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"
Sep 15 12:59:39.629356 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.629295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r" event={"ID":"f1939240-778d-4309-afac-25dda4ea1ee5","Type":"ContainerDied","Data":"7287d9aa9c1be65c135cdd659e2092022074a0ccbaee094d66db38366ade6008"}
Sep 15 12:59:39.629894 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.629367    2562 scope.go:117] "RemoveContainer" containerID="6d00132dbd43c7185b7f7712e9184e2008859f09ee64d3438a01288c94b77f2f"
Sep 15 12:59:39.631026 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.631000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck" event={"ID":"7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba","Type":"ContainerDied","Data":"b3c9665110f9d176b780d3b17e7d0034a0e6e4079c308380de7c5a56abfa2dab"}
Sep 15 12:59:39.631123 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.631051    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"
Sep 15 12:59:39.639317 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.639299    2562 scope.go:117] "RemoveContainer" containerID="22b8a7ebc11735fd8636730febec6b30eac6a59ad41d1042e7006183c557890f"
Sep 15 12:59:39.652522 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.652498    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"]
Sep 15 12:59:39.667279 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.667252    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f78f068d-7ff5ff7fb6-4qx8r"]
Sep 15 12:59:39.681847 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.681819    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"]
Sep 15 12:59:39.684187 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:39.684167    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f78f068d-57c9b6656b-zvlck"]
Sep 15 12:59:40.080404 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:40.080370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:40.182841 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:40.182814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:41.035775 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:41.035741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:41.262921 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:41.262889    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" path="/var/lib/kubelet/pods/7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba/volumes"
Sep 15 12:59:41.263292 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:41.263278    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1939240-778d-4309-afac-25dda4ea1ee5" path="/var/lib/kubelet/pods/f1939240-778d-4309-afac-25dda4ea1ee5/volumes"
Sep 15 12:59:41.604940 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:41.604906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:41.715797 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:41.715759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:41.812304 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:41.812270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:41.907279 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:41.907191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:42.013565 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:42.013527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:42.914616 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:42.914581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:43.678249 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:43.678216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:44.528084 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:44.528048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:44.608809 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:44.608767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:44.708412 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:44.708376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:45.038124 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.038088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:45.114026 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.113988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:45.222504 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.222466    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"]
Sep 15 12:59:45.222887 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.222875    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1939240-778d-4309-afac-25dda4ea1ee5" containerName="payload-processing"
Sep 15 12:59:45.222932 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.222890    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1939240-778d-4309-afac-25dda4ea1ee5" containerName="payload-processing"
Sep 15 12:59:45.222932 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.222900    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" containerName="payload-pre-processing"
Sep 15 12:59:45.222932 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.222905    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" containerName="payload-pre-processing"
Sep 15 12:59:45.223083 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.223001    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1939240-778d-4309-afac-25dda4ea1ee5" containerName="payload-processing"
Sep 15 12:59:45.223083 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.223011    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b0ddf2f-6c80-41d1-8e03-30c49ec1a4ba" containerName="payload-pre-processing"
Sep 15 12:59:45.227595 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.227578    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.230514 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.230492    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-dc842c6b\""
Sep 15 12:59:45.237627 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.237603    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"]
Sep 15 12:59:45.341851 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.341817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26699778-c9be-4b1a-99e7-7469d3d663ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.341851 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.341852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p2d5\" (UniqueName: \"kubernetes.io/projected/26699778-c9be-4b1a-99e7-7469d3d663ba-kube-api-access-5p2d5\") pod \"payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.348083 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.348056    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"]
Sep 15 12:59:45.351400 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.351384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.355121 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.355098    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-dc842c6b-dockercfg-lqqhs\""
Sep 15 12:59:45.365317 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.365293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"]
Sep 15 12:59:45.442758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.442725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26699778-c9be-4b1a-99e7-7469d3d663ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.442758 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.442768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2d5\" (UniqueName: \"kubernetes.io/projected/26699778-c9be-4b1a-99e7-7469d3d663ba-kube-api-access-5p2d5\") pod \"payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.443062 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.442821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1351c3c1-cd54-47e2-82e4-17d7aec02297-plugins-config-volume\") pod \"payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") " pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.443062 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.442863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck2rw\" (UniqueName: \"kubernetes.io/projected/1351c3c1-cd54-47e2-82e4-17d7aec02297-kube-api-access-ck2rw\") pod \"payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") " pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.443438 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.443419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26699778-c9be-4b1a-99e7-7469d3d663ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.451819 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.451786    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p2d5\" (UniqueName: \"kubernetes.io/projected/26699778-c9be-4b1a-99e7-7469d3d663ba-kube-api-access-5p2d5\") pod \"payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.544134 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.544099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1351c3c1-cd54-47e2-82e4-17d7aec02297-plugins-config-volume\") pod \"payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") " pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.544592 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.544154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck2rw\" (UniqueName: \"kubernetes.io/projected/1351c3c1-cd54-47e2-82e4-17d7aec02297-kube-api-access-ck2rw\") pod \"payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") " pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.544862 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.544841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1351c3c1-cd54-47e2-82e4-17d7aec02297-plugins-config-volume\") pod \"payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") " pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.553612 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.553541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck2rw\" (UniqueName: \"kubernetes.io/projected/1351c3c1-cd54-47e2-82e4-17d7aec02297-kube-api-access-ck2rw\") pod \"payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") " pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.565465 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.565440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:45.611351 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.611308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:45.662044 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.662006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:45.841364 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.841339    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"]
Sep 15 12:59:45.843100 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:59:45.843076    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26699778_c9be_4b1a_99e7_7469d3d663ba.slice/crio-db9f5a3527d09b19f9b45a1b38e391bd86809d4bdbc3d577ca0859c07c6fe413 WatchSource:0}: Error finding container db9f5a3527d09b19f9b45a1b38e391bd86809d4bdbc3d577ca0859c07c6fe413: Status 404 returned error can't find the container with id db9f5a3527d09b19f9b45a1b38e391bd86809d4bdbc3d577ca0859c07c6fe413
Sep 15 12:59:45.939882 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:45.939718    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"]
Sep 15 12:59:45.942173 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:59:45.942144    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1351c3c1_cd54_47e2_82e4_17d7aec02297.slice/crio-1d17e2d39e17f86f17e37b9271e14c7ebd1f739033c375923c1b7a7a8afd4631 WatchSource:0}: Error finding container 1d17e2d39e17f86f17e37b9271e14c7ebd1f739033c375923c1b7a7a8afd4631: Status 404 returned error can't find the container with id 1d17e2d39e17f86f17e37b9271e14c7ebd1f739033c375923c1b7a7a8afd4631
Sep 15 12:59:46.344444 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.344405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:46.675019 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.674986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69" event={"ID":"26699778-c9be-4b1a-99e7-7469d3d663ba","Type":"ContainerStarted","Data":"00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4"}
Sep 15 12:59:46.675417 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.675049    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:46.675417 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.675077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69" event={"ID":"26699778-c9be-4b1a-99e7-7469d3d663ba","Type":"ContainerStarted","Data":"db9f5a3527d09b19f9b45a1b38e391bd86809d4bdbc3d577ca0859c07c6fe413"}
Sep 15 12:59:46.676735 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.676712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8" event={"ID":"1351c3c1-cd54-47e2-82e4-17d7aec02297","Type":"ContainerStarted","Data":"e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879"}
Sep 15 12:59:46.676826 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.676755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8" event={"ID":"1351c3c1-cd54-47e2-82e4-17d7aec02297","Type":"ContainerStarted","Data":"1d17e2d39e17f86f17e37b9271e14c7ebd1f739033c375923c1b7a7a8afd4631"}
Sep 15 12:59:46.676826 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.676778    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:46.696332 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.696285    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69" podStartSLOduration=1.696271115 podStartE2EDuration="1.696271115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:46.693349147 +0000 UTC m=+892.056080757" watchObservedRunningTime="2026-09-15 12:59:46.696271115 +0000 UTC m=+892.059002714"
Sep 15 12:59:46.710052 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:46.710009    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8" podStartSLOduration=1.709996608 podStartE2EDuration="1.709996608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:46.709305988 +0000 UTC m=+892.072037587" watchObservedRunningTime="2026-09-15 12:59:46.709996608 +0000 UTC m=+892.072728206"
Sep 15 12:59:47.244230 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:47.244151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:48.010009 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:48.009941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:48.725632 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:48.725591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:48.795269 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:48.795233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:55.249354 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:55.249322    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:59:55.252472 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:55.252448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 12:59:57.565597 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.565562    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"]
Sep 15 12:59:57.570469 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.570451    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.574532 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.574492    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6c9f0b\"/\"simulator-w0-6c9f0b-kserve-self-signed-certs\""
Sep 15 12:59:57.574532 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.574526    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-6c9f0b\"/\"kube-root-ca.crt\""
Sep 15 12:59:57.574768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.574529    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-6c9f0b\"/\"openshift-service-ca.crt\""
Sep 15 12:59:57.574768 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.574504    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6c9f0b\"/\"default-dockercfg-g2hgd\""
Sep 15 12:59:57.578434 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.578414    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"]
Sep 15 12:59:57.651319 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.651279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-dshm\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.651503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.651355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-model-cache\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.651503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.651396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tmp-dir\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.651503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.651451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-home\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.651503 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.651481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4j8z\" (UniqueName: \"kubernetes.io/projected/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-kube-api-access-t4j8z\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.651735 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.651516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tls-certs\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.690525 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.690498    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 12:59:57.690684 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.690564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 12:59:57.716716 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.716690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 12:59:57.752505 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-model-cache\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752505 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tmp-dir\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752762 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-home\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752762 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4j8z\" (UniqueName: \"kubernetes.io/projected/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-kube-api-access-t4j8z\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752867 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tls-certs\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752867 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752854    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tmp-dir\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752990 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-dshm\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752990 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-model-cache\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.752990 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.752956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-home\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.755709 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.755677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-dshm\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.755994 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.755954    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tls-certs\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.762228 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.762197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4j8z\" (UniqueName: \"kubernetes.io/projected/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-kube-api-access-t4j8z\") pod \"simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") " pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:57.880751 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:57.880666    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 12:59:58.157284 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:58.157254    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"]
Sep 15 12:59:58.158160 ip-10-0-143-85 kubenswrapper[2562]: W0915 12:59:58.158132    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad8273fc_a39f_499a_9c8f_8ff18aea96d3.slice/crio-86dd128ca04f86dc026a85c2a2c456cf5a574b824a50fee8e439235102714abf WatchSource:0}: Error finding container 86dd128ca04f86dc026a85c2a2c456cf5a574b824a50fee8e439235102714abf: Status 404 returned error can't find the container with id 86dd128ca04f86dc026a85c2a2c456cf5a574b824a50fee8e439235102714abf
Sep 15 12:59:58.754863 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:58.754825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t" event={"ID":"ad8273fc-a39f-499a-9c8f-8ff18aea96d3","Type":"ContainerStarted","Data":"f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f"}
Sep 15 12:59:58.755287 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:58.754874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t" event={"ID":"ad8273fc-a39f-499a-9c8f-8ff18aea96d3","Type":"ContainerStarted","Data":"86dd128ca04f86dc026a85c2a2c456cf5a574b824a50fee8e439235102714abf"}
Sep 15 12:59:58.779224 ip-10-0-143-85 kubenswrapper[2562]: I0915 12:59:58.779172    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t" podStartSLOduration=1.779158432 podStartE2EDuration="1.779158432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:58.777075172 +0000 UTC m=+904.139806771" watchObservedRunningTime="2026-09-15 12:59:58.779158432 +0000 UTC m=+904.141890031"
Sep 15 13:00:00.148915 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.148883    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"]
Sep 15 13:00:00.152626 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.152602    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"]
Sep 15 13:00:00.152760 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.152723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"
Sep 15 13:00:00.156051 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.156031    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"
Sep 15 13:00:00.163272 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.163243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"]
Sep 15 13:00:00.168239 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.168207    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"]
Sep 15 13:00:00.171734 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.171705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5hn\" (UniqueName: \"kubernetes.io/projected/1cb2f50f-6a20-4855-a740-912b434450c9-kube-api-access-7m5hn\") pod \"maas-api-key-cleanup-29824620-wbdxh\" (UID: \"1cb2f50f-6a20-4855-a740-912b434450c9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"
Sep 15 13:00:00.171950 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.171921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffqf2\" (UniqueName: \"kubernetes.io/projected/62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96-kube-api-access-ffqf2\") pod \"maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5\" (UID: \"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"
Sep 15 13:00:00.172082 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.171757    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"]
Sep 15 13:00:00.175892 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.175664    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:00:00.175892 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.175664    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:00:00.175892 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.175769    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:00:00.176855 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.176836    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"
Sep 15 13:00:00.183551 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.183526    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"]
Sep 15 13:00:00.273155 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.273114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c6s7\" (UniqueName: \"kubernetes.io/projected/46d744a5-99e7-4d34-8be0-e039b0d1827b-kube-api-access-7c6s7\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q\" (UID: \"46d744a5-99e7-4d34-8be0-e039b0d1827b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"
Sep 15 13:00:00.273357 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.273166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5hn\" (UniqueName: \"kubernetes.io/projected/1cb2f50f-6a20-4855-a740-912b434450c9-kube-api-access-7m5hn\") pod \"maas-api-key-cleanup-29824620-wbdxh\" (UID: \"1cb2f50f-6a20-4855-a740-912b434450c9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"
Sep 15 13:00:00.273357 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.273209    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffqf2\" (UniqueName: \"kubernetes.io/projected/62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96-kube-api-access-ffqf2\") pod \"maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5\" (UID: \"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"
Sep 15 13:00:00.282541 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.282509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffqf2\" (UniqueName: \"kubernetes.io/projected/62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96-kube-api-access-ffqf2\") pod \"maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5\" (UID: \"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"
Sep 15 13:00:00.282665 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.282509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5hn\" (UniqueName: \"kubernetes.io/projected/1cb2f50f-6a20-4855-a740-912b434450c9-kube-api-access-7m5hn\") pod \"maas-api-key-cleanup-29824620-wbdxh\" (UID: \"1cb2f50f-6a20-4855-a740-912b434450c9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"
Sep 15 13:00:00.373935 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.373897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c6s7\" (UniqueName: \"kubernetes.io/projected/46d744a5-99e7-4d34-8be0-e039b0d1827b-kube-api-access-7c6s7\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q\" (UID: \"46d744a5-99e7-4d34-8be0-e039b0d1827b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"
Sep 15 13:00:00.383294 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.383256    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c6s7\" (UniqueName: \"kubernetes.io/projected/46d744a5-99e7-4d34-8be0-e039b0d1827b-kube-api-access-7c6s7\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q\" (UID: \"46d744a5-99e7-4d34-8be0-e039b0d1827b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"
Sep 15 13:00:00.470197 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.470166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"
Sep 15 13:00:00.477526 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.477501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"
Sep 15 13:00:00.488984 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.488955    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"
Sep 15 13:00:00.770333 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.770300    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"]
Sep 15 13:00:00.770853 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:00:00.770827    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb2f50f_6a20_4855_a740_912b434450c9.slice/crio-9fc285e993d4109d99d564e2a8d64385e0fd3cae1b942a397e43391be0d8f10f WatchSource:0}: Error finding container 9fc285e993d4109d99d564e2a8d64385e0fd3cae1b942a397e43391be0d8f10f: Status 404 returned error can't find the container with id 9fc285e993d4109d99d564e2a8d64385e0fd3cae1b942a397e43391be0d8f10f
Sep 15 13:00:00.802033 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:00:00.802005    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bcbdd7_cdb4_4c2d_a0c0_61b14e957e96.slice/crio-1e2e08582f568547de6cb277c921af5b889e0282ef6635ddebbb8db768147145 WatchSource:0}: Error finding container 1e2e08582f568547de6cb277c921af5b889e0282ef6635ddebbb8db768147145: Status 404 returned error can't find the container with id 1e2e08582f568547de6cb277c921af5b889e0282ef6635ddebbb8db768147145
Sep 15 13:00:00.802819 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:00:00.802764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d744a5_99e7_4d34_8be0_e039b0d1827b.slice/crio-73fe9ae12c03ca1d5b8a74996d80f53914fdbfb2c5b6a0bedd78fb9f03fe4b32 WatchSource:0}: Error finding container 73fe9ae12c03ca1d5b8a74996d80f53914fdbfb2c5b6a0bedd78fb9f03fe4b32: Status 404 returned error can't find the container with id 73fe9ae12c03ca1d5b8a74996d80f53914fdbfb2c5b6a0bedd78fb9f03fe4b32
Sep 15 13:00:00.806032 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.806007    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"]
Sep 15 13:00:00.809003 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:00.808980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"]
Sep 15 13:00:01.775016 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:01.774958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh" event={"ID":"1cb2f50f-6a20-4855-a740-912b434450c9","Type":"ContainerStarted","Data":"9fc285e993d4109d99d564e2a8d64385e0fd3cae1b942a397e43391be0d8f10f"}
Sep 15 13:00:01.776303 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:01.776277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5" event={"ID":"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96","Type":"ContainerStarted","Data":"1e2e08582f568547de6cb277c921af5b889e0282ef6635ddebbb8db768147145"}
Sep 15 13:00:01.777386 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:01.777368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q" event={"ID":"46d744a5-99e7-4d34-8be0-e039b0d1827b","Type":"ContainerStarted","Data":"73fe9ae12c03ca1d5b8a74996d80f53914fdbfb2c5b6a0bedd78fb9f03fe4b32"}
Sep 15 13:00:04.803415 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:04.803370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh" event={"ID":"1cb2f50f-6a20-4855-a740-912b434450c9","Type":"ContainerStarted","Data":"09289ce6b24b6a424499f670520cd1722257d18f0e1755a2a2ba1bd3138dd33a"}
Sep 15 13:00:04.805305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:04.805278    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5" event={"ID":"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96","Type":"ContainerStarted","Data":"b50eaeccae200133ea32ffd8756a85378d46a086b3bcfa9f8c49c541b48df6e5"}
Sep 15 13:00:04.806975 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:04.806931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q" event={"ID":"46d744a5-99e7-4d34-8be0-e039b0d1827b","Type":"ContainerStarted","Data":"6cf1905a38703dff8becf03be52a42fbd5038868f7e5b12a9ae1e2d9232da1a0"}
Sep 15 13:00:04.822838 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:04.822792    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh" podStartSLOduration=1.712877374 podStartE2EDuration="4.822777806s" totalImagesPullingTime="3.109900432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:00:04.819757551 +0000 UTC m=+910.182489150" watchObservedRunningTime="2026-09-15 13:00:04.822777806 +0000 UTC m=+910.185509443"
Sep 15 13:00:04.836868 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:04.836816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q" podStartSLOduration=1.764403219 podStartE2EDuration="4.836795398s" totalImagesPullingTime="3.072392179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:00:04.835768368 +0000 UTC m=+910.198499968" watchObservedRunningTime="2026-09-15 13:00:04.836795398 +0000 UTC m=+910.199527002"
Sep 15 13:00:04.854557 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:04.854491    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5" podStartSLOduration=1.781260479 podStartE2EDuration="4.854474792s" totalImagesPullingTime="3.073214313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:00:04.852707617 +0000 UTC m=+910.215439218" watchObservedRunningTime="2026-09-15 13:00:04.854474792 +0000 UTC m=+910.217206390"
Sep 15 13:00:05.814299 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:05.814262    2562 generic.go:356] "Generic (PLEG): container finished" podID="46d744a5-99e7-4d34-8be0-e039b0d1827b" containerID="6cf1905a38703dff8becf03be52a42fbd5038868f7e5b12a9ae1e2d9232da1a0" exitCode=0
Sep 15 13:00:05.814764 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:05.814347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q" event={"ID":"46d744a5-99e7-4d34-8be0-e039b0d1827b","Type":"ContainerDied","Data":"6cf1905a38703dff8becf03be52a42fbd5038868f7e5b12a9ae1e2d9232da1a0"}
Sep 15 13:00:05.815765 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:05.815742    2562 generic.go:356] "Generic (PLEG): container finished" podID="1cb2f50f-6a20-4855-a740-912b434450c9" containerID="09289ce6b24b6a424499f670520cd1722257d18f0e1755a2a2ba1bd3138dd33a" exitCode=0
Sep 15 13:00:05.815871 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:05.815768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh" event={"ID":"1cb2f50f-6a20-4855-a740-912b434450c9","Type":"ContainerDied","Data":"09289ce6b24b6a424499f670520cd1722257d18f0e1755a2a2ba1bd3138dd33a"}
Sep 15 13:00:05.817237 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:05.817217    2562 generic.go:356] "Generic (PLEG): container finished" podID="62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96" containerID="b50eaeccae200133ea32ffd8756a85378d46a086b3bcfa9f8c49c541b48df6e5" exitCode=0
Sep 15 13:00:05.817310 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:05.817246    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5" event={"ID":"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96","Type":"ContainerDied","Data":"b50eaeccae200133ea32ffd8756a85378d46a086b3bcfa9f8c49c541b48df6e5"}
Sep 15 13:00:06.981681 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:06.981645    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"
Sep 15 13:00:07.020190 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.020152    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"
Sep 15 13:00:07.023265 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.023242    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"
Sep 15 13:00:07.024804 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.024771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:07.037891 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.037858    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffqf2\" (UniqueName: \"kubernetes.io/projected/62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96-kube-api-access-ffqf2\") pod \"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96\" (UID: \"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96\") "
Sep 15 13:00:07.040651 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.040615    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96-kube-api-access-ffqf2" (OuterVolumeSpecName: "kube-api-access-ffqf2") pod "62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96" (UID: "62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96"). InnerVolumeSpecName "kube-api-access-ffqf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:07.138951 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.138852    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c6s7\" (UniqueName: \"kubernetes.io/projected/46d744a5-99e7-4d34-8be0-e039b0d1827b-kube-api-access-7c6s7\") pod \"46d744a5-99e7-4d34-8be0-e039b0d1827b\" (UID: \"46d744a5-99e7-4d34-8be0-e039b0d1827b\") "
Sep 15 13:00:07.138951 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.138952    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m5hn\" (UniqueName: \"kubernetes.io/projected/1cb2f50f-6a20-4855-a740-912b434450c9-kube-api-access-7m5hn\") pod \"1cb2f50f-6a20-4855-a740-912b434450c9\" (UID: \"1cb2f50f-6a20-4855-a740-912b434450c9\") "
Sep 15 13:00:07.139217 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.139189    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffqf2\" (UniqueName: \"kubernetes.io/projected/62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96-kube-api-access-ffqf2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:07.141105 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.141078    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d744a5-99e7-4d34-8be0-e039b0d1827b-kube-api-access-7c6s7" (OuterVolumeSpecName: "kube-api-access-7c6s7") pod "46d744a5-99e7-4d34-8be0-e039b0d1827b" (UID: "46d744a5-99e7-4d34-8be0-e039b0d1827b"). InnerVolumeSpecName "kube-api-access-7c6s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:07.141215 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.141113    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb2f50f-6a20-4855-a740-912b434450c9-kube-api-access-7m5hn" (OuterVolumeSpecName: "kube-api-access-7m5hn") pod "1cb2f50f-6a20-4855-a740-912b434450c9" (UID: "1cb2f50f-6a20-4855-a740-912b434450c9"). InnerVolumeSpecName "kube-api-access-7m5hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:07.239860 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.239821    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m5hn\" (UniqueName: \"kubernetes.io/projected/1cb2f50f-6a20-4855-a740-912b434450c9-kube-api-access-7m5hn\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:07.239860 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.239855    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c6s7\" (UniqueName: \"kubernetes.io/projected/46d744a5-99e7-4d34-8be0-e039b0d1827b-kube-api-access-7c6s7\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:07.708355 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.708316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:07.830508 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.830474    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5"
Sep 15 13:00:07.830657 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.830508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5" event={"ID":"62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96","Type":"ContainerDied","Data":"1e2e08582f568547de6cb277c921af5b889e0282ef6635ddebbb8db768147145"}
Sep 15 13:00:07.830657 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.830557    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e2e08582f568547de6cb277c921af5b889e0282ef6635ddebbb8db768147145"
Sep 15 13:00:07.832027 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.832002    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q"
Sep 15 13:00:07.832027 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.832021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q" event={"ID":"46d744a5-99e7-4d34-8be0-e039b0d1827b","Type":"ContainerDied","Data":"73fe9ae12c03ca1d5b8a74996d80f53914fdbfb2c5b6a0bedd78fb9f03fe4b32"}
Sep 15 13:00:07.832250 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.832066    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73fe9ae12c03ca1d5b8a74996d80f53914fdbfb2c5b6a0bedd78fb9f03fe4b32"
Sep 15 13:00:07.839743 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.839699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh" event={"ID":"1cb2f50f-6a20-4855-a740-912b434450c9","Type":"ContainerDied","Data":"9fc285e993d4109d99d564e2a8d64385e0fd3cae1b942a397e43391be0d8f10f"}
Sep 15 13:00:07.839922 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.839805    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fc285e993d4109d99d564e2a8d64385e0fd3cae1b942a397e43391be0d8f10f"
Sep 15 13:00:07.839922 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.839900    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824620-wbdxh"
Sep 15 13:00:07.881126 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.881088    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 13:00:07.881330 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.881143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 13:00:07.893857 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:07.893827    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 13:00:08.537144 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:08.537115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:08.857435 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:08.857349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 13:00:10.008994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:10.008935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:10.451140 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:10.451103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:11.165535 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:11.165507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:12.263900 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:12.263862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:12.868734 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:12.868693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:13.512660 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:13.512627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:14.213947 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.213916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:14.286172 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.286138    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"]
Sep 15 13:00:14.286431 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.286401    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8" podUID="1351c3c1-cd54-47e2-82e4-17d7aec02297" containerName="payload-processing" containerID="cri-o://e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879" gracePeriod=30
Sep 15 13:00:14.337572 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.337530    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"]
Sep 15 13:00:14.338287 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.338235    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69" podUID="26699778-c9be-4b1a-99e7-7469d3d663ba" containerName="payload-pre-processing" containerID="cri-o://00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4" gracePeriod=30
Sep 15 13:00:14.421101 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.421070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:14.541398 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.541079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:14.617461 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.617439    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 13:00:14.620045 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.620026    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 13:00:14.627767 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.627738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:14.690560 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.690518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:14.708165 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.708136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p2d5\" (UniqueName: \"kubernetes.io/projected/26699778-c9be-4b1a-99e7-7469d3d663ba-kube-api-access-5p2d5\") pod \"26699778-c9be-4b1a-99e7-7469d3d663ba\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") "
Sep 15 13:00:14.708315 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.708179    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck2rw\" (UniqueName: \"kubernetes.io/projected/1351c3c1-cd54-47e2-82e4-17d7aec02297-kube-api-access-ck2rw\") pod \"1351c3c1-cd54-47e2-82e4-17d7aec02297\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") "
Sep 15 13:00:14.708315 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.708233    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26699778-c9be-4b1a-99e7-7469d3d663ba-plugins-config-volume\") pod \"26699778-c9be-4b1a-99e7-7469d3d663ba\" (UID: \"26699778-c9be-4b1a-99e7-7469d3d663ba\") "
Sep 15 13:00:14.708403 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.708316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1351c3c1-cd54-47e2-82e4-17d7aec02297-plugins-config-volume\") pod \"1351c3c1-cd54-47e2-82e4-17d7aec02297\" (UID: \"1351c3c1-cd54-47e2-82e4-17d7aec02297\") "
Sep 15 13:00:14.708659 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.708629    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26699778-c9be-4b1a-99e7-7469d3d663ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26699778-c9be-4b1a-99e7-7469d3d663ba" (UID: "26699778-c9be-4b1a-99e7-7469d3d663ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:00:14.708747 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.708716    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1351c3c1-cd54-47e2-82e4-17d7aec02297-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1351c3c1-cd54-47e2-82e4-17d7aec02297" (UID: "1351c3c1-cd54-47e2-82e4-17d7aec02297"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:00:14.710305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.710272    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26699778-c9be-4b1a-99e7-7469d3d663ba-kube-api-access-5p2d5" (OuterVolumeSpecName: "kube-api-access-5p2d5") pod "26699778-c9be-4b1a-99e7-7469d3d663ba" (UID: "26699778-c9be-4b1a-99e7-7469d3d663ba"). InnerVolumeSpecName "kube-api-access-5p2d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:14.710305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.710289    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1351c3c1-cd54-47e2-82e4-17d7aec02297-kube-api-access-ck2rw" (OuterVolumeSpecName: "kube-api-access-ck2rw") pod "1351c3c1-cd54-47e2-82e4-17d7aec02297" (UID: "1351c3c1-cd54-47e2-82e4-17d7aec02297"). InnerVolumeSpecName "kube-api-access-ck2rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:14.809265 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.809182    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p2d5\" (UniqueName: \"kubernetes.io/projected/26699778-c9be-4b1a-99e7-7469d3d663ba-kube-api-access-5p2d5\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.809265 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.809210    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck2rw\" (UniqueName: \"kubernetes.io/projected/1351c3c1-cd54-47e2-82e4-17d7aec02297-kube-api-access-ck2rw\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.809265 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.809219    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26699778-c9be-4b1a-99e7-7469d3d663ba-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.809265 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.809228    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1351c3c1-cd54-47e2-82e4-17d7aec02297-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.880796 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.880760    2562 generic.go:356] "Generic (PLEG): container finished" podID="26699778-c9be-4b1a-99e7-7469d3d663ba" containerID="00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4" exitCode=0
Sep 15 13:00:14.880994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.880811    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"
Sep 15 13:00:14.880994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.880849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69" event={"ID":"26699778-c9be-4b1a-99e7-7469d3d663ba","Type":"ContainerDied","Data":"00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4"}
Sep 15 13:00:14.880994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.880903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69" event={"ID":"26699778-c9be-4b1a-99e7-7469d3d663ba","Type":"ContainerDied","Data":"db9f5a3527d09b19f9b45a1b38e391bd86809d4bdbc3d577ca0859c07c6fe413"}
Sep 15 13:00:14.880994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.880930    2562 scope.go:117] "RemoveContainer" containerID="00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4"
Sep 15 13:00:14.882426 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.882403    2562 generic.go:356] "Generic (PLEG): container finished" podID="1351c3c1-cd54-47e2-82e4-17d7aec02297" containerID="e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879" exitCode=0
Sep 15 13:00:14.882538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.882444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8" event={"ID":"1351c3c1-cd54-47e2-82e4-17d7aec02297","Type":"ContainerDied","Data":"e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879"}
Sep 15 13:00:14.882538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.882448    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"
Sep 15 13:00:14.882538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.882481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8" event={"ID":"1351c3c1-cd54-47e2-82e4-17d7aec02297","Type":"ContainerDied","Data":"1d17e2d39e17f86f17e37b9271e14c7ebd1f739033c375923c1b7a7a8afd4631"}
Sep 15 13:00:14.890824 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.890659    2562 scope.go:117] "RemoveContainer" containerID="00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4"
Sep 15 13:00:14.891025 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:00:14.890998    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4\": container with ID starting with 00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4 not found: ID does not exist" containerID="00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4"
Sep 15 13:00:14.891114 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.891034    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4"} err="failed to get container status \"00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4\": rpc error: code = NotFound desc = could not find container \"00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4\": container with ID starting with 00472f024a95ce0733b9c1ca2cf346fe6c37468fe6ab2e81f0aa512762a5abf4 not found: ID does not exist"
Sep 15 13:00:14.891114 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.891051    2562 scope.go:117] "RemoveContainer" containerID="e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879"
Sep 15 13:00:14.899724 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.899707    2562 scope.go:117] "RemoveContainer" containerID="e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879"
Sep 15 13:00:14.900039 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:00:14.900020    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879\": container with ID starting with e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879 not found: ID does not exist" containerID="e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879"
Sep 15 13:00:14.900101 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.900047    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879"} err="failed to get container status \"e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879\": rpc error: code = NotFound desc = could not find container \"e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879\": container with ID starting with e7ddc38f55f4bd2889f46e671e6f1b2224e5d1c1025450feb6ab31780d351879 not found: ID does not exist"
Sep 15 13:00:14.910899 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.910878    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"]
Sep 15 13:00:14.915787 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.915763    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc842c6b-75bbcbcd58-lcs69"]
Sep 15 13:00:14.927050 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.927024    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"]
Sep 15 13:00:14.931620 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:14.931596    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc842c6b-554f55bdf9-s4cf8"]
Sep 15 13:00:15.017816 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:15.017785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:15.263305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:15.263272    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1351c3c1-cd54-47e2-82e4-17d7aec02297" path="/var/lib/kubelet/pods/1351c3c1-cd54-47e2-82e4-17d7aec02297/volumes"
Sep 15 13:00:15.263700 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:15.263683    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26699778-c9be-4b1a-99e7-7469d3d663ba" path="/var/lib/kubelet/pods/26699778-c9be-4b1a-99e7-7469d3d663ba/volumes"
Sep 15 13:00:15.743107 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:15.743073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:15.913134 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:15.913101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:16.278694 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:16.278662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:16.689074 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:16.689040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:16.790133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:16.790094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:16.912676 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:16.912633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:18.623258 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:18.623214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:18.730419 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:18.730389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:19.262468 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:19.262437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:19.439146 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:19.439074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:19.917280 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:19.917234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:20.862622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:20.862579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:20.962939 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:20.962886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:21.412690 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.412657    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:21.507636 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.507596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:21.600865 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.600829    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"]
Sep 15 13:00:21.601239 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601226    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb2f50f-6a20-4855-a740-912b434450c9" containerName="cleanup"
Sep 15 13:00:21.601289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601241    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb2f50f-6a20-4855-a740-912b434450c9" containerName="cleanup"
Sep 15 13:00:21.601289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601253    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d744a5-99e7-4d34-8be0-e039b0d1827b" containerName="cleanup"
Sep 15 13:00:21.601289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601259    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d744a5-99e7-4d34-8be0-e039b0d1827b" containerName="cleanup"
Sep 15 13:00:21.601289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601269    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26699778-c9be-4b1a-99e7-7469d3d663ba" containerName="payload-pre-processing"
Sep 15 13:00:21.601289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601274    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26699778-c9be-4b1a-99e7-7469d3d663ba" containerName="payload-pre-processing"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601291    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1351c3c1-cd54-47e2-82e4-17d7aec02297" containerName="payload-processing"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601297    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1351c3c1-cd54-47e2-82e4-17d7aec02297" containerName="payload-processing"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601306    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96" containerName="cleanup"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601311    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96" containerName="cleanup"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601377    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1351c3c1-cd54-47e2-82e4-17d7aec02297" containerName="payload-processing"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601385    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d744a5-99e7-4d34-8be0-e039b0d1827b" containerName="cleanup"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601392    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96" containerName="cleanup"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601398    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cb2f50f-6a20-4855-a740-912b434450c9" containerName="cleanup"
Sep 15 13:00:21.601445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.601404    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="26699778-c9be-4b1a-99e7-7469d3d663ba" containerName="payload-pre-processing"
Sep 15 13:00:21.604473 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.604457    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:21.607365 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.607340    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-179a5f99-dockercfg-ptvr8\""
Sep 15 13:00:21.607505 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.607437    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-179a5f99\""
Sep 15 13:00:21.618562 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.618537    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"]
Sep 15 13:00:21.669348 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.669271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rg2\" (UniqueName: \"kubernetes.io/projected/17d28d2d-ba73-4214-88c6-72135ada9de4-kube-api-access-w6rg2\") pod \"payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:21.669348 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.669344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17d28d2d-ba73-4214-88c6-72135ada9de4-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:21.770808 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.770773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rg2\" (UniqueName: \"kubernetes.io/projected/17d28d2d-ba73-4214-88c6-72135ada9de4-kube-api-access-w6rg2\") pod \"payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:21.771019 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.770843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17d28d2d-ba73-4214-88c6-72135ada9de4-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:21.771529 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.771511    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17d28d2d-ba73-4214-88c6-72135ada9de4-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:21.779782 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.779749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rg2\" (UniqueName: \"kubernetes.io/projected/17d28d2d-ba73-4214-88c6-72135ada9de4-kube-api-access-w6rg2\") pod \"payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:21.895753 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.895720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:21.915603 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:21.915572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:22.194417 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:22.194389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"]
Sep 15 13:00:22.197105 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:00:22.197076    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d28d2d_ba73_4214_88c6_72135ada9de4.slice/crio-204f0753e6d64ed6f5bfe15015648b10987b5d06da088f1ea8db94fa0527c680 WatchSource:0}: Error finding container 204f0753e6d64ed6f5bfe15015648b10987b5d06da088f1ea8db94fa0527c680: Status 404 returned error can't find the container with id 204f0753e6d64ed6f5bfe15015648b10987b5d06da088f1ea8db94fa0527c680
Sep 15 13:00:22.787171 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:22.787127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:22.931751 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:22.931713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk" event={"ID":"17d28d2d-ba73-4214-88c6-72135ada9de4","Type":"ContainerStarted","Data":"6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42"}
Sep 15 13:00:22.931914 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:22.931781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk" event={"ID":"17d28d2d-ba73-4214-88c6-72135ada9de4","Type":"ContainerStarted","Data":"204f0753e6d64ed6f5bfe15015648b10987b5d06da088f1ea8db94fa0527c680"}
Sep 15 13:00:22.931914 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:22.931809    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:22.952574 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:22.952523    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk" podStartSLOduration=1.952507609 podStartE2EDuration="1.952507609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:00:22.951209765 +0000 UTC m=+928.313941363" watchObservedRunningTime="2026-09-15 13:00:22.952507609 +0000 UTC m=+928.315239240"
Sep 15 13:00:25.518904 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:25.518874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:25.638609 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:25.638569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:33.941414 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:33.941382    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:41.016942 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:41.016905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:44.395763 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:44.395720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:44.806460 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:44.806427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:45.812615 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:45.812578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:46.510446 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:46.510411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:47.385928 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:47.385893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:48.219441 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:48.219408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:48.947853 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:48.947818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:49.912641 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:49.912611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:50.648633 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:50.648593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:51.613867 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:51.613834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:52.294940 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:52.294903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:53.044580 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:53.044547    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:53.735522 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:53.735491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:53.779803 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:53.779771    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"]
Sep 15 13:00:53.780085 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:53.780045    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk" podUID="17d28d2d-ba73-4214-88c6-72135ada9de4" containerName="payload-pre-processing" containerID="cri-o://6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42" gracePeriod=30
Sep 15 13:00:53.939325 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:53.939269    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk" podUID="17d28d2d-ba73-4214-88c6-72135ada9de4" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.70:9004: connect: connection refused"
Sep 15 13:00:54.038303 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.038272    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:54.122286 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.122254    2562 generic.go:356] "Generic (PLEG): container finished" podID="17d28d2d-ba73-4214-88c6-72135ada9de4" containerID="6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42" exitCode=0
Sep 15 13:00:54.122469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.122298    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"
Sep 15 13:00:54.122469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.122330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk" event={"ID":"17d28d2d-ba73-4214-88c6-72135ada9de4","Type":"ContainerDied","Data":"6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42"}
Sep 15 13:00:54.122469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.122382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk" event={"ID":"17d28d2d-ba73-4214-88c6-72135ada9de4","Type":"ContainerDied","Data":"204f0753e6d64ed6f5bfe15015648b10987b5d06da088f1ea8db94fa0527c680"}
Sep 15 13:00:54.122469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.122406    2562 scope.go:117] "RemoveContainer" containerID="6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42"
Sep 15 13:00:54.133694 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.133666    2562 scope.go:117] "RemoveContainer" containerID="6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42"
Sep 15 13:00:54.134052 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:00:54.134032    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42\": container with ID starting with 6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42 not found: ID does not exist" containerID="6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42"
Sep 15 13:00:54.134121 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.134062    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42"} err="failed to get container status \"6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42\": rpc error: code = NotFound desc = could not find container \"6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42\": container with ID starting with 6d6e31be505e0372d56ceb8f1ee4769d5969fa8acfed615d24cb90b635a05a42 not found: ID does not exist"
Sep 15 13:00:54.156524 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.156494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6rg2\" (UniqueName: \"kubernetes.io/projected/17d28d2d-ba73-4214-88c6-72135ada9de4-kube-api-access-w6rg2\") pod \"17d28d2d-ba73-4214-88c6-72135ada9de4\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") "
Sep 15 13:00:54.156711 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.156574    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17d28d2d-ba73-4214-88c6-72135ada9de4-plugins-config-volume\") pod \"17d28d2d-ba73-4214-88c6-72135ada9de4\" (UID: \"17d28d2d-ba73-4214-88c6-72135ada9de4\") "
Sep 15 13:00:54.156933 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.156911    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17d28d2d-ba73-4214-88c6-72135ada9de4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17d28d2d-ba73-4214-88c6-72135ada9de4" (UID: "17d28d2d-ba73-4214-88c6-72135ada9de4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:00:54.158607 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.158577    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17d28d2d-ba73-4214-88c6-72135ada9de4-kube-api-access-w6rg2" (OuterVolumeSpecName: "kube-api-access-w6rg2") pod "17d28d2d-ba73-4214-88c6-72135ada9de4" (UID: "17d28d2d-ba73-4214-88c6-72135ada9de4"). InnerVolumeSpecName "kube-api-access-w6rg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:54.257886 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.257854    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6rg2\" (UniqueName: \"kubernetes.io/projected/17d28d2d-ba73-4214-88c6-72135ada9de4-kube-api-access-w6rg2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.257886 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.257882    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17d28d2d-ba73-4214-88c6-72135ada9de4-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.448615 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.448580    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"]
Sep 15 13:00:54.452667 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:54.452639    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-179a5f99-f9f6bbcfd-p9zfk"]
Sep 15 13:00:55.264396 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:55.264362    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17d28d2d-ba73-4214-88c6-72135ada9de4" path="/var/lib/kubelet/pods/17d28d2d-ba73-4214-88c6-72135ada9de4/volumes"
Sep 15 13:00:56.279761 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:56.279725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:56.379555 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:56.379518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:56.914216 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:56.914179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:57.619296 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:57.619256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:58.417133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:58.417096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:00:59.400269 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:00:59.400235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:00.037882 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.037849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:00.066917 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.066887    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"]
Sep 15 13:01:00.067160 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.067136    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs" podUID="37673f72-5893-4155-b37b-5b1a33bb54b1" containerName="payload-processing" containerID="cri-o://4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4" gracePeriod=30
Sep 15 13:01:00.075044 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.075013    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"]
Sep 15 13:01:00.075861 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.075814    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz" podUID="d92eff55-17f3-4b71-982e-5f71628233df" containerName="payload-pre-processing" containerID="cri-o://0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80" gracePeriod=30
Sep 15 13:01:00.120576 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.120540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:00.193165 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.193113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:00.279192 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.279159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:00.335914 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.335891    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 13:01:00.363100 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.363076    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 13:01:00.405448 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.405412    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9bwc\" (UniqueName: \"kubernetes.io/projected/d92eff55-17f3-4b71-982e-5f71628233df-kube-api-access-z9bwc\") pod \"d92eff55-17f3-4b71-982e-5f71628233df\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") "
Sep 15 13:01:00.405913 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.405475    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbzk7\" (UniqueName: \"kubernetes.io/projected/37673f72-5893-4155-b37b-5b1a33bb54b1-kube-api-access-tbzk7\") pod \"37673f72-5893-4155-b37b-5b1a33bb54b1\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") "
Sep 15 13:01:00.405913 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.405518    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37673f72-5893-4155-b37b-5b1a33bb54b1-plugins-config-volume\") pod \"37673f72-5893-4155-b37b-5b1a33bb54b1\" (UID: \"37673f72-5893-4155-b37b-5b1a33bb54b1\") "
Sep 15 13:01:00.405913 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.405558    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d92eff55-17f3-4b71-982e-5f71628233df-plugins-config-volume\") pod \"d92eff55-17f3-4b71-982e-5f71628233df\" (UID: \"d92eff55-17f3-4b71-982e-5f71628233df\") "
Sep 15 13:01:00.406168 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.406140    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92eff55-17f3-4b71-982e-5f71628233df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d92eff55-17f3-4b71-982e-5f71628233df" (UID: "d92eff55-17f3-4b71-982e-5f71628233df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:01:00.406168 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.405940    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37673f72-5893-4155-b37b-5b1a33bb54b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37673f72-5893-4155-b37b-5b1a33bb54b1" (UID: "37673f72-5893-4155-b37b-5b1a33bb54b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:01:00.407760 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.407691    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37673f72-5893-4155-b37b-5b1a33bb54b1-kube-api-access-tbzk7" (OuterVolumeSpecName: "kube-api-access-tbzk7") pod "37673f72-5893-4155-b37b-5b1a33bb54b1" (UID: "37673f72-5893-4155-b37b-5b1a33bb54b1"). InnerVolumeSpecName "kube-api-access-tbzk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:01:00.408341 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.408318    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d92eff55-17f3-4b71-982e-5f71628233df-kube-api-access-z9bwc" (OuterVolumeSpecName: "kube-api-access-z9bwc") pod "d92eff55-17f3-4b71-982e-5f71628233df" (UID: "d92eff55-17f3-4b71-982e-5f71628233df"). InnerVolumeSpecName "kube-api-access-z9bwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:01:00.506607 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.506563    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9bwc\" (UniqueName: \"kubernetes.io/projected/d92eff55-17f3-4b71-982e-5f71628233df-kube-api-access-z9bwc\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:01:00.506607 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.506601    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbzk7\" (UniqueName: \"kubernetes.io/projected/37673f72-5893-4155-b37b-5b1a33bb54b1-kube-api-access-tbzk7\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:01:00.506607 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.506612    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37673f72-5893-4155-b37b-5b1a33bb54b1-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:01:00.506842 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:00.506620    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d92eff55-17f3-4b71-982e-5f71628233df-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:01:01.067623 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.067573    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:01.168405 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.168372    2562 generic.go:356] "Generic (PLEG): container finished" podID="37673f72-5893-4155-b37b-5b1a33bb54b1" containerID="4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4" exitCode=0
Sep 15 13:01:01.168605 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.168416    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"
Sep 15 13:01:01.168605 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.168466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs" event={"ID":"37673f72-5893-4155-b37b-5b1a33bb54b1","Type":"ContainerDied","Data":"4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4"}
Sep 15 13:01:01.168605 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.168525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs" event={"ID":"37673f72-5893-4155-b37b-5b1a33bb54b1","Type":"ContainerDied","Data":"2ae8ae32622ce7afc1b6512e8d81801eefa0177df58a2d4057f036bb64b9d764"}
Sep 15 13:01:01.168605 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.168555    2562 scope.go:117] "RemoveContainer" containerID="4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4"
Sep 15 13:01:01.169997 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.169883    2562 generic.go:356] "Generic (PLEG): container finished" podID="d92eff55-17f3-4b71-982e-5f71628233df" containerID="0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80" exitCode=0
Sep 15 13:01:01.169997 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.169918    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"
Sep 15 13:01:01.169997 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.169961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz" event={"ID":"d92eff55-17f3-4b71-982e-5f71628233df","Type":"ContainerDied","Data":"0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80"}
Sep 15 13:01:01.170124 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.170034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz" event={"ID":"d92eff55-17f3-4b71-982e-5f71628233df","Type":"ContainerDied","Data":"8074104daab045f0fd5f8571b0e3a1002c7fa95c2c767a7b1373bedb6ca1855f"}
Sep 15 13:01:01.178778 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.178755    2562 scope.go:117] "RemoveContainer" containerID="4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4"
Sep 15 13:01:01.179137 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:01:01.179113    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4\": container with ID starting with 4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4 not found: ID does not exist" containerID="4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4"
Sep 15 13:01:01.179218 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.179140    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4"} err="failed to get container status \"4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4\": rpc error: code = NotFound desc = could not find container \"4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4\": container with ID starting with 4dd35fdf43968e7cd4ee3d193a50a524419bec5cb22956f43712d4d0233658a4 not found: ID does not exist"
Sep 15 13:01:01.179218 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.179159    2562 scope.go:117] "RemoveContainer" containerID="0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80"
Sep 15 13:01:01.188130 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.188112    2562 scope.go:117] "RemoveContainer" containerID="0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80"
Sep 15 13:01:01.188381 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:01:01.188359    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80\": container with ID starting with 0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80 not found: ID does not exist" containerID="0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80"
Sep 15 13:01:01.188442 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.188393    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80"} err="failed to get container status \"0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80\": rpc error: code = NotFound desc = could not find container \"0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80\": container with ID starting with 0247ff7194c78c943091f8e9561d2092e8a4af438275c32cf0fd1950b2fcba80 not found: ID does not exist"
Sep 15 13:01:01.197325 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.197298    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"]
Sep 15 13:01:01.202337 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.202316    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-59f4a3-5d7dd844fd-rp9zz"]
Sep 15 13:01:01.215173 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.215146    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"]
Sep 15 13:01:01.221442 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.221416    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-59f4a3-57764894d5-wn8bs"]
Sep 15 13:01:01.262706 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.262678    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37673f72-5893-4155-b37b-5b1a33bb54b1" path="/var/lib/kubelet/pods/37673f72-5893-4155-b37b-5b1a33bb54b1/volumes"
Sep 15 13:01:01.263112 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:01.263098    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d92eff55-17f3-4b71-982e-5f71628233df" path="/var/lib/kubelet/pods/d92eff55-17f3-4b71-982e-5f71628233df/volumes"
Sep 15 13:01:03.603959 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:03.603926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:03.705188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:03.705158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:03.968342 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:03.968308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:05.699655 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:05.699622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:22.464398 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:22.464314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:26.279402 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:26.279366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:28.507736 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:28.507699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:32.548053 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:32.548013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:42.996482 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:42.996453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:43.306688 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:43.306585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:45.658613 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:45.658575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:45.781690 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:45.781646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:46.966481 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:46.966441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:47.205866 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:47.205830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:47.304104 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:47.304004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:48.089788 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:48.089744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:49.048002 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:49.047954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:50.020153 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:50.020119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:51.016421 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.016384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:51.084891 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.084844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:51.326070 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.325959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:51.542152 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.542110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:51.639110 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.639024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:01:51.669532 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.669503    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"]
Sep 15 13:01:51.669879 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.669866    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92eff55-17f3-4b71-982e-5f71628233df" containerName="payload-pre-processing"
Sep 15 13:01:51.669925 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.669881    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92eff55-17f3-4b71-982e-5f71628233df" containerName="payload-pre-processing"
Sep 15 13:01:51.669925 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.669900    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37673f72-5893-4155-b37b-5b1a33bb54b1" containerName="payload-processing"
Sep 15 13:01:51.669925 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.669906    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="37673f72-5893-4155-b37b-5b1a33bb54b1" containerName="payload-processing"
Sep 15 13:01:51.669925 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.669916    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d28d2d-ba73-4214-88c6-72135ada9de4" containerName="payload-pre-processing"
Sep 15 13:01:51.669925 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.669922    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d28d2d-ba73-4214-88c6-72135ada9de4" containerName="payload-pre-processing"
Sep 15 13:01:51.670127 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.670014    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="17d28d2d-ba73-4214-88c6-72135ada9de4" containerName="payload-pre-processing"
Sep 15 13:01:51.670127 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.670024    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d92eff55-17f3-4b71-982e-5f71628233df" containerName="payload-pre-processing"
Sep 15 13:01:51.670127 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.670031    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="37673f72-5893-4155-b37b-5b1a33bb54b1" containerName="payload-processing"
Sep 15 13:01:51.673172 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.673155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:51.676656 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.676635    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-413e9f\""
Sep 15 13:01:51.676789 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.676776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-413e9f-dockercfg-j9rpt\""
Sep 15 13:01:51.685101 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.685075    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"]
Sep 15 13:01:51.769853 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.769818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqvsq\" (UniqueName: \"kubernetes.io/projected/642f3bbd-1f22-438a-bd20-424e4c44f73e-kube-api-access-xqvsq\") pod \"payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") " pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:51.770066 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.769877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642f3bbd-1f22-438a-bd20-424e4c44f73e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") " pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:51.870470 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.870432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642f3bbd-1f22-438a-bd20-424e4c44f73e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") " pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:51.870657 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.870536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqvsq\" (UniqueName: \"kubernetes.io/projected/642f3bbd-1f22-438a-bd20-424e4c44f73e-kube-api-access-xqvsq\") pod \"payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") " pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:51.871180 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.871158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642f3bbd-1f22-438a-bd20-424e4c44f73e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") " pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:51.880038 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.880009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqvsq\" (UniqueName: \"kubernetes.io/projected/642f3bbd-1f22-438a-bd20-424e4c44f73e-kube-api-access-xqvsq\") pod \"payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") " pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:51.984121 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:51.984081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:52.258908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:52.258878    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"]
Sep 15 13:01:52.260734 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:01:52.260689    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642f3bbd_1f22_438a_bd20_424e4c44f73e.slice/crio-773e08560f6b9d77327c01a830300e10616de7e360eb03b36ed3dc3665dcc1c1 WatchSource:0}: Error finding container 773e08560f6b9d77327c01a830300e10616de7e360eb03b36ed3dc3665dcc1c1: Status 404 returned error can't find the container with id 773e08560f6b9d77327c01a830300e10616de7e360eb03b36ed3dc3665dcc1c1
Sep 15 13:01:52.483743 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:52.483710    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5" event={"ID":"642f3bbd-1f22-438a-bd20-424e4c44f73e","Type":"ContainerStarted","Data":"7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c"}
Sep 15 13:01:52.483942 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:52.483766    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5" event={"ID":"642f3bbd-1f22-438a-bd20-424e4c44f73e","Type":"ContainerStarted","Data":"773e08560f6b9d77327c01a830300e10616de7e360eb03b36ed3dc3665dcc1c1"}
Sep 15 13:01:52.483942 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:52.483850    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:01:52.505412 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:01:52.505344    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5" podStartSLOduration=1.505314341 podStartE2EDuration="1.505314341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:01:52.501923105 +0000 UTC m=+1017.864654705" watchObservedRunningTime="2026-09-15 13:01:52.505314341 +0000 UTC m=+1017.868045941"
Sep 15 13:02:03.492384 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:03.492353    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:02:14.613147 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.613116    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"]
Sep 15 13:02:14.618652 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.618631    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.621738 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.621717    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"premium-w4-2af9a3-kserve-self-signed-certs\""
Sep 15 13:02:14.627959 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.627934    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"]
Sep 15 13:02:14.646602 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.646570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:14.659622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.659592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-dshm\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.659622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.659624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-tmp-dir\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.659831 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.659654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-home\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.659831 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.659671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqrgw\" (UniqueName: \"kubernetes.io/projected/de9bcbcb-c974-48e9-bacc-66973597e7c1-kube-api-access-nqrgw\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.659831 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.659733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-model-cache\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.659831 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.659771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9bcbcb-c974-48e9-bacc-66973597e7c1-tls-certs\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.745593 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.745562    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:14.760649 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.760620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-dshm\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.760781 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.760651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-tmp-dir\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.760781 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.760681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-home\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.760781 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.760703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqrgw\" (UniqueName: \"kubernetes.io/projected/de9bcbcb-c974-48e9-bacc-66973597e7c1-kube-api-access-nqrgw\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.760781 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.760725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-model-cache\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.760781 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.760741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9bcbcb-c974-48e9-bacc-66973597e7c1-tls-certs\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.761123 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.761106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-home\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.761177 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.761155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-tmp-dir\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.761219 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.761197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-model-cache\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.762979 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.762950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-dshm\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.763175 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.763159    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9bcbcb-c974-48e9-bacc-66973597e7c1-tls-certs\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.769570 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.769547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqrgw\" (UniqueName: \"kubernetes.io/projected/de9bcbcb-c974-48e9-bacc-66973597e7c1-kube-api-access-nqrgw\") pod \"premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") " pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:14.928212 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:14.928180    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:15.203098 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:15.203066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"]
Sep 15 13:02:15.204254 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:02:15.204227    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde9bcbcb_c974_48e9_bacc_66973597e7c1.slice/crio-fc222ab65b595534d1ffaa1037be60fd26980164931d8a5c8fe272a5c914be38 WatchSource:0}: Error finding container fc222ab65b595534d1ffaa1037be60fd26980164931d8a5c8fe272a5c914be38: Status 404 returned error can't find the container with id fc222ab65b595534d1ffaa1037be60fd26980164931d8a5c8fe272a5c914be38
Sep 15 13:02:15.383581 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:15.383551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:15.620885 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:15.620790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th" event={"ID":"de9bcbcb-c974-48e9-bacc-66973597e7c1","Type":"ContainerStarted","Data":"f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7"}
Sep 15 13:02:15.620885 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:15.620844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th" event={"ID":"de9bcbcb-c974-48e9-bacc-66973597e7c1","Type":"ContainerStarted","Data":"fc222ab65b595534d1ffaa1037be60fd26980164931d8a5c8fe272a5c914be38"}
Sep 15 13:02:15.644434 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:15.644382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th" podStartSLOduration=1.644366823 podStartE2EDuration="1.644366823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:02:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:02:15.642500079 +0000 UTC m=+1041.005231676" watchObservedRunningTime="2026-09-15 13:02:15.644366823 +0000 UTC m=+1041.007098463"
Sep 15 13:02:16.210199 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:16.210167    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:16.908029 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:16.907991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:17.225016 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:17.224961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:17.649192 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:17.649098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:18.528652 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:18.528615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:24.928565 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:24.928524    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:24.929101 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:24.928588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:24.941032 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:24.941000    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:25.687379 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:25.687350    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:02:37.193389 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:37.193354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:37.302799 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:37.302761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:38.396453 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:38.396422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:56.491319 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:56.491215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:56.645186 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:56.645149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:57.412023 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:57.411991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:02:59.240477 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:02:59.240431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:20.415092 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.415042    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"]
Sep 15 13:03:20.418863 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.418834    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.428886 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.428858    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-413e9f\"/\"kube-root-ca.crt\""
Sep 15 13:03:20.432448 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.432411    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-413e9f\"/\"openshift-service-ca.crt\""
Sep 15 13:03:20.432622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.432432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-413e9f\"/\"default-dockercfg-f44jw\""
Sep 15 13:03:20.432622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.432511    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-413e9f\"/\"explicit-model-413e9f-kserve-self-signed-certs\""
Sep 15 13:03:20.442573 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.442519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"]
Sep 15 13:03:20.526567 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.526505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:20.563729 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.563684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76882\" (UniqueName: \"kubernetes.io/projected/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-kube-api-access-76882\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.563893 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.563789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-model-cache\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.563893 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.563818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tmp-dir\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.563893 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.563841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-dshm\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.564036 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.563903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tls-certs\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.564036 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.563946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-home\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.664902 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.664860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-model-cache\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665152 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.664913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tmp-dir\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665152 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.664942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-dshm\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665152 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.665009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tls-certs\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665152 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.665034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-home\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665152 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.665077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76882\" (UniqueName: \"kubernetes.io/projected/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-kube-api-access-76882\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665419 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.665364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-model-cache\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665419 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.665375    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tmp-dir\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.665522 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.665439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-home\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.667588 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.667562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-dshm\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.667771 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.667743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tls-certs\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.680391 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.680361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76882\" (UniqueName: \"kubernetes.io/projected/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-kube-api-access-76882\") pod \"explicit-model-413e9f-kserve-846d8d6ff7-wtfjf\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") " pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:20.730203 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:20.730159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:21.024483 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:21.024443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"]
Sep 15 13:03:21.028193 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:03:21.028162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07654d31_8c4f_4c30_8cf4_0c572ff1cdb5.slice/crio-70a6cced385f0afca82eb4700b45a6cb48c302676b8511c3755e39569777f849 WatchSource:0}: Error finding container 70a6cced385f0afca82eb4700b45a6cb48c302676b8511c3755e39569777f849: Status 404 returned error can't find the container with id 70a6cced385f0afca82eb4700b45a6cb48c302676b8511c3755e39569777f849
Sep 15 13:03:22.011954 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:22.011911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf" event={"ID":"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5","Type":"ContainerStarted","Data":"338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c"}
Sep 15 13:03:22.011954 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:22.011961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf" event={"ID":"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5","Type":"ContainerStarted","Data":"70a6cced385f0afca82eb4700b45a6cb48c302676b8511c3755e39569777f849"}
Sep 15 13:03:22.040374 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:22.040304    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf" podStartSLOduration=2.040284562 podStartE2EDuration="2.040284562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:03:22.038653628 +0000 UTC m=+1107.401385227" watchObservedRunningTime="2026-09-15 13:03:22.040284562 +0000 UTC m=+1107.403016161"
Sep 15 13:03:23.304697 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:23.304655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:29.739240 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:29.739201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:29.870042 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:29.870000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:29.983235 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:29.983192    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:30.730510 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:30.730461    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:30.730743 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:30.730693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:30.744168 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:30.744133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:31.082180 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:31.082085    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:38.088869 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:38.088823    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"]
Sep 15 13:03:38.137784 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:38.137745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:39.377276 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:39.377225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:40.329409 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:40.329361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:43.714581 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:43.714540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:43.823025 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:43.822987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:44.244909 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:44.244870    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:45.184440 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:45.184402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:45.845720 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:45.845656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:46.366553 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:46.366513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:47.070944 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:47.070876    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:48.437362 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:48.437328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:49.202093 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.202052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:49.235515 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.235474    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"]
Sep 15 13:03:49.235805 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.235773    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5" podUID="642f3bbd-1f22-438a-bd20-424e4c44f73e" containerName="payload-processing" containerID="cri-o://7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c" gracePeriod=30
Sep 15 13:03:49.309539 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.309499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:49.414630 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.414581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:49.505196 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.505155    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:03:49.537094 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.537051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:49.636979 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.636939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:49.662541 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.662496    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqvsq\" (UniqueName: \"kubernetes.io/projected/642f3bbd-1f22-438a-bd20-424e4c44f73e-kube-api-access-xqvsq\") pod \"642f3bbd-1f22-438a-bd20-424e4c44f73e\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") "
Sep 15 13:03:49.662712 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.662587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642f3bbd-1f22-438a-bd20-424e4c44f73e-plugins-config-volume\") pod \"642f3bbd-1f22-438a-bd20-424e4c44f73e\" (UID: \"642f3bbd-1f22-438a-bd20-424e4c44f73e\") "
Sep 15 13:03:49.663054 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.663027    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/642f3bbd-1f22-438a-bd20-424e4c44f73e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "642f3bbd-1f22-438a-bd20-424e4c44f73e" (UID: "642f3bbd-1f22-438a-bd20-424e4c44f73e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:03:49.664872 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.664835    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642f3bbd-1f22-438a-bd20-424e4c44f73e-kube-api-access-xqvsq" (OuterVolumeSpecName: "kube-api-access-xqvsq") pod "642f3bbd-1f22-438a-bd20-424e4c44f73e" (UID: "642f3bbd-1f22-438a-bd20-424e4c44f73e"). InnerVolumeSpecName "kube-api-access-xqvsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:03:49.763695 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.763586    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqvsq\" (UniqueName: \"kubernetes.io/projected/642f3bbd-1f22-438a-bd20-424e4c44f73e-kube-api-access-xqvsq\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.763695 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.763623    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642f3bbd-1f22-438a-bd20-424e4c44f73e-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.876255 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:49.876209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:50.087915 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.087813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:50.201610 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.201560    2562 generic.go:356] "Generic (PLEG): container finished" podID="642f3bbd-1f22-438a-bd20-424e4c44f73e" containerID="7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c" exitCode=0
Sep 15 13:03:50.201820 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.201673    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"
Sep 15 13:03:50.201820 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.201656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5" event={"ID":"642f3bbd-1f22-438a-bd20-424e4c44f73e","Type":"ContainerDied","Data":"7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c"}
Sep 15 13:03:50.201935 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.201910    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5" event={"ID":"642f3bbd-1f22-438a-bd20-424e4c44f73e","Type":"ContainerDied","Data":"773e08560f6b9d77327c01a830300e10616de7e360eb03b36ed3dc3665dcc1c1"}
Sep 15 13:03:50.202002 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.201987    2562 scope.go:117] "RemoveContainer" containerID="7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c"
Sep 15 13:03:50.212994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.212940    2562 scope.go:117] "RemoveContainer" containerID="7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c"
Sep 15 13:03:50.213362 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:03:50.213337    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c\": container with ID starting with 7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c not found: ID does not exist" containerID="7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c"
Sep 15 13:03:50.213453 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.213371    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c"} err="failed to get container status \"7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c\": rpc error: code = NotFound desc = could not find container \"7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c\": container with ID starting with 7de3c3c186557f3e821173a6dede3a76977e750771502d69f1c4d5bf559a726c not found: ID does not exist"
Sep 15 13:03:50.237486 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.237444    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"]
Sep 15 13:03:50.240235 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:50.240203    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-413e9f-68958d8c69-brvr5"]
Sep 15 13:03:51.015421 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:51.015385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:51.262719 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:51.262677    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="642f3bbd-1f22-438a-bd20-424e4c44f73e" path="/var/lib/kubelet/pods/642f3bbd-1f22-438a-bd20-424e4c44f73e/volumes"
Sep 15 13:03:51.885779 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:51.885747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:53.110442 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.110388    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf" podUID="07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" containerName="main" containerID="cri-o://338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c" gracePeriod=45
Sep 15 13:03:53.385702 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.385648    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:53.501795 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.501755    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-home\") pod \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") "
Sep 15 13:03:53.502046 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.501843    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76882\" (UniqueName: \"kubernetes.io/projected/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-kube-api-access-76882\") pod \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") "
Sep 15 13:03:53.502046 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.501869    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tmp-dir\") pod \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") "
Sep 15 13:03:53.502046 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.501893    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-model-cache\") pod \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") "
Sep 15 13:03:53.502046 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.501916    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-dshm\") pod \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") "
Sep 15 13:03:53.502046 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.501951    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tls-certs\") pod \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\" (UID: \"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5\") "
Sep 15 13:03:53.502314 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.502157    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-home" (OuterVolumeSpecName: "home") pod "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" (UID: "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:03:53.502314 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.502171    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" (UID: "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:03:53.502314 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.502232    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-model-cache" (OuterVolumeSpecName: "model-cache") pod "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" (UID: "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:03:53.502469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.502338    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tmp-dir\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:53.502469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.502362    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-model-cache\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:53.502469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.502377    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-home\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:53.504386 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.504349    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-dshm" (OuterVolumeSpecName: "dshm") pod "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" (UID: "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:03:53.504516 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.504402    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-kube-api-access-76882" (OuterVolumeSpecName: "kube-api-access-76882") pod "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" (UID: "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5"). InnerVolumeSpecName "kube-api-access-76882". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:03:53.504516 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.504400    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" (UID: "07654d31-8c4f-4c30-8cf4-0c572ff1cdb5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:03:53.602903 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.602865    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76882\" (UniqueName: \"kubernetes.io/projected/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-kube-api-access-76882\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:53.602903 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.602898    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-dshm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:53.602903 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:53.602908    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5-tls-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:03:54.231591 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.231554    2562 generic.go:356] "Generic (PLEG): container finished" podID="07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" containerID="338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c" exitCode=0
Sep 15 13:03:54.232072 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.231603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"
Sep 15 13:03:54.232072 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.231620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf" event={"ID":"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5","Type":"ContainerDied","Data":"338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c"}
Sep 15 13:03:54.232072 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.231660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf" event={"ID":"07654d31-8c4f-4c30-8cf4-0c572ff1cdb5","Type":"ContainerDied","Data":"70a6cced385f0afca82eb4700b45a6cb48c302676b8511c3755e39569777f849"}
Sep 15 13:03:54.232072 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.231686    2562 scope.go:117] "RemoveContainer" containerID="338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c"
Sep 15 13:03:54.242622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.242602    2562 scope.go:117] "RemoveContainer" containerID="338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c"
Sep 15 13:03:54.243016 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:03:54.242988    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c\": container with ID starting with 338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c not found: ID does not exist" containerID="338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c"
Sep 15 13:03:54.243098 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.243030    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c"} err="failed to get container status \"338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c\": rpc error: code = NotFound desc = could not find container \"338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c\": container with ID starting with 338f46b3d81f0097dfaca3b295fb0939ab0618b3dc7969ecc109cd3669d3470c not found: ID does not exist"
Sep 15 13:03:54.272451 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.272405    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"]
Sep 15 13:03:54.277893 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:54.277847    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-413e9f/explicit-model-413e9f-kserve-846d8d6ff7-wtfjf"]
Sep 15 13:03:55.227300 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:55.227259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:55.264164 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:55.264118    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" path="/var/lib/kubelet/pods/07654d31-8c4f-4c30-8cf4-0c572ff1cdb5/volumes"
Sep 15 13:03:55.334286 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:55.334248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:57.980552 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:57.980509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:58.199018 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:58.198947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:58.450934 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:58.450896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:58.842532 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:58.842436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:59.498136 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:59.498093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:03:59.983279 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:03:59.983243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:00.636179 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:00.636139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:00.875648 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:00.875611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:02.133648 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:02.133611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:03.661552 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:03.661516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:04.449502 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:04.449468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:05.963694 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.963636    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"]
Sep 15 13:04:05.964133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.964078    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642f3bbd-1f22-438a-bd20-424e4c44f73e" containerName="payload-processing"
Sep 15 13:04:05.964133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.964094    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="642f3bbd-1f22-438a-bd20-424e4c44f73e" containerName="payload-processing"
Sep 15 13:04:05.964133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.964119    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" containerName="main"
Sep 15 13:04:05.964133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.964125    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" containerName="main"
Sep 15 13:04:05.964273 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.964190    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07654d31-8c4f-4c30-8cf4-0c572ff1cdb5" containerName="main"
Sep 15 13:04:05.964273 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.964202    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="642f3bbd-1f22-438a-bd20-424e4c44f73e" containerName="payload-processing"
Sep 15 13:04:05.969046 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.969016    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:05.995638 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:05.995598    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"e2e-conflict-a-10e04108-kserve-self-signed-certs\""
Sep 15 13:04:06.014409 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.014376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"]
Sep 15 13:04:06.017824 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.017790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-tmp-dir\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.018022 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.017844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16d6fa7-629c-49ca-a19e-b29556090956-tls-certs\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.018022 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.018007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-dshm\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.018138 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.018070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-model-cache\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.018138 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.018102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-home\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.018138 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.018125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhs5f\" (UniqueName: \"kubernetes.io/projected/f16d6fa7-629c-49ca-a19e-b29556090956-kube-api-access-dhs5f\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.088023 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.087945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:06.119636 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.119590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-dshm\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.119841 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.119651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-model-cache\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.119841 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.119685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-home\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.119841 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.119708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhs5f\" (UniqueName: \"kubernetes.io/projected/f16d6fa7-629c-49ca-a19e-b29556090956-kube-api-access-dhs5f\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.119841 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.119755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-tmp-dir\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.119841 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.119796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16d6fa7-629c-49ca-a19e-b29556090956-tls-certs\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.120480 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.120179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-home\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.120480 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.120218    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-model-cache\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.120480 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.120238    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-tmp-dir\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.122311 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.122274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-dshm\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.122562 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.122543    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16d6fa7-629c-49ca-a19e-b29556090956-tls-certs\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.135108 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.135068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhs5f\" (UniqueName: \"kubernetes.io/projected/f16d6fa7-629c-49ca-a19e-b29556090956-kube-api-access-dhs5f\") pod \"e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") " pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.281037 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.280934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:06.590878 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:06.590781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"]
Sep 15 13:04:06.595856 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:04:06.595820    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf16d6fa7_629c_49ca_a19e_b29556090956.slice/crio-fbc2320ae232159807d145b0c6f06816ae7d172906be873b60fdcd0e5cf37f5f WatchSource:0}: Error finding container fbc2320ae232159807d145b0c6f06816ae7d172906be873b60fdcd0e5cf37f5f: Status 404 returned error can't find the container with id fbc2320ae232159807d145b0c6f06816ae7d172906be873b60fdcd0e5cf37f5f
Sep 15 13:04:07.325882 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:07.325842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6" event={"ID":"f16d6fa7-629c-49ca-a19e-b29556090956","Type":"ContainerStarted","Data":"1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143"}
Sep 15 13:04:07.325882 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:07.325888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6" event={"ID":"f16d6fa7-629c-49ca-a19e-b29556090956","Type":"ContainerStarted","Data":"fbc2320ae232159807d145b0c6f06816ae7d172906be873b60fdcd0e5cf37f5f"}
Sep 15 13:04:07.366592 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:07.366517    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6" podStartSLOduration=2.366494954 podStartE2EDuration="2.366494954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:04:07.363115997 +0000 UTC m=+1152.725847595" watchObservedRunningTime="2026-09-15 13:04:07.366494954 +0000 UTC m=+1152.729226614"
Sep 15 13:04:08.704306 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:08.704246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:12.568614 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:12.568570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:12.675619 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:12.675580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:12.845886 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:12.845791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:13.036131 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:13.036088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:13.641105 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:13.641063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:13.776227 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:13.776187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:16.281702 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:16.281657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:16.282142 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:16.281726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:16.295282 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:16.295246    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:16.395345 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:16.395306    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:04:20.121543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:20.121437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:29.133251 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:29.133209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:29.232276 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:29.232239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:29.442253 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:29.442216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:29.560385 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:29.560346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:34.632977 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:34.632936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:42.412560 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:42.412521    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:42.941923 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:42.941888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:45.173600 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:45.173559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:46.125064 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:46.125026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:46.227060 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:46.227020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:51.779806 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:51.779755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:55.040846 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:55.040811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:55.104359 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:55.104310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:55.292599 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:55.292520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:04:55.292599 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:55.292518    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:04:57.392179 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:57.392131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:04:58.671680 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:58.671630    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"]
Sep 15 13:04:58.687418 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:04:58.687377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:03.181977 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:03.181938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:06.039494 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:06.039454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:12.257380 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:12.257341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:13.693872 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:13.693783    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6" podUID="f16d6fa7-629c-49ca-a19e-b29556090956" containerName="main" containerID="cri-o://1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143" gracePeriod=45
Sep 15 13:05:13.975505 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:13.975465    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:05:14.079764 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.079717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-dshm\") pod \"f16d6fa7-629c-49ca-a19e-b29556090956\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") "
Sep 15 13:05:14.079764 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.079767    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-tmp-dir\") pod \"f16d6fa7-629c-49ca-a19e-b29556090956\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") "
Sep 15 13:05:14.080062 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.079819    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-home\") pod \"f16d6fa7-629c-49ca-a19e-b29556090956\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") "
Sep 15 13:05:14.080062 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.079838    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-model-cache\") pod \"f16d6fa7-629c-49ca-a19e-b29556090956\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") "
Sep 15 13:05:14.080062 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.079876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhs5f\" (UniqueName: \"kubernetes.io/projected/f16d6fa7-629c-49ca-a19e-b29556090956-kube-api-access-dhs5f\") pod \"f16d6fa7-629c-49ca-a19e-b29556090956\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") "
Sep 15 13:05:14.080062 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.079908    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16d6fa7-629c-49ca-a19e-b29556090956-tls-certs\") pod \"f16d6fa7-629c-49ca-a19e-b29556090956\" (UID: \"f16d6fa7-629c-49ca-a19e-b29556090956\") "
Sep 15 13:05:14.080290 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.080137    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-home" (OuterVolumeSpecName: "home") pod "f16d6fa7-629c-49ca-a19e-b29556090956" (UID: "f16d6fa7-629c-49ca-a19e-b29556090956"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:05:14.080290 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.080155    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f16d6fa7-629c-49ca-a19e-b29556090956" (UID: "f16d6fa7-629c-49ca-a19e-b29556090956"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:05:14.080290 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.080163    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-model-cache" (OuterVolumeSpecName: "model-cache") pod "f16d6fa7-629c-49ca-a19e-b29556090956" (UID: "f16d6fa7-629c-49ca-a19e-b29556090956"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:05:14.080433 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.080295    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-tmp-dir\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:05:14.080433 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.080313    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-home\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:05:14.080433 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.080327    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-model-cache\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:05:14.082366 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.082324    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16d6fa7-629c-49ca-a19e-b29556090956-kube-api-access-dhs5f" (OuterVolumeSpecName: "kube-api-access-dhs5f") pod "f16d6fa7-629c-49ca-a19e-b29556090956" (UID: "f16d6fa7-629c-49ca-a19e-b29556090956"). InnerVolumeSpecName "kube-api-access-dhs5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:05:14.082366 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.082322    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16d6fa7-629c-49ca-a19e-b29556090956-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f16d6fa7-629c-49ca-a19e-b29556090956" (UID: "f16d6fa7-629c-49ca-a19e-b29556090956"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:05:14.082533 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.082332    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-dshm" (OuterVolumeSpecName: "dshm") pod "f16d6fa7-629c-49ca-a19e-b29556090956" (UID: "f16d6fa7-629c-49ca-a19e-b29556090956"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:05:14.181617 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.181569    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhs5f\" (UniqueName: \"kubernetes.io/projected/f16d6fa7-629c-49ca-a19e-b29556090956-kube-api-access-dhs5f\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:05:14.181617 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.181606    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16d6fa7-629c-49ca-a19e-b29556090956-tls-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:05:14.181617 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.181617    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16d6fa7-629c-49ca-a19e-b29556090956-dshm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:05:14.757932 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.757891    2562 generic.go:356] "Generic (PLEG): container finished" podID="f16d6fa7-629c-49ca-a19e-b29556090956" containerID="1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143" exitCode=0
Sep 15 13:05:14.757932 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.757933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"
Sep 15 13:05:14.758409 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.757998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6" event={"ID":"f16d6fa7-629c-49ca-a19e-b29556090956","Type":"ContainerDied","Data":"1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143"}
Sep 15 13:05:14.758409 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.758044    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6" event={"ID":"f16d6fa7-629c-49ca-a19e-b29556090956","Type":"ContainerDied","Data":"fbc2320ae232159807d145b0c6f06816ae7d172906be873b60fdcd0e5cf37f5f"}
Sep 15 13:05:14.758409 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.758061    2562 scope.go:117] "RemoveContainer" containerID="1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143"
Sep 15 13:05:14.769143 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.769120    2562 scope.go:117] "RemoveContainer" containerID="1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143"
Sep 15 13:05:14.769513 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:05:14.769493    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143\": container with ID starting with 1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143 not found: ID does not exist" containerID="1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143"
Sep 15 13:05:14.769580 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.769526    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143"} err="failed to get container status \"1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143\": rpc error: code = NotFound desc = could not find container \"1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143\": container with ID starting with 1ab9321f7a45034f623961458c73da63320f0815e4189cf09a93838df61f4143 not found: ID does not exist"
Sep 15 13:05:14.783112 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.783066    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"]
Sep 15 13:05:14.787033 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:14.786986    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/e2e-conflict-a-10e04108-kserve-7f8fb59896-7t5r6"]
Sep 15 13:05:15.263468 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:15.263414    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f16d6fa7-629c-49ca-a19e-b29556090956" path="/var/lib/kubelet/pods/f16d6fa7-629c-49ca-a19e-b29556090956/volumes"
Sep 15 13:05:21.689806 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.689742    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"]
Sep 15 13:05:21.690454 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.690425    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16d6fa7-629c-49ca-a19e-b29556090956" containerName="main"
Sep 15 13:05:21.690512 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.690456    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16d6fa7-629c-49ca-a19e-b29556090956" containerName="main"
Sep 15 13:05:21.690584 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.690571    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16d6fa7-629c-49ca-a19e-b29556090956" containerName="main"
Sep 15 13:05:21.696133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.696099    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.700515 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.700481    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"distinct-2-w4-2af9a3-kserve-self-signed-certs\""
Sep 15 13:05:21.704386 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.704345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"]
Sep 15 13:05:21.854378 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.854343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxv8m\" (UniqueName: \"kubernetes.io/projected/0a669531-9188-4f11-b3d9-11abcbf6c410-kube-api-access-dxv8m\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.854542 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.854395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-home\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.854542 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.854415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-dshm\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.854542 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.854499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-tmp-dir\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.854676 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.854554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-model-cache\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.854676 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.854586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a669531-9188-4f11-b3d9-11abcbf6c410-tls-certs\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.899619 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.899576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:21.956012 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.955895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-home\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956012 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.955936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-dshm\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956234 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.956109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-tmp-dir\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956234 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.956192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-model-cache\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956357 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.956237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a669531-9188-4f11-b3d9-11abcbf6c410-tls-certs\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956410 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.956345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxv8m\" (UniqueName: \"kubernetes.io/projected/0a669531-9188-4f11-b3d9-11abcbf6c410-kube-api-access-dxv8m\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956410 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.956383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-home\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956542 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.956518    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-tmp-dir\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.956588 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.956559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-model-cache\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.958641 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.958601    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-dshm\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.958891 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.958869    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a669531-9188-4f11-b3d9-11abcbf6c410-tls-certs\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:21.967197 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:21.967161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxv8m\" (UniqueName: \"kubernetes.io/projected/0a669531-9188-4f11-b3d9-11abcbf6c410-kube-api-access-dxv8m\") pod \"distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:22.009194 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:22.009135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:22.303379 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:22.303338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"]
Sep 15 13:05:22.305271 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:05:22.305233    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a669531_9188_4f11_b3d9_11abcbf6c410.slice/crio-ee78c5977535d7cabf0148c46b45774b558ce7a6f7b69a7377308e8c71cd5681 WatchSource:0}: Error finding container ee78c5977535d7cabf0148c46b45774b558ce7a6f7b69a7377308e8c71cd5681: Status 404 returned error can't find the container with id ee78c5977535d7cabf0148c46b45774b558ce7a6f7b69a7377308e8c71cd5681
Sep 15 13:05:22.811666 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:22.811615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx" event={"ID":"0a669531-9188-4f11-b3d9-11abcbf6c410","Type":"ContainerStarted","Data":"ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e"}
Sep 15 13:05:22.812165 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:22.811681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx" event={"ID":"0a669531-9188-4f11-b3d9-11abcbf6c410","Type":"ContainerStarted","Data":"ee78c5977535d7cabf0148c46b45774b558ce7a6f7b69a7377308e8c71cd5681"}
Sep 15 13:05:22.836429 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:22.836347    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx" podStartSLOduration=1.836324633 podStartE2EDuration="1.836324633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:05:22.834146056 +0000 UTC m=+1228.196877648" watchObservedRunningTime="2026-09-15 13:05:22.836324633 +0000 UTC m=+1228.199056232"
Sep 15 13:05:32.010185 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:32.010143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:32.010593 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:32.010196    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:32.023328 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:32.023297    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:32.889782 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:32.889750    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:05:37.675043 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:37.675000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:38.078596 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:38.078495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:38.903281 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:38.903239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:39.857415 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:39.857380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:40.684286 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:40.684249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:41.513129 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:41.513080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:42.229461 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:42.229414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:05:55.088823 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:05:55.088706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:06:45.742907 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:06:45.742869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:06:51.943634 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:06:51.943592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:07:06.556872 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:07:06.556826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:07:28.991142 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:07:28.991040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:14.926606 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:14.926571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:15.948538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:15.948496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:16.290656 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:16.290559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:16.655866 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:16.655773    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:21.371614 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:21.371576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:22.085182 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:22.085142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:25.106509 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.106467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:25.206453 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.206418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:25.364429 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.364320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:25.467572 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.467532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:25.478957 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.478906    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"]
Sep 15 13:08:25.482606 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.482578    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:25.485828 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.485799    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-de540b29-dockercfg-29xwh\""
Sep 15 13:08:25.485828 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.485824    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-de540b29\""
Sep 15 13:08:25.492061 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.491499    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"]
Sep 15 13:08:25.531765 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.531723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e85726-0127-4ce8-92e6-f24964a13506-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:25.531951 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.531849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qj97\" (UniqueName: \"kubernetes.io/projected/47e85726-0127-4ce8-92e6-f24964a13506-kube-api-access-7qj97\") pod \"payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:25.632798 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.632699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qj97\" (UniqueName: \"kubernetes.io/projected/47e85726-0127-4ce8-92e6-f24964a13506-kube-api-access-7qj97\") pod \"payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:25.633015 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.632840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e85726-0127-4ce8-92e6-f24964a13506-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:25.633549 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.633527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e85726-0127-4ce8-92e6-f24964a13506-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:25.641507 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.641466    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qj97\" (UniqueName: \"kubernetes.io/projected/47e85726-0127-4ce8-92e6-f24964a13506-kube-api-access-7qj97\") pod \"payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:25.796646 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:25.796609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:26.079290 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:26.079257    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"]
Sep 15 13:08:26.081777 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:08:26.081744    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e85726_0127_4ce8_92e6_f24964a13506.slice/crio-b694635e42801abb61f50a2ef3ec2c7381356df49b09e328eea9881a353912a3 WatchSource:0}: Error finding container b694635e42801abb61f50a2ef3ec2c7381356df49b09e328eea9881a353912a3: Status 404 returned error can't find the container with id b694635e42801abb61f50a2ef3ec2c7381356df49b09e328eea9881a353912a3
Sep 15 13:08:26.978948 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:26.978904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv" event={"ID":"47e85726-0127-4ce8-92e6-f24964a13506","Type":"ContainerStarted","Data":"9f7b030ccd0784b61e519eaa73fa156b780dade9f06333a8b38bbee99193cfce"}
Sep 15 13:08:26.979412 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:26.979018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:26.979412 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:26.979046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv" event={"ID":"47e85726-0127-4ce8-92e6-f24964a13506","Type":"ContainerStarted","Data":"b694635e42801abb61f50a2ef3ec2c7381356df49b09e328eea9881a353912a3"}
Sep 15 13:08:26.999311 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:26.999234    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv" podStartSLOduration=1.999214556 podStartE2EDuration="1.999214556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:08:26.995499053 +0000 UTC m=+1412.358230652" watchObservedRunningTime="2026-09-15 13:08:26.999214556 +0000 UTC m=+1412.361946162"
Sep 15 13:08:37.987035 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:37.987001    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:08:38.107768 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:38.107728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:44.172073 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:44.172035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:46.379367 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:46.379328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:47.061984 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:47.061922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:47.162110 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:47.162076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:47.672000 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:47.671914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:47.771956 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:47.771922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:48.076182 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:48.076087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:48.176919 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:48.176879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:48.920082 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:48.920045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:49.818952 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:49.818915    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:50.702282 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:50.702248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:54.115039 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:54.114996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:54.215279 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:54.215235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:54.697426 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:54.697389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:55.598340 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:55.598284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:56.300394 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:56.300357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:57.000088 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:57.000050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:57.802587 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:57.802553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:08:58.502215 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:08:58.502182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:04.965015 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:04.964941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:05.004547 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.004503    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"]
Sep 15 13:09:05.004803 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.004756    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv" podUID="47e85726-0127-4ce8-92e6-f24964a13506" containerName="payload-pre-processing" containerID="cri-o://9f7b030ccd0784b61e519eaa73fa156b780dade9f06333a8b38bbee99193cfce" gracePeriod=30
Sep 15 13:09:05.035783 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.035746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:05.136633 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.136598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:05.198058 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.198015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:05.225821 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.225709    2562 generic.go:356] "Generic (PLEG): container finished" podID="47e85726-0127-4ce8-92e6-f24964a13506" containerID="9f7b030ccd0784b61e519eaa73fa156b780dade9f06333a8b38bbee99193cfce" exitCode=0
Sep 15 13:09:05.225821 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.225786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv" event={"ID":"47e85726-0127-4ce8-92e6-f24964a13506","Type":"ContainerDied","Data":"9f7b030ccd0784b61e519eaa73fa156b780dade9f06333a8b38bbee99193cfce"}
Sep 15 13:09:05.285910 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.285871    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:09:05.317191 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.317150    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qj97\" (UniqueName: \"kubernetes.io/projected/47e85726-0127-4ce8-92e6-f24964a13506-kube-api-access-7qj97\") pod \"47e85726-0127-4ce8-92e6-f24964a13506\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") "
Sep 15 13:09:05.317404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.317331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e85726-0127-4ce8-92e6-f24964a13506-plugins-config-volume\") pod \"47e85726-0127-4ce8-92e6-f24964a13506\" (UID: \"47e85726-0127-4ce8-92e6-f24964a13506\") "
Sep 15 13:09:05.317797 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.317767    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e85726-0127-4ce8-92e6-f24964a13506-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47e85726-0127-4ce8-92e6-f24964a13506" (UID: "47e85726-0127-4ce8-92e6-f24964a13506"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:09:05.320113 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.320070    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e85726-0127-4ce8-92e6-f24964a13506-kube-api-access-7qj97" (OuterVolumeSpecName: "kube-api-access-7qj97") pod "47e85726-0127-4ce8-92e6-f24964a13506" (UID: "47e85726-0127-4ce8-92e6-f24964a13506"). InnerVolumeSpecName "kube-api-access-7qj97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:09:05.418921 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.418873    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47e85726-0127-4ce8-92e6-f24964a13506-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:09:05.418921 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.418911    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qj97\" (UniqueName: \"kubernetes.io/projected/47e85726-0127-4ce8-92e6-f24964a13506-kube-api-access-7qj97\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:09:05.556291 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.556181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:05.655689 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:05.655655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:06.235084 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:06.235041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv" event={"ID":"47e85726-0127-4ce8-92e6-f24964a13506","Type":"ContainerDied","Data":"b694635e42801abb61f50a2ef3ec2c7381356df49b09e328eea9881a353912a3"}
Sep 15 13:09:06.235535 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:06.235150    2562 scope.go:117] "RemoveContainer" containerID="9f7b030ccd0784b61e519eaa73fa156b780dade9f06333a8b38bbee99193cfce"
Sep 15 13:09:06.235535 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:06.235059    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"
Sep 15 13:09:06.258371 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:06.258329    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"]
Sep 15 13:09:06.261021 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:06.260982    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-de540b29-668b67fc9d-v6hpv"]
Sep 15 13:09:06.318121 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:06.318087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:07.088930 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:07.088890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:07.263165 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:07.263118    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e85726-0127-4ce8-92e6-f24964a13506" path="/var/lib/kubelet/pods/47e85726-0127-4ce8-92e6-f24964a13506/volumes"
Sep 15 13:09:07.895180 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:07.895145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:09.850146 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:09.850104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:11.537539 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:11.537497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:11.637349 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:11.637307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:11.781273 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:11.781229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:12.101026 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:12.100952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:12.198654 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:12.198613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:12.324691 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:12.324662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:23.100350 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:23.100304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:23.201904 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:23.201868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:24.809174 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:24.809133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:24.878172 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:24.878134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:25.667018 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:25.666985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:25.969546 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:25.969506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:26.502296 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:26.502266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:28.840929 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:28.840893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:28.971863 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:28.971818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:29.071794 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:29.071758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:29.899114 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:29.899077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:30.700527 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:30.700489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:31.454147 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:31.454109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:32.190514 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.190470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:32.290658 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.290621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:32.392038 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.392001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:32.680585 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.680554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:32.754378 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.754341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:32.827980 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.827920    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"]
Sep 15 13:09:32.828400 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.828383    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e85726-0127-4ce8-92e6-f24964a13506" containerName="payload-pre-processing"
Sep 15 13:09:32.828400 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.828401    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e85726-0127-4ce8-92e6-f24964a13506" containerName="payload-pre-processing"
Sep 15 13:09:32.828483 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.828475    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e85726-0127-4ce8-92e6-f24964a13506" containerName="payload-pre-processing"
Sep 15 13:09:32.831750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.831725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:32.835061 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.835031    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-f6a966-dockercfg-j4mnh\""
Sep 15 13:09:32.835061 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.835035    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-f6a966\""
Sep 15 13:09:32.841763 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.841731    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"]
Sep 15 13:09:32.984045 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.983922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzdtw\" (UniqueName: \"kubernetes.io/projected/cc1291dd-f3dc-40ff-9421-21e34941680a-kube-api-access-wzdtw\") pod \"payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:32.984212 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:32.984087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1291dd-f3dc-40ff-9421-21e34941680a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:33.085577 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:33.085536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1291dd-f3dc-40ff-9421-21e34941680a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:33.085770 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:33.085602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzdtw\" (UniqueName: \"kubernetes.io/projected/cc1291dd-f3dc-40ff-9421-21e34941680a-kube-api-access-wzdtw\") pod \"payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:33.086392 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:33.086364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1291dd-f3dc-40ff-9421-21e34941680a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:33.095813 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:33.095783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzdtw\" (UniqueName: \"kubernetes.io/projected/cc1291dd-f3dc-40ff-9421-21e34941680a-kube-api-access-wzdtw\") pod \"payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:33.145855 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:33.145817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:33.430514 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:33.430470    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"]
Sep 15 13:09:33.431753 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:09:33.431720    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1291dd_f3dc_40ff_9421_21e34941680a.slice/crio-725f980345ca02e65a161c8c339ac5be2932a2667236c4499bc68708a1bfc035 WatchSource:0}: Error finding container 725f980345ca02e65a161c8c339ac5be2932a2667236c4499bc68708a1bfc035: Status 404 returned error can't find the container with id 725f980345ca02e65a161c8c339ac5be2932a2667236c4499bc68708a1bfc035
Sep 15 13:09:34.427310 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:34.427265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86" event={"ID":"cc1291dd-f3dc-40ff-9421-21e34941680a","Type":"ContainerStarted","Data":"ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60"}
Sep 15 13:09:34.427759 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:34.427334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86" event={"ID":"cc1291dd-f3dc-40ff-9421-21e34941680a","Type":"ContainerStarted","Data":"725f980345ca02e65a161c8c339ac5be2932a2667236c4499bc68708a1bfc035"}
Sep 15 13:09:34.427759 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:34.427570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:34.446062 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:34.445988    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86" podStartSLOduration=2.445946861 podStartE2EDuration="2.445946861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:09:34.444417585 +0000 UTC m=+1479.807149181" watchObservedRunningTime="2026-09-15 13:09:34.445946861 +0000 UTC m=+1479.808678461"
Sep 15 13:09:45.436125 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:45.436090    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:09:54.425887 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:54.425850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:55.179856 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:55.179810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:55.350035 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:55.350004    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:09:55.352337 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:55.352307    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:09:55.979349 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:55.979311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:56.698439 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:56.698389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:57.508447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:57.508407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:58.983888 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:58.983835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:59.297332 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:59.297236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:59.615122 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:59.615014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:09:59.939314 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:09:59.939272    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:02.568927 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:02.568881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:03.569013 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:03.568940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:03.725975 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:03.725927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:04.906157 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:04.906120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:05.738400 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:05.738354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:06.477892 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:06.477846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:07.321369 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.321327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:07.419428 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.419388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:07.519555 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.519516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:07.835135 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.835093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:07.940408 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.940371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:07.954117 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.954065    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"]
Sep 15 13:10:07.959749 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.959712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:07.962913 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.962890    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-ddd0eb\""
Sep 15 13:10:07.963095 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.962890    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-ddd0eb-dockercfg-bbxrx\""
Sep 15 13:10:07.971337 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:07.971303    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"]
Sep 15 13:10:08.048873 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.048825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glh6j\" (UniqueName: \"kubernetes.io/projected/f8f74299-8c73-4832-84f5-73efb2a12539-kube-api-access-glh6j\") pod \"payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:08.049075 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.049004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f74299-8c73-4832-84f5-73efb2a12539-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:08.150587 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.150469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f74299-8c73-4832-84f5-73efb2a12539-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:08.150587 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.150577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glh6j\" (UniqueName: \"kubernetes.io/projected/f8f74299-8c73-4832-84f5-73efb2a12539-kube-api-access-glh6j\") pod \"payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:08.151377 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.151351    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f74299-8c73-4832-84f5-73efb2a12539-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:08.159843 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.159807    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glh6j\" (UniqueName: \"kubernetes.io/projected/f8f74299-8c73-4832-84f5-73efb2a12539-kube-api-access-glh6j\") pod \"payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:08.276135 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.276092    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:08.361332 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.361286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:08.569391 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.569353    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"]
Sep 15 13:10:08.569881 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.569416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:08.571536 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:10:08.571500    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f74299_8c73_4832_84f5_73efb2a12539.slice/crio-d81bbb67ee5a4df7da86c27674149c7a470be3c8a33464a04b614fb8b772b88a WatchSource:0}: Error finding container d81bbb67ee5a4df7da86c27674149c7a470be3c8a33464a04b614fb8b772b88a: Status 404 returned error can't find the container with id d81bbb67ee5a4df7da86c27674149c7a470be3c8a33464a04b614fb8b772b88a
Sep 15 13:10:08.645300 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:08.645255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz" event={"ID":"f8f74299-8c73-4832-84f5-73efb2a12539","Type":"ContainerStarted","Data":"d81bbb67ee5a4df7da86c27674149c7a470be3c8a33464a04b614fb8b772b88a"}
Sep 15 13:10:09.655211 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:09.655157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz" event={"ID":"f8f74299-8c73-4832-84f5-73efb2a12539","Type":"ContainerStarted","Data":"492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965"}
Sep 15 13:10:09.655684 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:09.655317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:09.677431 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:09.677342    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz" podStartSLOduration=2.6773216 podStartE2EDuration="2.6773216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:10:09.674867999 +0000 UTC m=+1515.037599601" watchObservedRunningTime="2026-09-15 13:10:09.6773216 +0000 UTC m=+1515.040053200"
Sep 15 13:10:09.834797 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:09.834764    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:10.795691 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:10.795651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:11.609540 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:11.609503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:12.296370 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:12.296335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:12.443843 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:12.443802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:12.550076 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:12.549948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:13.130169 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:13.130122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:13.997260 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:13.997213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:14.906415 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:14.906381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:15.676218 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:15.676182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:16.433430 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:16.433395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:17.169841 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:17.169799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:17.934647 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:17.934607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:18.037284 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:18.037248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:18.807658 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:18.807616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:20.664284 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:20.664240    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:10:27.726519 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:27.726476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:28.055940 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:28.055834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:28.232257 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:28.232211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:28.330456 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:28.330356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:30.723469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:30.723436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:31.414062 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:31.414025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:31.526177 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:31.526136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:31.668782 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:31.668667    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:31.822092 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:31.822054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:35.744588 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.744536    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"]
Sep 15 13:10:35.748351 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.748327    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:35.755844 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.755809    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7e508e61-dockercfg-zj65g\""
Sep 15 13:10:35.757270 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.757242    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7e508e61\""
Sep 15 13:10:35.767987 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.767921    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"]
Sep 15 13:10:35.777658 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.777620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:35.826521 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.826469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e16cee-3259-45f4-a256-51269a332163-plugins-config-volume\") pod \"payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") " pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:35.826728 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.826544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx286\" (UniqueName: \"kubernetes.io/projected/38e16cee-3259-45f4-a256-51269a332163-kube-api-access-xx286\") pod \"payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") " pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:35.842408 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.842364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:35.927226 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.927180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e16cee-3259-45f4-a256-51269a332163-plugins-config-volume\") pod \"payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") " pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:35.927399 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.927253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx286\" (UniqueName: \"kubernetes.io/projected/38e16cee-3259-45f4-a256-51269a332163-kube-api-access-xx286\") pod \"payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") " pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:35.927945 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.927924    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e16cee-3259-45f4-a256-51269a332163-plugins-config-volume\") pod \"payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") " pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:35.936101 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:35.936071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx286\" (UniqueName: \"kubernetes.io/projected/38e16cee-3259-45f4-a256-51269a332163-kube-api-access-xx286\") pod \"payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") " pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:36.017039 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.016909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:36.061107 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.061062    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:36.344776 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.344740    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"]
Sep 15 13:10:36.346469 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:10:36.346441    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e16cee_3259_45f4_a256_51269a332163.slice/crio-7c8ee7d8a8757753c1d42a3a3cc7918967eddbf5a8e2fe50b3040a5d8fb9a420 WatchSource:0}: Error finding container 7c8ee7d8a8757753c1d42a3a3cc7918967eddbf5a8e2fe50b3040a5d8fb9a420: Status 404 returned error can't find the container with id 7c8ee7d8a8757753c1d42a3a3cc7918967eddbf5a8e2fe50b3040a5d8fb9a420
Sep 15 13:10:36.765566 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.765527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:36.853696 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.853649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2" event={"ID":"38e16cee-3259-45f4-a256-51269a332163","Type":"ContainerStarted","Data":"5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817"}
Sep 15 13:10:36.854031 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.853721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2" event={"ID":"38e16cee-3259-45f4-a256-51269a332163","Type":"ContainerStarted","Data":"7c8ee7d8a8757753c1d42a3a3cc7918967eddbf5a8e2fe50b3040a5d8fb9a420"}
Sep 15 13:10:36.854031 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.853752    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:36.874983 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:36.874911    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2" podStartSLOduration=1.874889992 podStartE2EDuration="1.874889992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:10:36.874068928 +0000 UTC m=+1542.236800528" watchObservedRunningTime="2026-09-15 13:10:36.874889992 +0000 UTC m=+1542.237621591"
Sep 15 13:10:47.862710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:47.862673    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:10:55.937168 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:55.937112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:56.670851 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:56.670816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:58.173004 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:58.172908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:59.046747 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:59.046712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:10:59.642721 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:10:59.642678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:11:00.355028 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:11:00.354990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:11:01.037769 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:11:01.037725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:11:03.076925 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:11:03.076870    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:11:10.715187 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:11:10.715147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:00.127232 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.127142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:00.233380 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.233344    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"]
Sep 15 13:12:00.236844 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.236826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.239888 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.239865    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:12:00.240954 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.240927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:12:00.241069 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.241028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:12:00.245684 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.245661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"]
Sep 15 13:12:00.365937 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.365898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgssn\" (UniqueName: \"kubernetes.io/projected/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-kube-api-access-hgssn\") pod \"maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.366137 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.366036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.467402 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.467363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.467591 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.467454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgssn\" (UniqueName: \"kubernetes.io/projected/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-kube-api-access-hgssn\") pod \"maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.468029 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.468010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.476863 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.476834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgssn\" (UniqueName: \"kubernetes.io/projected/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-kube-api-access-hgssn\") pod \"maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.518221 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.518187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:00.548542 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.548509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:00.823954 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:00.823924    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"]
Sep 15 13:12:00.824716 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:12:00.824685    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdc7f65_6b59_42b8_8b46_1549a4bccb87.slice/crio-4dd1e924f4d27018635b7faae7a4b5f2bc4ffafbe838d798278545f1627e579f WatchSource:0}: Error finding container 4dd1e924f4d27018635b7faae7a4b5f2bc4ffafbe838d798278545f1627e579f: Status 404 returned error can't find the container with id 4dd1e924f4d27018635b7faae7a4b5f2bc4ffafbe838d798278545f1627e579f
Sep 15 13:12:01.406608 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:01.406572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg" event={"ID":"fcdc7f65-6b59-42b8-8b46-1549a4bccb87","Type":"ContainerStarted","Data":"16a6e871f3cc391c88b5dc5b9dc98bc609fc4f3176a50c6da9e8984a3eb37045"}
Sep 15 13:12:01.407022 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:01.406625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg" event={"ID":"fcdc7f65-6b59-42b8-8b46-1549a4bccb87","Type":"ContainerStarted","Data":"4dd1e924f4d27018635b7faae7a4b5f2bc4ffafbe838d798278545f1627e579f"}
Sep 15 13:12:01.429164 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:01.429113    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg" podStartSLOduration=1.429096489 podStartE2EDuration="1.429096489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:12:01.426194025 +0000 UTC m=+1626.788925660" watchObservedRunningTime="2026-09-15 13:12:01.429096489 +0000 UTC m=+1626.791828088"
Sep 15 13:12:01.431252 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:01.431224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:02.155349 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:02.155314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:02.414490 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:02.414394    2562 generic.go:356] "Generic (PLEG): container finished" podID="fcdc7f65-6b59-42b8-8b46-1549a4bccb87" containerID="16a6e871f3cc391c88b5dc5b9dc98bc609fc4f3176a50c6da9e8984a3eb37045" exitCode=0
Sep 15 13:12:02.414490 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:02.414481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg" event={"ID":"fcdc7f65-6b59-42b8-8b46-1549a4bccb87","Type":"ContainerDied","Data":"16a6e871f3cc391c88b5dc5b9dc98bc609fc4f3176a50c6da9e8984a3eb37045"}
Sep 15 13:12:03.066302 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.066262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:03.561388 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.561366    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:03.698197 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.698098    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgssn\" (UniqueName: \"kubernetes.io/projected/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-kube-api-access-hgssn\") pod \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") "
Sep 15 13:12:03.698376 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.698204    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-maas-api-service-ca\") pod \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\" (UID: \"fcdc7f65-6b59-42b8-8b46-1549a4bccb87\") "
Sep 15 13:12:03.698577 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.698553    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fcdc7f65-6b59-42b8-8b46-1549a4bccb87" (UID: "fcdc7f65-6b59-42b8-8b46-1549a4bccb87"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:12:03.700118 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.700094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-kube-api-access-hgssn" (OuterVolumeSpecName: "kube-api-access-hgssn") pod "fcdc7f65-6b59-42b8-8b46-1549a4bccb87" (UID: "fcdc7f65-6b59-42b8-8b46-1549a4bccb87"). InnerVolumeSpecName "kube-api-access-hgssn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:12:03.799371 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.799330    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgssn\" (UniqueName: \"kubernetes.io/projected/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-kube-api-access-hgssn\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:03.799371 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.799362    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc7f65-6b59-42b8-8b46-1549a4bccb87-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:03.914103 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:03.914068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:04.430052 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:04.430024    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"
Sep 15 13:12:04.430226 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:04.430024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg" event={"ID":"fcdc7f65-6b59-42b8-8b46-1549a4bccb87","Type":"ContainerDied","Data":"4dd1e924f4d27018635b7faae7a4b5f2bc4ffafbe838d798278545f1627e579f"}
Sep 15 13:12:04.430226 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:04.430151    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dd1e924f4d27018635b7faae7a4b5f2bc4ffafbe838d798278545f1627e579f"
Sep 15 13:12:04.660944 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:04.660906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:05.210189 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:05.210156    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"]
Sep 15 13:12:05.273317 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:05.273283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:05.500375 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:05.500279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:20.229250 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.229192    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t" podUID="ad8273fc-a39f-499a-9c8f-8ff18aea96d3" containerName="main" containerID="cri-o://f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f" gracePeriod=45
Sep 15 13:12:20.493623 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.493557    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 13:12:20.532409 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.532375    2562 generic.go:356] "Generic (PLEG): container finished" podID="ad8273fc-a39f-499a-9c8f-8ff18aea96d3" containerID="f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f" exitCode=0
Sep 15 13:12:20.532589 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.532436    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"
Sep 15 13:12:20.532589 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.532457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t" event={"ID":"ad8273fc-a39f-499a-9c8f-8ff18aea96d3","Type":"ContainerDied","Data":"f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f"}
Sep 15 13:12:20.532589 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.532504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t" event={"ID":"ad8273fc-a39f-499a-9c8f-8ff18aea96d3","Type":"ContainerDied","Data":"86dd128ca04f86dc026a85c2a2c456cf5a574b824a50fee8e439235102714abf"}
Sep 15 13:12:20.532589 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.532524    2562 scope.go:117] "RemoveContainer" containerID="f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f"
Sep 15 13:12:20.542181 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.542122    2562 scope.go:117] "RemoveContainer" containerID="f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f"
Sep 15 13:12:20.542472 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:12:20.542452    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f\": container with ID starting with f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f not found: ID does not exist" containerID="f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f"
Sep 15 13:12:20.542532 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.542485    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f"} err="failed to get container status \"f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f\": rpc error: code = NotFound desc = could not find container \"f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f\": container with ID starting with f30d47ce8f27f81d8b799c97789e6d873f523d7de15202e17ba61c4ddf07883f not found: ID does not exist"
Sep 15 13:12:20.551868 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.551840    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4j8z\" (UniqueName: \"kubernetes.io/projected/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-kube-api-access-t4j8z\") pod \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") "
Sep 15 13:12:20.552031 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.551894    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-home\") pod \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") "
Sep 15 13:12:20.552031 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.551929    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tls-certs\") pod \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") "
Sep 15 13:12:20.552031 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.551991    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-model-cache\") pod \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") "
Sep 15 13:12:20.552031 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.552026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-dshm\") pod \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") "
Sep 15 13:12:20.552252 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.552063    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tmp-dir\") pod \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\" (UID: \"ad8273fc-a39f-499a-9c8f-8ff18aea96d3\") "
Sep 15 13:12:20.552252 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.552210    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-home" (OuterVolumeSpecName: "home") pod "ad8273fc-a39f-499a-9c8f-8ff18aea96d3" (UID: "ad8273fc-a39f-499a-9c8f-8ff18aea96d3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:12:20.552358 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.552289    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad8273fc-a39f-499a-9c8f-8ff18aea96d3" (UID: "ad8273fc-a39f-499a-9c8f-8ff18aea96d3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:12:20.552436 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.552412    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad8273fc-a39f-499a-9c8f-8ff18aea96d3" (UID: "ad8273fc-a39f-499a-9c8f-8ff18aea96d3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:12:20.552489 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.552430    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-home\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:20.552489 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.552450    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-model-cache\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:20.554186 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.554162    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-dshm" (OuterVolumeSpecName: "dshm") pod "ad8273fc-a39f-499a-9c8f-8ff18aea96d3" (UID: "ad8273fc-a39f-499a-9c8f-8ff18aea96d3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:12:20.554290 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.554199    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad8273fc-a39f-499a-9c8f-8ff18aea96d3" (UID: "ad8273fc-a39f-499a-9c8f-8ff18aea96d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:12:20.554334 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.554318    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-kube-api-access-t4j8z" (OuterVolumeSpecName: "kube-api-access-t4j8z") pod "ad8273fc-a39f-499a-9c8f-8ff18aea96d3" (UID: "ad8273fc-a39f-499a-9c8f-8ff18aea96d3"). InnerVolumeSpecName "kube-api-access-t4j8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:12:20.652915 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.652873    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-dshm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:20.652915 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.652925    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tmp-dir\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:20.653167 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.652936    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4j8z\" (UniqueName: \"kubernetes.io/projected/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-kube-api-access-t4j8z\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:20.653167 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.652948    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad8273fc-a39f-499a-9c8f-8ff18aea96d3-tls-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:12:20.856174 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.856144    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"]
Sep 15 13:12:20.860277 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:20.860250    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-6c9f0b/simulator-w0-6c9f0b-kserve-f7669fbd7-lzb2t"]
Sep 15 13:12:21.263065 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:21.263036    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad8273fc-a39f-499a-9c8f-8ff18aea96d3" path="/var/lib/kubelet/pods/ad8273fc-a39f-499a-9c8f-8ff18aea96d3/volumes"
Sep 15 13:12:42.135856 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:42.135819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:42.235548 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:42.235510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:42.672986 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:42.672935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:48.148250 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:48.148214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:53.855121 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:53.855080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:12:53.926974 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:12:53.926922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:02.113737 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:02.113699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:02.308990 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:02.308923    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:09.025423 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:09.025382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:14.956209 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:14.956171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:26.469587 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.469499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:26.573853 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.573816    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"]
Sep 15 13:13:26.574254 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.574240    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad8273fc-a39f-499a-9c8f-8ff18aea96d3" containerName="main"
Sep 15 13:13:26.574305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.574256    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad8273fc-a39f-499a-9c8f-8ff18aea96d3" containerName="main"
Sep 15 13:13:26.574305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.574269    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcdc7f65-6b59-42b8-8b46-1549a4bccb87" containerName="revoke-keys"
Sep 15 13:13:26.574305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.574275    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcdc7f65-6b59-42b8-8b46-1549a4bccb87" containerName="revoke-keys"
Sep 15 13:13:26.574407 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.574355    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad8273fc-a39f-499a-9c8f-8ff18aea96d3" containerName="main"
Sep 15 13:13:26.574407 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.574364    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcdc7f65-6b59-42b8-8b46-1549a4bccb87" containerName="revoke-keys"
Sep 15 13:13:26.577110 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.577094    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.579712 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.579687    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:13:26.580749 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.580732    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:13:26.580857 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.580733    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:13:26.585956 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.585922    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"]
Sep 15 13:13:26.665658 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.665624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.665864 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.665701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqr4b\" (UniqueName: \"kubernetes.io/projected/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-kube-api-access-nqr4b\") pod \"maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.767229 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.767113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqr4b\" (UniqueName: \"kubernetes.io/projected/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-kube-api-access-nqr4b\") pod \"maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.767229 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.767229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.767845 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.767826    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.776157 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.776132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqr4b\" (UniqueName: \"kubernetes.io/projected/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-kube-api-access-nqr4b\") pod \"maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.888896 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.888848    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:26.890298 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:26.890268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:27.166801 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:27.166775    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"]
Sep 15 13:13:27.168156 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:13:27.168129    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b470f4e_e4c0_4a73_99be_e8a6ed9abf35.slice/crio-9c587a1006dbecb0bf66f4d5abb83297f843d828b7a64725d0cd023d78dbd05b WatchSource:0}: Error finding container 9c587a1006dbecb0bf66f4d5abb83297f843d828b7a64725d0cd023d78dbd05b: Status 404 returned error can't find the container with id 9c587a1006dbecb0bf66f4d5abb83297f843d828b7a64725d0cd023d78dbd05b
Sep 15 13:13:27.695876 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:27.695833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:27.932949 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:27.932917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq" event={"ID":"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35","Type":"ContainerStarted","Data":"cbda7dc5b7ff55ac9b2f30f56e6105faedc4fa9795c8ef5f1369019a4744640f"}
Sep 15 13:13:27.933153 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:27.932990    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq" event={"ID":"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35","Type":"ContainerStarted","Data":"9c587a1006dbecb0bf66f4d5abb83297f843d828b7a64725d0cd023d78dbd05b"}
Sep 15 13:13:27.951260 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:27.951142    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq" podStartSLOduration=1.9511234979999998 podStartE2EDuration="1.951123498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:13:27.949205115 +0000 UTC m=+1713.311936714" watchObservedRunningTime="2026-09-15 13:13:27.951123498 +0000 UTC m=+1713.313855097"
Sep 15 13:13:28.486913 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:28.486875    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:28.948068 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:28.948033    2562 generic.go:356] "Generic (PLEG): container finished" podID="9b470f4e-e4c0-4a73-99be-e8a6ed9abf35" containerID="cbda7dc5b7ff55ac9b2f30f56e6105faedc4fa9795c8ef5f1369019a4744640f" exitCode=0
Sep 15 13:13:28.948480 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:28.948116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq" event={"ID":"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35","Type":"ContainerDied","Data":"cbda7dc5b7ff55ac9b2f30f56e6105faedc4fa9795c8ef5f1369019a4744640f"}
Sep 15 13:13:29.226605 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:29.226510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:30.098566 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.098539    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:30.103254 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.103231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:30.199844 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.199792    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqr4b\" (UniqueName: \"kubernetes.io/projected/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-kube-api-access-nqr4b\") pod \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") "
Sep 15 13:13:30.199844 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.199854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-maas-api-service-ca\") pod \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\" (UID: \"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35\") "
Sep 15 13:13:30.200258 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.200230    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9b470f4e-e4c0-4a73-99be-e8a6ed9abf35" (UID: "9b470f4e-e4c0-4a73-99be-e8a6ed9abf35"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:13:30.201916 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.201894    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-kube-api-access-nqr4b" (OuterVolumeSpecName: "kube-api-access-nqr4b") pod "9b470f4e-e4c0-4a73-99be-e8a6ed9abf35" (UID: "9b470f4e-e4c0-4a73-99be-e8a6ed9abf35"). InnerVolumeSpecName "kube-api-access-nqr4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:13:30.301136 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.301093    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqr4b\" (UniqueName: \"kubernetes.io/projected/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-kube-api-access-nqr4b\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:30.301136 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.301130    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:30.805518 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.805472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:30.961014 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.960985    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"
Sep 15 13:13:30.961192 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.961013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq" event={"ID":"9b470f4e-e4c0-4a73-99be-e8a6ed9abf35","Type":"ContainerDied","Data":"9c587a1006dbecb0bf66f4d5abb83297f843d828b7a64725d0cd023d78dbd05b"}
Sep 15 13:13:30.961192 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:30.961066    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c587a1006dbecb0bf66f4d5abb83297f843d828b7a64725d0cd023d78dbd05b"
Sep 15 13:13:31.452348 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:31.452314    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"]
Sep 15 13:13:31.462330 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:31.462302    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"]
Sep 15 13:13:31.477045 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:31.477005    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"]
Sep 15 13:13:31.541217 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:31.541179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:31.603166 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:31.603127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:13:46.472202 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.472137    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx" podUID="0a669531-9188-4f11-b3d9-11abcbf6c410" containerName="main" containerID="cri-o://ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e" gracePeriod=45
Sep 15 13:13:46.482422 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.482365    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th" podUID="de9bcbcb-c974-48e9-bacc-66973597e7c1" containerName="main" containerID="cri-o://f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7" gracePeriod=45
Sep 15 13:13:46.496234 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.496194    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z" podUID="dcb9d878-6594-456d-a19f-629130b07f23" containerName="main" containerID="cri-o://423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4" gracePeriod=45
Sep 15 13:13:46.814480 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.814451    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:13:46.817652 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.817630    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 13:13:46.821008 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.820990    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:13:46.955774 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.955734    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-home\") pod \"0a669531-9188-4f11-b3d9-11abcbf6c410\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") "
Sep 15 13:13:46.956007 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.955785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-dshm\") pod \"dcb9d878-6594-456d-a19f-629130b07f23\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") "
Sep 15 13:13:46.956007 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.955812    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-model-cache\") pod \"0a669531-9188-4f11-b3d9-11abcbf6c410\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") "
Sep 15 13:13:46.956007 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.955867    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-model-cache\") pod \"dcb9d878-6594-456d-a19f-629130b07f23\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") "
Sep 15 13:13:46.956007 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.955915    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-home\") pod \"de9bcbcb-c974-48e9-bacc-66973597e7c1\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") "
Sep 15 13:13:46.956007 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.955954    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-home\") pod \"dcb9d878-6594-456d-a19f-629130b07f23\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") "
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956027    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-tmp-dir\") pod \"dcb9d878-6594-456d-a19f-629130b07f23\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") "
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956056    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-tmp-dir\") pod \"0a669531-9188-4f11-b3d9-11abcbf6c410\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") "
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-home" (OuterVolumeSpecName: "home") pod "0a669531-9188-4f11-b3d9-11abcbf6c410" (UID: "0a669531-9188-4f11-b3d9-11abcbf6c410"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956094    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqrgw\" (UniqueName: \"kubernetes.io/projected/de9bcbcb-c974-48e9-bacc-66973597e7c1-kube-api-access-nqrgw\") pod \"de9bcbcb-c974-48e9-bacc-66973597e7c1\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") "
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956138    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a669531-9188-4f11-b3d9-11abcbf6c410" (UID: "0a669531-9188-4f11-b3d9-11abcbf6c410"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956179    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a669531-9188-4f11-b3d9-11abcbf6c410-tls-certs\") pod \"0a669531-9188-4f11-b3d9-11abcbf6c410\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") "
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-tmp-dir\") pod \"de9bcbcb-c974-48e9-bacc-66973597e7c1\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") "
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956211    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-model-cache" (OuterVolumeSpecName: "model-cache") pod "dcb9d878-6594-456d-a19f-629130b07f23" (UID: "dcb9d878-6594-456d-a19f-629130b07f23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956239    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-home" (OuterVolumeSpecName: "home") pod "de9bcbcb-c974-48e9-bacc-66973597e7c1" (UID: "de9bcbcb-c974-48e9-bacc-66973597e7c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxzqh\" (UniqueName: \"kubernetes.io/projected/dcb9d878-6594-456d-a19f-629130b07f23-kube-api-access-fxzqh\") pod \"dcb9d878-6594-456d-a19f-629130b07f23\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") "
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956272    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-home" (OuterVolumeSpecName: "home") pod "dcb9d878-6594-456d-a19f-629130b07f23" (UID: "dcb9d878-6594-456d-a19f-629130b07f23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.956316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956279    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-model-cache\") pod \"de9bcbcb-c974-48e9-bacc-66973597e7c1\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") "
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956352    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9bcbcb-c974-48e9-bacc-66973597e7c1-tls-certs\") pod \"de9bcbcb-c974-48e9-bacc-66973597e7c1\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") "
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb9d878-6594-456d-a19f-629130b07f23-tls-certs\") pod \"dcb9d878-6594-456d-a19f-629130b07f23\" (UID: \"dcb9d878-6594-456d-a19f-629130b07f23\") "
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956367    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dcb9d878-6594-456d-a19f-629130b07f23" (UID: "dcb9d878-6594-456d-a19f-629130b07f23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956412    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-dshm\") pod \"de9bcbcb-c974-48e9-bacc-66973597e7c1\" (UID: \"de9bcbcb-c974-48e9-bacc-66973597e7c1\") "
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956423    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a669531-9188-4f11-b3d9-11abcbf6c410" (UID: "0a669531-9188-4f11-b3d9-11abcbf6c410"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956462    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-model-cache" (OuterVolumeSpecName: "model-cache") pod "de9bcbcb-c974-48e9-bacc-66973597e7c1" (UID: "de9bcbcb-c974-48e9-bacc-66973597e7c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956644    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "de9bcbcb-c974-48e9-bacc-66973597e7c1" (UID: "de9bcbcb-c974-48e9-bacc-66973597e7c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956687    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxv8m\" (UniqueName: \"kubernetes.io/projected/0a669531-9188-4f11-b3d9-11abcbf6c410-kube-api-access-dxv8m\") pod \"0a669531-9188-4f11-b3d9-11abcbf6c410\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") "
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.956718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-dshm\") pod \"0a669531-9188-4f11-b3d9-11abcbf6c410\" (UID: \"0a669531-9188-4f11-b3d9-11abcbf6c410\") "
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957077    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-home\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957096    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-model-cache\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957110    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-model-cache\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957123    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-home\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957134    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-home\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957147    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-tmp-dir\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957159    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-tmp-dir\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957170    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-tmp-dir\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.957447 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.957182    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-model-cache\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.958710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.958651    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-dshm" (OuterVolumeSpecName: "dshm") pod "dcb9d878-6594-456d-a19f-629130b07f23" (UID: "dcb9d878-6594-456d-a19f-629130b07f23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.958710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.958670    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de9bcbcb-c974-48e9-bacc-66973597e7c1-kube-api-access-nqrgw" (OuterVolumeSpecName: "kube-api-access-nqrgw") pod "de9bcbcb-c974-48e9-bacc-66973597e7c1" (UID: "de9bcbcb-c974-48e9-bacc-66973597e7c1"). InnerVolumeSpecName "kube-api-access-nqrgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:13:46.959253 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.959232    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de9bcbcb-c974-48e9-bacc-66973597e7c1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "de9bcbcb-c974-48e9-bacc-66973597e7c1" (UID: "de9bcbcb-c974-48e9-bacc-66973597e7c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:13:46.959346 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.959252    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-dshm" (OuterVolumeSpecName: "dshm") pod "de9bcbcb-c974-48e9-bacc-66973597e7c1" (UID: "de9bcbcb-c974-48e9-bacc-66973597e7c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.959346 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.959269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb9d878-6594-456d-a19f-629130b07f23-kube-api-access-fxzqh" (OuterVolumeSpecName: "kube-api-access-fxzqh") pod "dcb9d878-6594-456d-a19f-629130b07f23" (UID: "dcb9d878-6594-456d-a19f-629130b07f23"). InnerVolumeSpecName "kube-api-access-fxzqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:13:46.959469 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.959449    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-dshm" (OuterVolumeSpecName: "dshm") pod "0a669531-9188-4f11-b3d9-11abcbf6c410" (UID: "0a669531-9188-4f11-b3d9-11abcbf6c410"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.959508 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.959449    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb9d878-6594-456d-a19f-629130b07f23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dcb9d878-6594-456d-a19f-629130b07f23" (UID: "dcb9d878-6594-456d-a19f-629130b07f23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:13:46.960319 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.960300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a669531-9188-4f11-b3d9-11abcbf6c410-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a669531-9188-4f11-b3d9-11abcbf6c410" (UID: "0a669531-9188-4f11-b3d9-11abcbf6c410"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:13:46.960461 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:46.960441    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a669531-9188-4f11-b3d9-11abcbf6c410-kube-api-access-dxv8m" (OuterVolumeSpecName: "kube-api-access-dxv8m") pod "0a669531-9188-4f11-b3d9-11abcbf6c410" (UID: "0a669531-9188-4f11-b3d9-11abcbf6c410"). InnerVolumeSpecName "kube-api-access-dxv8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:13:47.056404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.056316    2562 generic.go:356] "Generic (PLEG): container finished" podID="dcb9d878-6594-456d-a19f-629130b07f23" containerID="423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4" exitCode=0
Sep 15 13:13:47.056404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.056355    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"
Sep 15 13:13:47.056629 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.056410    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z" event={"ID":"dcb9d878-6594-456d-a19f-629130b07f23","Type":"ContainerDied","Data":"423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4"}
Sep 15 13:13:47.056629 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.056455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z" event={"ID":"dcb9d878-6594-456d-a19f-629130b07f23","Type":"ContainerDied","Data":"eb4ac66546164ee4c6b637aeee360f0f097583e59b0e8d6fc96efe6bebc0aff9"}
Sep 15 13:13:47.056629 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.056477    2562 scope.go:117] "RemoveContainer" containerID="423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4"
Sep 15 13:13:47.057703 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057677    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcb9d878-6594-456d-a19f-629130b07f23-dshm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057703 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057705    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqrgw\" (UniqueName: \"kubernetes.io/projected/de9bcbcb-c974-48e9-bacc-66973597e7c1-kube-api-access-nqrgw\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057720    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a669531-9188-4f11-b3d9-11abcbf6c410-tls-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057735    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxzqh\" (UniqueName: \"kubernetes.io/projected/dcb9d878-6594-456d-a19f-629130b07f23-kube-api-access-fxzqh\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057748    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9bcbcb-c974-48e9-bacc-66973597e7c1-tls-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057761    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb9d878-6594-456d-a19f-629130b07f23-tls-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057771    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9bcbcb-c974-48e9-bacc-66973597e7c1-dshm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057779    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxv8m\" (UniqueName: \"kubernetes.io/projected/0a669531-9188-4f11-b3d9-11abcbf6c410-kube-api-access-dxv8m\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057795    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a669531-9188-4f11-b3d9-11abcbf6c410-dshm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057830    2562 generic.go:356] "Generic (PLEG): container finished" podID="0a669531-9188-4f11-b3d9-11abcbf6c410" containerID="ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e" exitCode=0
Sep 15 13:13:47.057897 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057866    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"
Sep 15 13:13:47.058415 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx" event={"ID":"0a669531-9188-4f11-b3d9-11abcbf6c410","Type":"ContainerDied","Data":"ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e"}
Sep 15 13:13:47.058415 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.057944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx" event={"ID":"0a669531-9188-4f11-b3d9-11abcbf6c410","Type":"ContainerDied","Data":"ee78c5977535d7cabf0148c46b45774b558ce7a6f7b69a7377308e8c71cd5681"}
Sep 15 13:13:47.059592 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.059565    2562 generic.go:356] "Generic (PLEG): container finished" podID="de9bcbcb-c974-48e9-bacc-66973597e7c1" containerID="f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7" exitCode=0
Sep 15 13:13:47.059697 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.059603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"
Sep 15 13:13:47.059697 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.059653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th" event={"ID":"de9bcbcb-c974-48e9-bacc-66973597e7c1","Type":"ContainerDied","Data":"f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7"}
Sep 15 13:13:47.059697 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.059681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th" event={"ID":"de9bcbcb-c974-48e9-bacc-66973597e7c1","Type":"ContainerDied","Data":"fc222ab65b595534d1ffaa1037be60fd26980164931d8a5c8fe272a5c914be38"}
Sep 15 13:13:47.066843 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.066825    2562 scope.go:117] "RemoveContainer" containerID="423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4"
Sep 15 13:13:47.067186 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:13:47.067168    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4\": container with ID starting with 423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4 not found: ID does not exist" containerID="423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4"
Sep 15 13:13:47.067260 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.067194    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4"} err="failed to get container status \"423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4\": rpc error: code = NotFound desc = could not find container \"423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4\": container with ID starting with 423c9c1280d0e56260460820f4991e2e9751ab888eeee67636fb505bd5a99da4 not found: ID does not exist"
Sep 15 13:13:47.067260 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.067210    2562 scope.go:117] "RemoveContainer" containerID="ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e"
Sep 15 13:13:47.076392 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.076375    2562 scope.go:117] "RemoveContainer" containerID="ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e"
Sep 15 13:13:47.076683 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:13:47.076665    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e\": container with ID starting with ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e not found: ID does not exist" containerID="ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e"
Sep 15 13:13:47.076733 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.076691    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e"} err="failed to get container status \"ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e\": rpc error: code = NotFound desc = could not find container \"ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e\": container with ID starting with ace0dcf543f224022ec55d7d74d9a1049b132ced80323a694b00cb8b9dbd050e not found: ID does not exist"
Sep 15 13:13:47.076733 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.076707    2562 scope.go:117] "RemoveContainer" containerID="f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7"
Sep 15 13:13:47.082525 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.082502    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"]
Sep 15 13:13:47.088187 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.088163    2562 scope.go:117] "RemoveContainer" containerID="f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7"
Sep 15 13:13:47.088512 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:13:47.088494    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7\": container with ID starting with f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7 not found: ID does not exist" containerID="f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7"
Sep 15 13:13:47.088586 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.088523    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7"} err="failed to get container status \"f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7\": rpc error: code = NotFound desc = could not find container \"f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7\": container with ID starting with f451c401da03aa4d5d5dc2cc31a3930e86762d3f21177f9932660c4438db92f7 not found: ID does not exist"
Sep 15 13:13:47.089714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.089695    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/simulator-w4-2af9a3-kserve-5bdc8b54cc-mgd6z"]
Sep 15 13:13:47.101056 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.101030    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"]
Sep 15 13:13:47.105277 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.105252    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/premium-w4-2af9a3-kserve-6f7cbb4f64-nx2th"]
Sep 15 13:13:47.116766 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.116740    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"]
Sep 15 13:13:47.125561 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.125538    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-2-w4-2af9a3-kserve-65544cb6b8-dqwbx"]
Sep 15 13:13:47.263682 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.263650    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a669531-9188-4f11-b3d9-11abcbf6c410" path="/var/lib/kubelet/pods/0a669531-9188-4f11-b3d9-11abcbf6c410/volumes"
Sep 15 13:13:47.264049 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.264036    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcb9d878-6594-456d-a19f-629130b07f23" path="/var/lib/kubelet/pods/dcb9d878-6594-456d-a19f-629130b07f23/volumes"
Sep 15 13:13:47.264377 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:13:47.264365    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de9bcbcb-c974-48e9-bacc-66973597e7c1" path="/var/lib/kubelet/pods/de9bcbcb-c974-48e9-bacc-66973597e7c1/volumes"
Sep 15 13:14:08.000876 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:08.000778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:08.102136 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:08.102105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:08.830460 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:08.830427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:14.507147 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:14.507115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:14.607524 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:14.607486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:39.379635 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:39.379601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:39.500048 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:39.500016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:39.880242 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:39.880204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:40.145527 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:40.145434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:40.380046 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:40.380016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:42.395948 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:42.395909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:42.992199 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:42.992169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:43.098204 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:43.098171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:43.483072 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:43.483031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:44.734222 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:44.734182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:45.646877 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:45.646840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:45.816742 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:45.816711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:46.003714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:46.003680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:46.833408 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:46.833380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:46.933684 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:46.933623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:47.191544 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.191516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:47.560839 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.560748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:47.661074 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.661040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:47.701290 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701260    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"]
Sep 15 13:14:47.701665 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701653    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b470f4e-e4c0-4a73-99be-e8a6ed9abf35" containerName="revoke-keys"
Sep 15 13:14:47.701710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701668    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b470f4e-e4c0-4a73-99be-e8a6ed9abf35" containerName="revoke-keys"
Sep 15 13:14:47.701710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701681    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb9d878-6594-456d-a19f-629130b07f23" containerName="main"
Sep 15 13:14:47.701710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701687    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb9d878-6594-456d-a19f-629130b07f23" containerName="main"
Sep 15 13:14:47.701710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701694    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de9bcbcb-c974-48e9-bacc-66973597e7c1" containerName="main"
Sep 15 13:14:47.701710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701699    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de9bcbcb-c974-48e9-bacc-66973597e7c1" containerName="main"
Sep 15 13:14:47.701878 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701717    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a669531-9188-4f11-b3d9-11abcbf6c410" containerName="main"
Sep 15 13:14:47.701878 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701722    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a669531-9188-4f11-b3d9-11abcbf6c410" containerName="main"
Sep 15 13:14:47.701878 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701791    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a669531-9188-4f11-b3d9-11abcbf6c410" containerName="main"
Sep 15 13:14:47.701878 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701798    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de9bcbcb-c974-48e9-bacc-66973597e7c1" containerName="main"
Sep 15 13:14:47.701878 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701808    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b470f4e-e4c0-4a73-99be-e8a6ed9abf35" containerName="revoke-keys"
Sep 15 13:14:47.701878 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.701816    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcb9d878-6594-456d-a19f-629130b07f23" containerName="main"
Sep 15 13:14:47.704960 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.704939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:47.708296 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.708276    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-aa8ef1\""
Sep 15 13:14:47.717067 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.717044    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"]
Sep 15 13:14:47.794641 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.794595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9qw\" (UniqueName: \"kubernetes.io/projected/e059f95b-9c01-4a4e-9f15-d185aeff0425-kube-api-access-mk9qw\") pod \"payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:47.794641 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.794643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e059f95b-9c01-4a4e-9f15-d185aeff0425-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:47.828393 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.828320    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"]
Sep 15 13:14:47.831911 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.831888    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:47.834560 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.834534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-aa8ef1-dockercfg-5bc8p\""
Sep 15 13:14:47.846234 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.846204    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"]
Sep 15 13:14:47.895747 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.895702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9qw\" (UniqueName: \"kubernetes.io/projected/e059f95b-9c01-4a4e-9f15-d185aeff0425-kube-api-access-mk9qw\") pod \"payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:47.895933 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.895762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e059f95b-9c01-4a4e-9f15-d185aeff0425-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:47.895933 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.895797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364d6b31-015e-4df6-a899-5b46fd271cc4-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:47.895933 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.895829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6l7\" (UniqueName: \"kubernetes.io/projected/364d6b31-015e-4df6-a899-5b46fd271cc4-kube-api-access-6h6l7\") pod \"payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:47.896700 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.896676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e059f95b-9c01-4a4e-9f15-d185aeff0425-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:47.905701 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.905677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9qw\" (UniqueName: \"kubernetes.io/projected/e059f95b-9c01-4a4e-9f15-d185aeff0425-kube-api-access-mk9qw\") pod \"payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:47.997031 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.996993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364d6b31-015e-4df6-a899-5b46fd271cc4-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:47.997203 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.997046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6l7\" (UniqueName: \"kubernetes.io/projected/364d6b31-015e-4df6-a899-5b46fd271cc4-kube-api-access-6h6l7\") pod \"payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:47.997658 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:47.997637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364d6b31-015e-4df6-a899-5b46fd271cc4-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:48.007131 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.007100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6l7\" (UniqueName: \"kubernetes.io/projected/364d6b31-015e-4df6-a899-5b46fd271cc4-kube-api-access-6h6l7\") pod \"payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:48.015916 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.015896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:48.141797 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.141702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:48.277554 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.277516    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"]
Sep 15 13:14:48.282228 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.282212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.285662 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.285640    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:14:48.285942 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.285925    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:14:48.286704 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.286687    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:14:48.300553 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.300524    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"]
Sep 15 13:14:48.301921 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:14:48.301898    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode059f95b_9c01_4a4e_9f15_d185aeff0425.slice/crio-81ee58c99d669c5cac375bda6bdd35c905924e504bf43f0a80ed0d47113c8bc6 WatchSource:0}: Error finding container 81ee58c99d669c5cac375bda6bdd35c905924e504bf43f0a80ed0d47113c8bc6: Status 404 returned error can't find the container with id 81ee58c99d669c5cac375bda6bdd35c905924e504bf43f0a80ed0d47113c8bc6
Sep 15 13:14:48.304174 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.304153    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"]
Sep 15 13:14:48.401183 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.401109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlrfn\" (UniqueName: \"kubernetes.io/projected/6b8ab681-7a24-4fd3-8034-2641d72554bc-kube-api-access-rlrfn\") pod \"maas-api-revoke-keys-e2e-mt-7e508e61-5s968\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.401318 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.401181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b8ab681-7a24-4fd3-8034-2641d72554bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e508e61-5s968\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.408037 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.408004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567" event={"ID":"e059f95b-9c01-4a4e-9f15-d185aeff0425","Type":"ContainerStarted","Data":"1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a"}
Sep 15 13:14:48.408184 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.408065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567" event={"ID":"e059f95b-9c01-4a4e-9f15-d185aeff0425","Type":"ContainerStarted","Data":"81ee58c99d669c5cac375bda6bdd35c905924e504bf43f0a80ed0d47113c8bc6"}
Sep 15 13:14:48.408184 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.408114    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:14:48.433763 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.433730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"]
Sep 15 13:14:48.437000 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:14:48.436942    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364d6b31_015e_4df6_a899_5b46fd271cc4.slice/crio-c4513ea5e9b91227c7fb1c891822799b535ca113ca5734f0da71169d92d2594a WatchSource:0}: Error finding container c4513ea5e9b91227c7fb1c891822799b535ca113ca5734f0da71169d92d2594a: Status 404 returned error can't find the container with id c4513ea5e9b91227c7fb1c891822799b535ca113ca5734f0da71169d92d2594a
Sep 15 13:14:48.457947 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.457903    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567" podStartSLOduration=1.4578846269999999 podStartE2EDuration="1.457884627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:14:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:14:48.455995695 +0000 UTC m=+1793.818727292" watchObservedRunningTime="2026-09-15 13:14:48.457884627 +0000 UTC m=+1793.820616226"
Sep 15 13:14:48.502099 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.502069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlrfn\" (UniqueName: \"kubernetes.io/projected/6b8ab681-7a24-4fd3-8034-2641d72554bc-kube-api-access-rlrfn\") pod \"maas-api-revoke-keys-e2e-mt-7e508e61-5s968\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.502230 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.502136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b8ab681-7a24-4fd3-8034-2641d72554bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e508e61-5s968\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.502740 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.502720    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b8ab681-7a24-4fd3-8034-2641d72554bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e508e61-5s968\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.512100 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.512074    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlrfn\" (UniqueName: \"kubernetes.io/projected/6b8ab681-7a24-4fd3-8034-2641d72554bc-kube-api-access-rlrfn\") pod \"maas-api-revoke-keys-e2e-mt-7e508e61-5s968\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.593086 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.593055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:48.871284 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:14:48.871247    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8ab681_7a24_4fd3_8034_2641d72554bc.slice/crio-92f30d0302286909101f4324d11adc9adae26f3c625e828ccce15d160df8004b WatchSource:0}: Error finding container 92f30d0302286909101f4324d11adc9adae26f3c625e828ccce15d160df8004b: Status 404 returned error can't find the container with id 92f30d0302286909101f4324d11adc9adae26f3c625e828ccce15d160df8004b
Sep 15 13:14:48.872618 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:48.872595    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"]
Sep 15 13:14:49.094354 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.094316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:49.416903 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.416864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968" event={"ID":"6b8ab681-7a24-4fd3-8034-2641d72554bc","Type":"ContainerStarted","Data":"92bf640350c32066ea0ee880185fe1adc0d40def9745e52619026590468827ff"}
Sep 15 13:14:49.417120 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.416930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968" event={"ID":"6b8ab681-7a24-4fd3-8034-2641d72554bc","Type":"ContainerStarted","Data":"92f30d0302286909101f4324d11adc9adae26f3c625e828ccce15d160df8004b"}
Sep 15 13:14:49.418537 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.418509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk" event={"ID":"364d6b31-015e-4df6-a899-5b46fd271cc4","Type":"ContainerStarted","Data":"0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9"}
Sep 15 13:14:49.418683 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.418554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk" event={"ID":"364d6b31-015e-4df6-a899-5b46fd271cc4","Type":"ContainerStarted","Data":"c4513ea5e9b91227c7fb1c891822799b535ca113ca5734f0da71169d92d2594a"}
Sep 15 13:14:49.438227 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.438166    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968" podStartSLOduration=1.43814651 podStartE2EDuration="1.43814651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:14:49.434237236 +0000 UTC m=+1794.796969033" watchObservedRunningTime="2026-09-15 13:14:49.43814651 +0000 UTC m=+1794.800878112"
Sep 15 13:14:49.462900 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.462774    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk" podStartSLOduration=2.462754174 podStartE2EDuration="2.462754174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:14:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:14:49.459988831 +0000 UTC m=+1794.822720425" watchObservedRunningTime="2026-09-15 13:14:49.462754174 +0000 UTC m=+1794.825485776"
Sep 15 13:14:49.940724 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:49.940685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:50.427815 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:50.427783    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b8ab681-7a24-4fd3-8034-2641d72554bc" containerID="92bf640350c32066ea0ee880185fe1adc0d40def9745e52619026590468827ff" exitCode=0
Sep 15 13:14:50.428039 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:50.427870    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968" event={"ID":"6b8ab681-7a24-4fd3-8034-2641d72554bc","Type":"ContainerDied","Data":"92bf640350c32066ea0ee880185fe1adc0d40def9745e52619026590468827ff"}
Sep 15 13:14:50.428267 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:50.428255    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:14:51.126146 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.126104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:51.578000 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.577954    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:51.630788 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.630759    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlrfn\" (UniqueName: \"kubernetes.io/projected/6b8ab681-7a24-4fd3-8034-2641d72554bc-kube-api-access-rlrfn\") pod \"6b8ab681-7a24-4fd3-8034-2641d72554bc\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") "
Sep 15 13:14:51.631007 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.630817    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b8ab681-7a24-4fd3-8034-2641d72554bc-maas-api-service-ca\") pod \"6b8ab681-7a24-4fd3-8034-2641d72554bc\" (UID: \"6b8ab681-7a24-4fd3-8034-2641d72554bc\") "
Sep 15 13:14:51.631206 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.631180    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b8ab681-7a24-4fd3-8034-2641d72554bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6b8ab681-7a24-4fd3-8034-2641d72554bc" (UID: "6b8ab681-7a24-4fd3-8034-2641d72554bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:14:51.632942 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.632907    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b8ab681-7a24-4fd3-8034-2641d72554bc-kube-api-access-rlrfn" (OuterVolumeSpecName: "kube-api-access-rlrfn") pod "6b8ab681-7a24-4fd3-8034-2641d72554bc" (UID: "6b8ab681-7a24-4fd3-8034-2641d72554bc"). InnerVolumeSpecName "kube-api-access-rlrfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:14:51.731914 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.731825    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b8ab681-7a24-4fd3-8034-2641d72554bc-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:14:51.731914 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:51.731857    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlrfn\" (UniqueName: \"kubernetes.io/projected/6b8ab681-7a24-4fd3-8034-2641d72554bc-kube-api-access-rlrfn\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:14:52.067831 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:52.067738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:52.443619 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:52.443587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968" event={"ID":"6b8ab681-7a24-4fd3-8034-2641d72554bc","Type":"ContainerDied","Data":"92f30d0302286909101f4324d11adc9adae26f3c625e828ccce15d160df8004b"}
Sep 15 13:14:52.444167 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:52.443645    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92f30d0302286909101f4324d11adc9adae26f3c625e828ccce15d160df8004b"
Sep 15 13:14:52.444167 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:52.443603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"
Sep 15 13:14:52.869327 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:52.869235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:53.950689 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:53.950655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:55.398945 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:55.398917    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:14:55.403140 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:55.403112    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:14:58.430298 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:58.430253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:14:59.420621 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:14:59.420593    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:15:00.138000 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.137939    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"]
Sep 15 13:15:00.138628 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.138605    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b8ab681-7a24-4fd3-8034-2641d72554bc" containerName="revoke-keys"
Sep 15 13:15:00.138756 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.138631    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b8ab681-7a24-4fd3-8034-2641d72554bc" containerName="revoke-keys"
Sep 15 13:15:00.138756 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.138735    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b8ab681-7a24-4fd3-8034-2641d72554bc" containerName="revoke-keys"
Sep 15 13:15:00.142275 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.142250    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"]
Sep 15 13:15:00.142400 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.142363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"
Sep 15 13:15:00.146656 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.146627    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:15:00.146778 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.146627    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:15:00.148562 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.147112    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:15:00.152887 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.152852    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"]
Sep 15 13:15:00.153243 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.153207    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:00.160141 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.159490    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"]
Sep 15 13:15:00.160141 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.160099    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"
Sep 15 13:15:00.165879 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.165851    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"]
Sep 15 13:15:00.166165 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.166146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"
Sep 15 13:15:00.169700 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.169675    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"]
Sep 15 13:15:00.173114 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.173090    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"]
Sep 15 13:15:00.177163 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.177139    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"]
Sep 15 13:15:00.183246 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.183097    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"]
Sep 15 13:15:00.187155 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.187134    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"]
Sep 15 13:15:00.187279 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.187254    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"
Sep 15 13:15:00.190728 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.190711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"
Sep 15 13:15:00.201807 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.201411    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"]
Sep 15 13:15:00.207454 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.207425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spwhz\" (UniqueName: \"kubernetes.io/projected/df262b07-3c6a-473a-96db-efc3b2ca510c-kube-api-access-spwhz\") pod \"maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k\" (UID: \"df262b07-3c6a-473a-96db-efc3b2ca510c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:00.207603 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.207472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9kqx\" (UniqueName: \"kubernetes.io/projected/8379fe2b-ceae-4ac7-bed3-134e195f3121-kube-api-access-z9kqx\") pod \"maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz\" (UID: \"8379fe2b-ceae-4ac7-bed3-134e195f3121\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"
Sep 15 13:15:00.209480 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.209456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"]
Sep 15 13:15:00.308640 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.308599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pftsr\" (UniqueName: \"kubernetes.io/projected/8e2dbfb2-a592-4f38-9bec-00877ec77f42-kube-api-access-pftsr\") pod \"maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2\" (UID: \"8e2dbfb2-a592-4f38-9bec-00877ec77f42\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"
Sep 15 13:15:00.308834 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.308727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs779\" (UniqueName: \"kubernetes.io/projected/92f8d0c7-e371-4b37-b9cd-8843c53351ca-kube-api-access-vs779\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m\" (UID: \"92f8d0c7-e371-4b37-b9cd-8843c53351ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"
Sep 15 13:15:00.308834 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.308789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hcg\" (UniqueName: \"kubernetes.io/projected/6ef0e692-0903-4479-893f-627fd59261ff-kube-api-access-p4hcg\") pod \"maas-api-key-cleanup-29824635-tvwwt\" (UID: \"6ef0e692-0903-4479-893f-627fd59261ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"
Sep 15 13:15:00.308920 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.308860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzqbl\" (UniqueName: \"kubernetes.io/projected/47826aa3-c22d-4be0-925d-250da2786783-kube-api-access-kzqbl\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9\" (UID: \"47826aa3-c22d-4be0-925d-250da2786783\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"
Sep 15 13:15:00.308920 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.308900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spwhz\" (UniqueName: \"kubernetes.io/projected/df262b07-3c6a-473a-96db-efc3b2ca510c-kube-api-access-spwhz\") pod \"maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k\" (UID: \"df262b07-3c6a-473a-96db-efc3b2ca510c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:00.309030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.308930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9kqx\" (UniqueName: \"kubernetes.io/projected/8379fe2b-ceae-4ac7-bed3-134e195f3121-kube-api-access-z9kqx\") pod \"maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz\" (UID: \"8379fe2b-ceae-4ac7-bed3-134e195f3121\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"
Sep 15 13:15:00.318591 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.318563    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9kqx\" (UniqueName: \"kubernetes.io/projected/8379fe2b-ceae-4ac7-bed3-134e195f3121-kube-api-access-z9kqx\") pod \"maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz\" (UID: \"8379fe2b-ceae-4ac7-bed3-134e195f3121\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"
Sep 15 13:15:00.318733 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.318573    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spwhz\" (UniqueName: \"kubernetes.io/projected/df262b07-3c6a-473a-96db-efc3b2ca510c-kube-api-access-spwhz\") pod \"maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k\" (UID: \"df262b07-3c6a-473a-96db-efc3b2ca510c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:00.409475 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.409373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs779\" (UniqueName: \"kubernetes.io/projected/92f8d0c7-e371-4b37-b9cd-8843c53351ca-kube-api-access-vs779\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m\" (UID: \"92f8d0c7-e371-4b37-b9cd-8843c53351ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"
Sep 15 13:15:00.409475 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.409431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hcg\" (UniqueName: \"kubernetes.io/projected/6ef0e692-0903-4479-893f-627fd59261ff-kube-api-access-p4hcg\") pod \"maas-api-key-cleanup-29824635-tvwwt\" (UID: \"6ef0e692-0903-4479-893f-627fd59261ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"
Sep 15 13:15:00.409721 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.409477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzqbl\" (UniqueName: \"kubernetes.io/projected/47826aa3-c22d-4be0-925d-250da2786783-kube-api-access-kzqbl\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9\" (UID: \"47826aa3-c22d-4be0-925d-250da2786783\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"
Sep 15 13:15:00.409721 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.409520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pftsr\" (UniqueName: \"kubernetes.io/projected/8e2dbfb2-a592-4f38-9bec-00877ec77f42-kube-api-access-pftsr\") pod \"maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2\" (UID: \"8e2dbfb2-a592-4f38-9bec-00877ec77f42\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"
Sep 15 13:15:00.418375 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.418350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzqbl\" (UniqueName: \"kubernetes.io/projected/47826aa3-c22d-4be0-925d-250da2786783-kube-api-access-kzqbl\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9\" (UID: \"47826aa3-c22d-4be0-925d-250da2786783\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"
Sep 15 13:15:00.418567 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.418544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hcg\" (UniqueName: \"kubernetes.io/projected/6ef0e692-0903-4479-893f-627fd59261ff-kube-api-access-p4hcg\") pod \"maas-api-key-cleanup-29824635-tvwwt\" (UID: \"6ef0e692-0903-4479-893f-627fd59261ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"
Sep 15 13:15:00.418671 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.418653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pftsr\" (UniqueName: \"kubernetes.io/projected/8e2dbfb2-a592-4f38-9bec-00877ec77f42-kube-api-access-pftsr\") pod \"maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2\" (UID: \"8e2dbfb2-a592-4f38-9bec-00877ec77f42\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"
Sep 15 13:15:00.418826 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.418804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs779\" (UniqueName: \"kubernetes.io/projected/92f8d0c7-e371-4b37-b9cd-8843c53351ca-kube-api-access-vs779\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m\" (UID: \"92f8d0c7-e371-4b37-b9cd-8843c53351ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"
Sep 15 13:15:00.469262 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.469226    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"
Sep 15 13:15:00.477519 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.477494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:00.487047 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.487025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"
Sep 15 13:15:00.496986 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.496841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"
Sep 15 13:15:00.511060 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.510847    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"
Sep 15 13:15:00.520231 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.520135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"
Sep 15 13:15:00.767417 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.767389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"]
Sep 15 13:15:00.768343 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:00.768316    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8379fe2b_ceae_4ac7_bed3_134e195f3121.slice/crio-a3d2ac09962573f8eba4d0463ed7e576c00c6732380072a7c2af7d66aed6cf7e WatchSource:0}: Error finding container a3d2ac09962573f8eba4d0463ed7e576c00c6732380072a7c2af7d66aed6cf7e: Status 404 returned error can't find the container with id a3d2ac09962573f8eba4d0463ed7e576c00c6732380072a7c2af7d66aed6cf7e
Sep 15 13:15:00.790600 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:00.790530    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf262b07_3c6a_473a_96db_efc3b2ca510c.slice/crio-4e1e181748f19adedf36af9940aa1c4ba7e30d4fda41c9b6701f2d7910bfe602 WatchSource:0}: Error finding container 4e1e181748f19adedf36af9940aa1c4ba7e30d4fda41c9b6701f2d7910bfe602: Status 404 returned error can't find the container with id 4e1e181748f19adedf36af9940aa1c4ba7e30d4fda41c9b6701f2d7910bfe602
Sep 15 13:15:00.792528 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.792502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"]
Sep 15 13:15:00.824684 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.824661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"]
Sep 15 13:15:00.826148 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:00.826122    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef0e692_0903_4479_893f_627fd59261ff.slice/crio-76a5e726ea0ebad595f4623096fc89d631366ec61413731b84ff1a6eb02a3faf WatchSource:0}: Error finding container 76a5e726ea0ebad595f4623096fc89d631366ec61413731b84ff1a6eb02a3faf: Status 404 returned error can't find the container with id 76a5e726ea0ebad595f4623096fc89d631366ec61413731b84ff1a6eb02a3faf
Sep 15 13:15:00.838507 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.838476    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"]
Sep 15 13:15:00.842489 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.842455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"]
Sep 15 13:15:00.842839 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:00.842808    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f8d0c7_e371_4b37_b9cd_8843c53351ca.slice/crio-1867f11d9292d46bbfe1d06106a762838167ae029493a572a31775726bbf3ebd WatchSource:0}: Error finding container 1867f11d9292d46bbfe1d06106a762838167ae029493a572a31775726bbf3ebd: Status 404 returned error can't find the container with id 1867f11d9292d46bbfe1d06106a762838167ae029493a572a31775726bbf3ebd
Sep 15 13:15:00.843919 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:00.843898    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2dbfb2_a592_4f38_9bec_00877ec77f42.slice/crio-1471c7e7cbafb795cc6e0b5ea024c38bbf82b40b378a88f41731592f6ac8bfee WatchSource:0}: Error finding container 1471c7e7cbafb795cc6e0b5ea024c38bbf82b40b378a88f41731592f6ac8bfee: Status 404 returned error can't find the container with id 1471c7e7cbafb795cc6e0b5ea024c38bbf82b40b378a88f41731592f6ac8bfee
Sep 15 13:15:00.871088 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:00.871050    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"]
Sep 15 13:15:00.877202 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:00.877174    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47826aa3_c22d_4be0_925d_250da2786783.slice/crio-f391e692ecddb97c9b0dc770d71b60506e024e5c8f5598fcfaa5e1ed399afaf9 WatchSource:0}: Error finding container f391e692ecddb97c9b0dc770d71b60506e024e5c8f5598fcfaa5e1ed399afaf9: Status 404 returned error can't find the container with id f391e692ecddb97c9b0dc770d71b60506e024e5c8f5598fcfaa5e1ed399afaf9
Sep 15 13:15:01.438128 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.438086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:15:01.503289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.502400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m" event={"ID":"92f8d0c7-e371-4b37-b9cd-8843c53351ca","Type":"ContainerStarted","Data":"b7b5734978c63b17a203d172e9bc6ee0c9f52ea12e9cea667f73fef39c22cd5c"}
Sep 15 13:15:01.503289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.502476    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m" event={"ID":"92f8d0c7-e371-4b37-b9cd-8843c53351ca","Type":"ContainerStarted","Data":"1867f11d9292d46bbfe1d06106a762838167ae029493a572a31775726bbf3ebd"}
Sep 15 13:15:01.506292 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.506256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt" event={"ID":"6ef0e692-0903-4479-893f-627fd59261ff","Type":"ContainerStarted","Data":"8a9161f454720073ab340c746beae3c1764934dce5d8f44b163af183e38c73dc"}
Sep 15 13:15:01.506448 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.506316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt" event={"ID":"6ef0e692-0903-4479-893f-627fd59261ff","Type":"ContainerStarted","Data":"76a5e726ea0ebad595f4623096fc89d631366ec61413731b84ff1a6eb02a3faf"}
Sep 15 13:15:01.508113 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.508076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9" event={"ID":"47826aa3-c22d-4be0-925d-250da2786783","Type":"ContainerStarted","Data":"0e2c259345526e00c4df98836ae88b68f28a74b13b2f65f831e70a4201048f4f"}
Sep 15 13:15:01.508257 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.508126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9" event={"ID":"47826aa3-c22d-4be0-925d-250da2786783","Type":"ContainerStarted","Data":"f391e692ecddb97c9b0dc770d71b60506e024e5c8f5598fcfaa5e1ed399afaf9"}
Sep 15 13:15:01.509838 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.509814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz" event={"ID":"8379fe2b-ceae-4ac7-bed3-134e195f3121","Type":"ContainerStarted","Data":"85b78639bc42013b3ddeaf730d58e4306fe338cec383254043b5d7d7c75028fc"}
Sep 15 13:15:01.509932 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.509854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz" event={"ID":"8379fe2b-ceae-4ac7-bed3-134e195f3121","Type":"ContainerStarted","Data":"a3d2ac09962573f8eba4d0463ed7e576c00c6732380072a7c2af7d66aed6cf7e"}
Sep 15 13:15:01.511498 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.511478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2" event={"ID":"8e2dbfb2-a592-4f38-9bec-00877ec77f42","Type":"ContainerStarted","Data":"2c303d776ca4a0cd2ccc2d81f3f2579a6a4fe519a3065259648d819b649ea17c"}
Sep 15 13:15:01.511612 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.511518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2" event={"ID":"8e2dbfb2-a592-4f38-9bec-00877ec77f42","Type":"ContainerStarted","Data":"1471c7e7cbafb795cc6e0b5ea024c38bbf82b40b378a88f41731592f6ac8bfee"}
Sep 15 13:15:01.513126 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.513105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k" event={"ID":"df262b07-3c6a-473a-96db-efc3b2ca510c","Type":"ContainerStarted","Data":"c25106717a375952cd4dc2f798832fcc59c58c20129f578570521e1343f01b66"}
Sep 15 13:15:01.513243 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.513147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k" event={"ID":"df262b07-3c6a-473a-96db-efc3b2ca510c","Type":"ContainerStarted","Data":"4e1e181748f19adedf36af9940aa1c4ba7e30d4fda41c9b6701f2d7910bfe602"}
Sep 15 13:15:01.521602 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.521561    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m" podStartSLOduration=1.521547719 podStartE2EDuration="1.521547719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:01.521277655 +0000 UTC m=+1806.884009255" watchObservedRunningTime="2026-09-15 13:15:01.521547719 +0000 UTC m=+1806.884279358"
Sep 15 13:15:01.541456 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.541404    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2" podStartSLOduration=1.541390366 podStartE2EDuration="1.541390366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:01.539870144 +0000 UTC m=+1806.902601742" watchObservedRunningTime="2026-09-15 13:15:01.541390366 +0000 UTC m=+1806.904121965"
Sep 15 13:15:01.556201 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.556093    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9" podStartSLOduration=1.55607792 podStartE2EDuration="1.55607792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:01.555692082 +0000 UTC m=+1806.918423681" watchObservedRunningTime="2026-09-15 13:15:01.55607792 +0000 UTC m=+1806.918809518"
Sep 15 13:15:01.572785 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.572729    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k" podStartSLOduration=1.5727159560000001 podStartE2EDuration="1.572715956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:01.572038915 +0000 UTC m=+1806.934770516" watchObservedRunningTime="2026-09-15 13:15:01.572715956 +0000 UTC m=+1806.935447554"
Sep 15 13:15:01.591155 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.591105    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt" podStartSLOduration=1.5910917530000002 podStartE2EDuration="1.591091753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:01.588164707 +0000 UTC m=+1806.950896306" watchObservedRunningTime="2026-09-15 13:15:01.591091753 +0000 UTC m=+1806.953823349"
Sep 15 13:15:01.605901 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:01.605852    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz" podStartSLOduration=1.605835184 podStartE2EDuration="1.605835184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:01.604894092 +0000 UTC m=+1806.967625691" watchObservedRunningTime="2026-09-15 13:15:01.605835184 +0000 UTC m=+1806.968566823"
Sep 15 13:15:02.522100 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.522004    2562 generic.go:356] "Generic (PLEG): container finished" podID="8379fe2b-ceae-4ac7-bed3-134e195f3121" containerID="85b78639bc42013b3ddeaf730d58e4306fe338cec383254043b5d7d7c75028fc" exitCode=0
Sep 15 13:15:02.522466 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.522097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz" event={"ID":"8379fe2b-ceae-4ac7-bed3-134e195f3121","Type":"ContainerDied","Data":"85b78639bc42013b3ddeaf730d58e4306fe338cec383254043b5d7d7c75028fc"}
Sep 15 13:15:02.523750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.523722    2562 generic.go:356] "Generic (PLEG): container finished" podID="8e2dbfb2-a592-4f38-9bec-00877ec77f42" containerID="2c303d776ca4a0cd2ccc2d81f3f2579a6a4fe519a3065259648d819b649ea17c" exitCode=0
Sep 15 13:15:02.523866 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.523801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2" event={"ID":"8e2dbfb2-a592-4f38-9bec-00877ec77f42","Type":"ContainerDied","Data":"2c303d776ca4a0cd2ccc2d81f3f2579a6a4fe519a3065259648d819b649ea17c"}
Sep 15 13:15:02.525256 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.525234    2562 generic.go:356] "Generic (PLEG): container finished" podID="df262b07-3c6a-473a-96db-efc3b2ca510c" containerID="c25106717a375952cd4dc2f798832fcc59c58c20129f578570521e1343f01b66" exitCode=0
Sep 15 13:15:02.525339 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.525317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k" event={"ID":"df262b07-3c6a-473a-96db-efc3b2ca510c","Type":"ContainerDied","Data":"c25106717a375952cd4dc2f798832fcc59c58c20129f578570521e1343f01b66"}
Sep 15 13:15:02.526988 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.526942    2562 generic.go:356] "Generic (PLEG): container finished" podID="92f8d0c7-e371-4b37-b9cd-8843c53351ca" containerID="b7b5734978c63b17a203d172e9bc6ee0c9f52ea12e9cea667f73fef39c22cd5c" exitCode=0
Sep 15 13:15:02.527097 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.526992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m" event={"ID":"92f8d0c7-e371-4b37-b9cd-8843c53351ca","Type":"ContainerDied","Data":"b7b5734978c63b17a203d172e9bc6ee0c9f52ea12e9cea667f73fef39c22cd5c"}
Sep 15 13:15:02.528617 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.528599    2562 generic.go:356] "Generic (PLEG): container finished" podID="6ef0e692-0903-4479-893f-627fd59261ff" containerID="8a9161f454720073ab340c746beae3c1764934dce5d8f44b163af183e38c73dc" exitCode=0
Sep 15 13:15:02.528700 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.528623    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt" event={"ID":"6ef0e692-0903-4479-893f-627fd59261ff","Type":"ContainerDied","Data":"8a9161f454720073ab340c746beae3c1764934dce5d8f44b163af183e38c73dc"}
Sep 15 13:15:02.530167 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.530149    2562 generic.go:356] "Generic (PLEG): container finished" podID="47826aa3-c22d-4be0-925d-250da2786783" containerID="0e2c259345526e00c4df98836ae88b68f28a74b13b2f65f831e70a4201048f4f" exitCode=0
Sep 15 13:15:02.530240 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:02.530173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9" event={"ID":"47826aa3-c22d-4be0-925d-250da2786783","Type":"ContainerDied","Data":"0e2c259345526e00c4df98836ae88b68f28a74b13b2f65f831e70a4201048f4f"}
Sep 15 13:15:03.724690 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.724615    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"
Sep 15 13:15:03.787892 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.787865    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"
Sep 15 13:15:03.791127 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.791091    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"
Sep 15 13:15:03.795305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.795282    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"
Sep 15 13:15:03.800202 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.800175    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:03.827380 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.827297    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"
Sep 15 13:15:03.840631 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.840568    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9kqx\" (UniqueName: \"kubernetes.io/projected/8379fe2b-ceae-4ac7-bed3-134e195f3121-kube-api-access-z9kqx\") pod \"8379fe2b-ceae-4ac7-bed3-134e195f3121\" (UID: \"8379fe2b-ceae-4ac7-bed3-134e195f3121\") "
Sep 15 13:15:03.843790 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.843759    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8379fe2b-ceae-4ac7-bed3-134e195f3121-kube-api-access-z9kqx" (OuterVolumeSpecName: "kube-api-access-z9kqx") pod "8379fe2b-ceae-4ac7-bed3-134e195f3121" (UID: "8379fe2b-ceae-4ac7-bed3-134e195f3121"). InnerVolumeSpecName "kube-api-access-z9kqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:03.933400 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.933370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:03.941371 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.941348    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4hcg\" (UniqueName: \"kubernetes.io/projected/6ef0e692-0903-4479-893f-627fd59261ff-kube-api-access-p4hcg\") pod \"6ef0e692-0903-4479-893f-627fd59261ff\" (UID: \"6ef0e692-0903-4479-893f-627fd59261ff\") "
Sep 15 13:15:03.941512 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.941420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs779\" (UniqueName: \"kubernetes.io/projected/92f8d0c7-e371-4b37-b9cd-8843c53351ca-kube-api-access-vs779\") pod \"92f8d0c7-e371-4b37-b9cd-8843c53351ca\" (UID: \"92f8d0c7-e371-4b37-b9cd-8843c53351ca\") "
Sep 15 13:15:03.941512 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.941469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spwhz\" (UniqueName: \"kubernetes.io/projected/df262b07-3c6a-473a-96db-efc3b2ca510c-kube-api-access-spwhz\") pod \"df262b07-3c6a-473a-96db-efc3b2ca510c\" (UID: \"df262b07-3c6a-473a-96db-efc3b2ca510c\") "
Sep 15 13:15:03.941624 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.941520    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pftsr\" (UniqueName: \"kubernetes.io/projected/8e2dbfb2-a592-4f38-9bec-00877ec77f42-kube-api-access-pftsr\") pod \"8e2dbfb2-a592-4f38-9bec-00877ec77f42\" (UID: \"8e2dbfb2-a592-4f38-9bec-00877ec77f42\") "
Sep 15 13:15:03.941624 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.941579    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzqbl\" (UniqueName: \"kubernetes.io/projected/47826aa3-c22d-4be0-925d-250da2786783-kube-api-access-kzqbl\") pod \"47826aa3-c22d-4be0-925d-250da2786783\" (UID: \"47826aa3-c22d-4be0-925d-250da2786783\") "
Sep 15 13:15:03.941896 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.941872    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9kqx\" (UniqueName: \"kubernetes.io/projected/8379fe2b-ceae-4ac7-bed3-134e195f3121-kube-api-access-z9kqx\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:03.943696 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.943658    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f8d0c7-e371-4b37-b9cd-8843c53351ca-kube-api-access-vs779" (OuterVolumeSpecName: "kube-api-access-vs779") pod "92f8d0c7-e371-4b37-b9cd-8843c53351ca" (UID: "92f8d0c7-e371-4b37-b9cd-8843c53351ca"). InnerVolumeSpecName "kube-api-access-vs779". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:03.943779 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.943691    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2dbfb2-a592-4f38-9bec-00877ec77f42-kube-api-access-pftsr" (OuterVolumeSpecName: "kube-api-access-pftsr") pod "8e2dbfb2-a592-4f38-9bec-00877ec77f42" (UID: "8e2dbfb2-a592-4f38-9bec-00877ec77f42"). InnerVolumeSpecName "kube-api-access-pftsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:03.943779 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.943722    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef0e692-0903-4479-893f-627fd59261ff-kube-api-access-p4hcg" (OuterVolumeSpecName: "kube-api-access-p4hcg") pod "6ef0e692-0903-4479-893f-627fd59261ff" (UID: "6ef0e692-0903-4479-893f-627fd59261ff"). InnerVolumeSpecName "kube-api-access-p4hcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:03.943995 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.943951    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df262b07-3c6a-473a-96db-efc3b2ca510c-kube-api-access-spwhz" (OuterVolumeSpecName: "kube-api-access-spwhz") pod "df262b07-3c6a-473a-96db-efc3b2ca510c" (UID: "df262b07-3c6a-473a-96db-efc3b2ca510c"). InnerVolumeSpecName "kube-api-access-spwhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:03.943995 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:03.943951    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47826aa3-c22d-4be0-925d-250da2786783-kube-api-access-kzqbl" (OuterVolumeSpecName: "kube-api-access-kzqbl") pod "47826aa3-c22d-4be0-925d-250da2786783" (UID: "47826aa3-c22d-4be0-925d-250da2786783"). InnerVolumeSpecName "kube-api-access-kzqbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:04.043245 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.043139    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4hcg\" (UniqueName: \"kubernetes.io/projected/6ef0e692-0903-4479-893f-627fd59261ff-kube-api-access-p4hcg\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.043245 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.043175    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs779\" (UniqueName: \"kubernetes.io/projected/92f8d0c7-e371-4b37-b9cd-8843c53351ca-kube-api-access-vs779\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.043245 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.043189    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spwhz\" (UniqueName: \"kubernetes.io/projected/df262b07-3c6a-473a-96db-efc3b2ca510c-kube-api-access-spwhz\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.043245 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.043200    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pftsr\" (UniqueName: \"kubernetes.io/projected/8e2dbfb2-a592-4f38-9bec-00877ec77f42-kube-api-access-pftsr\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.043245 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.043213    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzqbl\" (UniqueName: \"kubernetes.io/projected/47826aa3-c22d-4be0-925d-250da2786783-kube-api-access-kzqbl\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.068557 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.068513    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"]
Sep 15 13:15:04.075462 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.075421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:04.079396 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.079370    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"]
Sep 15 13:15:04.099861 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.099818    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"]
Sep 15 13:15:04.100085 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.100036    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2" podUID="38e16cee-3259-45f4-a256-51269a332163" containerName="payload-processing" containerID="cri-o://5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817" gracePeriod=30
Sep 15 13:15:04.143620 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.143586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:04.243517 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.243479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:04.279121 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.279079    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"]
Sep 15 13:15:04.282289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.282259    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e508e61-5s968"]
Sep 15 13:15:04.327863 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.327840    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:15:04.343775 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.343747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:04.445837 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.445804    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx286\" (UniqueName: \"kubernetes.io/projected/38e16cee-3259-45f4-a256-51269a332163-kube-api-access-xx286\") pod \"38e16cee-3259-45f4-a256-51269a332163\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") "
Sep 15 13:15:04.446030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.445908    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e16cee-3259-45f4-a256-51269a332163-plugins-config-volume\") pod \"38e16cee-3259-45f4-a256-51269a332163\" (UID: \"38e16cee-3259-45f4-a256-51269a332163\") "
Sep 15 13:15:04.446331 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.446306    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38e16cee-3259-45f4-a256-51269a332163-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "38e16cee-3259-45f4-a256-51269a332163" (UID: "38e16cee-3259-45f4-a256-51269a332163"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:15:04.448069 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.448043    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e16cee-3259-45f4-a256-51269a332163-kube-api-access-xx286" (OuterVolumeSpecName: "kube-api-access-xx286") pod "38e16cee-3259-45f4-a256-51269a332163" (UID: "38e16cee-3259-45f4-a256-51269a332163"). InnerVolumeSpecName "kube-api-access-xx286". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:04.545434 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.545400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2" event={"ID":"8e2dbfb2-a592-4f38-9bec-00877ec77f42","Type":"ContainerDied","Data":"1471c7e7cbafb795cc6e0b5ea024c38bbf82b40b378a88f41731592f6ac8bfee"}
Sep 15 13:15:04.545434 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.545425    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2"
Sep 15 13:15:04.545692 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.545456    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1471c7e7cbafb795cc6e0b5ea024c38bbf82b40b378a88f41731592f6ac8bfee"
Sep 15 13:15:04.546717 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.546693    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx286\" (UniqueName: \"kubernetes.io/projected/38e16cee-3259-45f4-a256-51269a332163-kube-api-access-xx286\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.546840 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.546721    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e16cee-3259-45f4-a256-51269a332163-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.546920 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.546904    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:04.547008 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.546943    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e1e181748f19adedf36af9940aa1c4ba7e30d4fda41c9b6701f2d7910bfe602"
Sep 15 13:15:04.548452 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.548428    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m"
Sep 15 13:15:04.548577 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.548433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m" event={"ID":"92f8d0c7-e371-4b37-b9cd-8843c53351ca","Type":"ContainerDied","Data":"1867f11d9292d46bbfe1d06106a762838167ae029493a572a31775726bbf3ebd"}
Sep 15 13:15:04.548577 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.548552    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1867f11d9292d46bbfe1d06106a762838167ae029493a572a31775726bbf3ebd"
Sep 15 13:15:04.549922 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.549897    2562 generic.go:356] "Generic (PLEG): container finished" podID="38e16cee-3259-45f4-a256-51269a332163" containerID="5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817" exitCode=0
Sep 15 13:15:04.550074 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.549933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"
Sep 15 13:15:04.550074 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.550001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2" event={"ID":"38e16cee-3259-45f4-a256-51269a332163","Type":"ContainerDied","Data":"5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817"}
Sep 15 13:15:04.550074 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.550050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2" event={"ID":"38e16cee-3259-45f4-a256-51269a332163","Type":"ContainerDied","Data":"7c8ee7d8a8757753c1d42a3a3cc7918967eddbf5a8e2fe50b3040a5d8fb9a420"}
Sep 15 13:15:04.550246 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.550082    2562 scope.go:117] "RemoveContainer" containerID="5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817"
Sep 15 13:15:04.551657 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.551616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt" event={"ID":"6ef0e692-0903-4479-893f-627fd59261ff","Type":"ContainerDied","Data":"76a5e726ea0ebad595f4623096fc89d631366ec61413731b84ff1a6eb02a3faf"}
Sep 15 13:15:04.551657 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.551636    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824635-tvwwt"
Sep 15 13:15:04.551780 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.551657    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76a5e726ea0ebad595f4623096fc89d631366ec61413731b84ff1a6eb02a3faf"
Sep 15 13:15:04.555522 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.553506    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"
Sep 15 13:15:04.555522 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.553503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9" event={"ID":"47826aa3-c22d-4be0-925d-250da2786783","Type":"ContainerDied","Data":"f391e692ecddb97c9b0dc770d71b60506e024e5c8f5598fcfaa5e1ed399afaf9"}
Sep 15 13:15:04.555522 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.553953    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f391e692ecddb97c9b0dc770d71b60506e024e5c8f5598fcfaa5e1ed399afaf9"
Sep 15 13:15:04.557124 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.556142    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz" event={"ID":"8379fe2b-ceae-4ac7-bed3-134e195f3121","Type":"ContainerDied","Data":"a3d2ac09962573f8eba4d0463ed7e576c00c6732380072a7c2af7d66aed6cf7e"}
Sep 15 13:15:04.557124 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.556181    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3d2ac09962573f8eba4d0463ed7e576c00c6732380072a7c2af7d66aed6cf7e"
Sep 15 13:15:04.557124 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.556240    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz"
Sep 15 13:15:04.564534 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.564516    2562 scope.go:117] "RemoveContainer" containerID="5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817"
Sep 15 13:15:04.564896 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:15:04.564871    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817\": container with ID starting with 5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817 not found: ID does not exist" containerID="5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817"
Sep 15 13:15:04.565029 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.564904    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817"} err="failed to get container status \"5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817\": rpc error: code = NotFound desc = could not find container \"5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817\": container with ID starting with 5106389d7bf9adb2c2aaa796b2f06c6d1f9b11d0702d0cae543b9db48a782817 not found: ID does not exist"
Sep 15 13:15:04.593551 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.593520    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"]
Sep 15 13:15:04.600003 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.599960    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7e508e61-6c68f75fdf-95hz2"]
Sep 15 13:15:04.620618 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:15:04.620577    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="df262b07-3c6a-473a-96db-efc3b2ca510c" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:04.677293 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.677261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:04.759871 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:04.759837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:05.262127 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:15:05.262089    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="df262b07-3c6a-473a-96db-efc3b2ca510c" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7e508e61-29824635-6tz5k"
Sep 15 13:15:05.263794 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:05.263771    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38e16cee-3259-45f4-a256-51269a332163" path="/var/lib/kubelet/pods/38e16cee-3259-45f4-a256-51269a332163/volumes"
Sep 15 13:15:05.264169 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:05.264155    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b8ab681-7a24-4fd3-8034-2641d72554bc" path="/var/lib/kubelet/pods/6b8ab681-7a24-4fd3-8034-2641d72554bc/volumes"
Sep 15 13:15:05.264446 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:05.264434    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df262b07-3c6a-473a-96db-efc3b2ca510c" path="/var/lib/kubelet/pods/df262b07-3c6a-473a-96db-efc3b2ca510c/volumes"
Sep 15 13:15:05.634375 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:05.634282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:06.508203 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:06.508165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:07.254322 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:07.254289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:07.913466 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:07.913432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:08.123676 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:08.123642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:09.231482 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:09.231449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:09.343557 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:09.343522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:09.477735 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:09.477702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:09.672278 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:09.672247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:09.896073 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:09.896044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:10.772189 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:10.772151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:11.227537 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:11.227498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:11.322659 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:11.322628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:11.781330 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:11.781298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:12.662141 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:12.662104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:13.482654 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:13.482621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:14.183718 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:14.183685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:14.288666 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:14.288632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:14.887374 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:14.887340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:14.987560 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:14.987525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:15.007571 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.007534    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"]
Sep 15 13:15:15.007980 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.007956    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8379fe2b-ceae-4ac7-bed3-134e195f3121" containerName="cleanup"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.007982    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8379fe2b-ceae-4ac7-bed3-134e195f3121" containerName="cleanup"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.007994    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47826aa3-c22d-4be0-925d-250da2786783" containerName="cleanup"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.007999    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="47826aa3-c22d-4be0-925d-250da2786783" containerName="cleanup"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008008    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e16cee-3259-45f4-a256-51269a332163" containerName="payload-processing"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008015    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e16cee-3259-45f4-a256-51269a332163" containerName="payload-processing"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008023    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef0e692-0903-4479-893f-627fd59261ff" containerName="cleanup"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008029    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef0e692-0903-4479-893f-627fd59261ff" containerName="cleanup"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008038    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df262b07-3c6a-473a-96db-efc3b2ca510c" containerName="cleanup"
Sep 15 13:15:15.008041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008044    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df262b07-3c6a-473a-96db-efc3b2ca510c" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008060    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f8d0c7-e371-4b37-b9cd-8843c53351ca" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008065    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f8d0c7-e371-4b37-b9cd-8843c53351ca" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008073    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2dbfb2-a592-4f38-9bec-00877ec77f42" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008079    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2dbfb2-a592-4f38-9bec-00877ec77f42" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008141    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="38e16cee-3259-45f4-a256-51269a332163" containerName="payload-processing"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008147    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8379fe2b-ceae-4ac7-bed3-134e195f3121" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008156    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef0e692-0903-4479-893f-627fd59261ff" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008161    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f8d0c7-e371-4b37-b9cd-8843c53351ca" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008166    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="df262b07-3c6a-473a-96db-efc3b2ca510c" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008172    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="47826aa3-c22d-4be0-925d-250da2786783" containerName="cleanup"
Sep 15 13:15:15.008312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.008178    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2dbfb2-a592-4f38-9bec-00877ec77f42" containerName="cleanup"
Sep 15 13:15:15.012232 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.012217    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.015157 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.015127    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-38d90f\""
Sep 15 13:15:15.015157 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.015129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-38d90f-dockercfg-rgdmp\""
Sep 15 13:15:15.022240 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.022215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"]
Sep 15 13:15:15.050778 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.050743    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"]
Sep 15 13:15:15.054538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.054514    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.065089 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.065060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:15.065705 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.065683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"]
Sep 15 13:15:15.140930 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.140830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsb7f\" (UniqueName: \"kubernetes.io/projected/71aae9d2-a259-43bc-bd72-287b62b8fd7a-kube-api-access-lsb7f\") pod \"payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.140930 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.140884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14e24461-c9be-4e01-a13c-c108407dfc88-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.141170 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.140952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5p4\" (UniqueName: \"kubernetes.io/projected/14e24461-c9be-4e01-a13c-c108407dfc88-kube-api-access-ft5p4\") pod \"payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.141170 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.141069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71aae9d2-a259-43bc-bd72-287b62b8fd7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.241826 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.241777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsb7f\" (UniqueName: \"kubernetes.io/projected/71aae9d2-a259-43bc-bd72-287b62b8fd7a-kube-api-access-lsb7f\") pod \"payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.241826 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.241832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14e24461-c9be-4e01-a13c-c108407dfc88-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.242141 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.241853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5p4\" (UniqueName: \"kubernetes.io/projected/14e24461-c9be-4e01-a13c-c108407dfc88-kube-api-access-ft5p4\") pod \"payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.242141 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.241891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71aae9d2-a259-43bc-bd72-287b62b8fd7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.242605 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.242581    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71aae9d2-a259-43bc-bd72-287b62b8fd7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.242701 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.242640    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14e24461-c9be-4e01-a13c-c108407dfc88-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.250272 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.250240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsb7f\" (UniqueName: \"kubernetes.io/projected/71aae9d2-a259-43bc-bd72-287b62b8fd7a-kube-api-access-lsb7f\") pod \"payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.250377 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.250304    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5p4\" (UniqueName: \"kubernetes.io/projected/14e24461-c9be-4e01-a13c-c108407dfc88-kube-api-access-ft5p4\") pod \"payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.323770 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.323724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:15.367085 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.367048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:15.398164 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.398054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:15.603957 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.603934    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"]
Sep 15 13:15:15.604617 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:15.604589    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e24461_c9be_4e01_a13c_c108407dfc88.slice/crio-aef9e71d94072aca5618859e0296cc5fe479ec2c77521087d4217528641e5e96 WatchSource:0}: Error finding container aef9e71d94072aca5618859e0296cc5fe479ec2c77521087d4217528641e5e96: Status 404 returned error can't find the container with id aef9e71d94072aca5618859e0296cc5fe479ec2c77521087d4217528641e5e96
Sep 15 13:15:15.639695 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.639663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54" event={"ID":"14e24461-c9be-4e01-a13c-c108407dfc88","Type":"ContainerStarted","Data":"aef9e71d94072aca5618859e0296cc5fe479ec2c77521087d4217528641e5e96"}
Sep 15 13:15:15.653152 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:15.653128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"]
Sep 15 13:15:15.658064 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:15:15.658032    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71aae9d2_a259_43bc_bd72_287b62b8fd7a.slice/crio-ed4c86dddaf27cc2216a46ce42a3385e9e6b045840a299536fcce32db4229582 WatchSource:0}: Error finding container ed4c86dddaf27cc2216a46ce42a3385e9e6b045840a299536fcce32db4229582: Status 404 returned error can't find the container with id ed4c86dddaf27cc2216a46ce42a3385e9e6b045840a299536fcce32db4229582
Sep 15 13:15:16.117502 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.117465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:16.651012 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.650954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4" event={"ID":"71aae9d2-a259-43bc-bd72-287b62b8fd7a","Type":"ContainerStarted","Data":"35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f"}
Sep 15 13:15:16.651224 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.651036    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:16.651224 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.651061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4" event={"ID":"71aae9d2-a259-43bc-bd72-287b62b8fd7a","Type":"ContainerStarted","Data":"ed4c86dddaf27cc2216a46ce42a3385e9e6b045840a299536fcce32db4229582"}
Sep 15 13:15:16.652735 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.652710    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54" event={"ID":"14e24461-c9be-4e01-a13c-c108407dfc88","Type":"ContainerStarted","Data":"ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7"}
Sep 15 13:15:16.652858 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.652791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:16.673241 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.673120    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4" podStartSLOduration=1.673101435 podStartE2EDuration="1.673101435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:16.672153665 +0000 UTC m=+1822.034885265" watchObservedRunningTime="2026-09-15 13:15:16.673101435 +0000 UTC m=+1822.035833037"
Sep 15 13:15:16.691103 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.691054    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54" podStartSLOduration=2.691038273 podStartE2EDuration="2.691038273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:16.689187956 +0000 UTC m=+1822.051919571" watchObservedRunningTime="2026-09-15 13:15:16.691038273 +0000 UTC m=+1822.053769872"
Sep 15 13:15:16.838127 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:16.838094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:27.661937 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:27.661901    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:15:27.662307 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:27.661998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:15:29.190097 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:29.190062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:30.567801 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:30.567771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:35.300411 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:35.300374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:36.961856 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:36.961822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:37.360746 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:37.360656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:38.031313 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:38.031281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:38.623622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:38.623591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:39.054747 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:39.054715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:40.136335 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:40.136286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:40.837300 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:40.837248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:41.323471 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:41.323434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:41.726746 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:41.726713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:42.626891 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:42.626864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:43.403211 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:43.403176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:46.609992 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:46.609936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:46.960887 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:46.960846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:51.070383 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:51.070335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:53.463930 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:53.463894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:53.567778 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:53.567729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:15:56.722997 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:15:56.722935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:16:20.988466 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:20.988393    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"]
Sep 15 13:16:20.992150 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:20.992128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:20.994977 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:20.994944    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-38d90f\"/\"kube-root-ca.crt\""
Sep 15 13:16:20.996072 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:20.996052    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-38d90f\"/\"openshift-service-ca.crt\""
Sep 15 13:16:20.996174 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:20.996118    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-38d90f\"/\"default-dockercfg-5qmgl\""
Sep 15 13:16:20.996251 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:20.996174    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-38d90f\"/\"auth-test-model-38d90f-kserve-self-signed-certs\""
Sep 15 13:16:21.001473 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.001446    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"]
Sep 15 13:16:21.006212 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.006181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:16:21.025423 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.025387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-dshm\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.025423 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.025427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-model-cache\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.025649 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.025450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-tmp-dir\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.025649 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.025525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abfc350c-7622-4b50-9c48-271d99de2d78-tls-certs\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.025649 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.025586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-home\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.025649 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.025630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlvck\" (UniqueName: \"kubernetes.io/projected/abfc350c-7622-4b50-9c48-271d99de2d78-kube-api-access-vlvck\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.126715 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.126677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-dshm\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.126715 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.126719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-model-cache\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.127030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.126739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-tmp-dir\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.127030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.126758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abfc350c-7622-4b50-9c48-271d99de2d78-tls-certs\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.127030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.126786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-home\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.127030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.126812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlvck\" (UniqueName: \"kubernetes.io/projected/abfc350c-7622-4b50-9c48-271d99de2d78-kube-api-access-vlvck\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.127261 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.127207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-model-cache\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.127261 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.127242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-tmp-dir\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.127335 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.127292    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-home\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.129104 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.129082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-dshm\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.129291 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.129273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abfc350c-7622-4b50-9c48-271d99de2d78-tls-certs\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.136731 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.136705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlvck\" (UniqueName: \"kubernetes.io/projected/abfc350c-7622-4b50-9c48-271d99de2d78-kube-api-access-vlvck\") pod \"auth-test-model-38d90f-kserve-76cf5465ff-5pz2r\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") " pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.303363 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.303269    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:21.580714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:21.580682    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"]
Sep 15 13:16:21.581713 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:16:21.581681    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabfc350c_7622_4b50_9c48_271d99de2d78.slice/crio-b608ef5eeb947fd1ef4599711561570648ec80b3c4b14636dc3876fd9b698fbc WatchSource:0}: Error finding container b608ef5eeb947fd1ef4599711561570648ec80b3c4b14636dc3876fd9b698fbc: Status 404 returned error can't find the container with id b608ef5eeb947fd1ef4599711561570648ec80b3c4b14636dc3876fd9b698fbc
Sep 15 13:16:22.063366 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:22.063329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r" event={"ID":"abfc350c-7622-4b50-9c48-271d99de2d78","Type":"ContainerStarted","Data":"6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d"}
Sep 15 13:16:22.063366 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:22.063373    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r" event={"ID":"abfc350c-7622-4b50-9c48-271d99de2d78","Type":"ContainerStarted","Data":"b608ef5eeb947fd1ef4599711561570648ec80b3c4b14636dc3876fd9b698fbc"}
Sep 15 13:16:22.082396 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:22.082347    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r" podStartSLOduration=2.082330781 podStartE2EDuration="2.082330781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:16:22.080215653 +0000 UTC m=+1887.442947256" watchObservedRunningTime="2026-09-15 13:16:22.082330781 +0000 UTC m=+1887.445062423"
Sep 15 13:16:31.303484 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:31.303446    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:31.303877 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:31.303505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:31.316672 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:31.316648    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:32.139041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:32.139008    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:16:56.437873 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:56.437840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:16:56.892455 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:16:56.892370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:17:00.838236 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:17:00.838195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:17:01.073301 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:17:01.073268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:17:03.076231 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:17:03.076188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:17:04.022955 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:17:04.022921    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"]
Sep 15 13:17:04.025795 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:17:04.025770    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6c9f0b-76qsg"]
Sep 15 13:17:05.262925 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:17:05.262889    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcdc7f65-6b59-42b8-8b46-1549a4bccb87" path="/var/lib/kubelet/pods/fcdc7f65-6b59-42b8-8b46-1549a4bccb87/volumes"
Sep 15 13:17:06.130821 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:17:06.130788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:18:27.159586 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:27.159536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:18:27.378990 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:27.378936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:18:30.023188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:30.023154    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"]
Sep 15 13:18:30.027728 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:30.027703    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2af9a3-hrvnq"]
Sep 15 13:18:31.263174 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:31.263140    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b470f4e-e4c0-4a73-99be-e8a6ed9abf35" path="/var/lib/kubelet/pods/9b470f4e-e4c0-4a73-99be-e8a6ed9abf35/volumes"
Sep 15 13:18:52.210407 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:52.210371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:18:52.311270 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:52.311240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:18:55.600396 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:55.600362    2562 scope.go:117] "RemoveContainer" containerID="16a6e871f3cc391c88b5dc5b9dc98bc609fc4f3176a50c6da9e8984a3eb37045"
Sep 15 13:18:58.350731 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:58.350700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:18:58.450579 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:58.450545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:18:58.550458 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:18:58.550424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:19:54.807842 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:19:54.807745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:19:55.441809 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:19:55.441777    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:19:55.447732 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:19:55.447707    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:19:55.623225 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:19:55.623190    2562 scope.go:117] "RemoveContainer" containerID="cbda7dc5b7ff55ac9b2f30f56e6105faedc4fa9795c8ef5f1369019a4744640f"
Sep 15 13:20:06.890206 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:06.890168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:09.683215 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:09.683184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:09.967344 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:09.967250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:10.837488 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:10.837453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:11.530716 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:11.530672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:12.231610 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:12.231574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:13.119195 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:13.119163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:13.840265 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:13.840233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:30.201075 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:30.201024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:36.026578 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:36.026536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:20:55.649546 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:55.649513    2562 scope.go:117] "RemoveContainer" containerID="92bf640350c32066ea0ee880185fe1adc0d40def9745e52619026590468827ff"
Sep 15 13:20:57.581683 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:20:57.581654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:02.259344 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:02.259307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:08.145560 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:08.145524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:08.204623 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:08.204589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:08.728858 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:08.728819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:08.821817 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:08.821776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:13.827346 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:13.827308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:19.260573 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:19.260537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:19.485908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:19.485863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:23.904427 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:23.904392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:23.967669 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:23.967402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:40.426492 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:40.426454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:46.374378 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:46.374343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:46.481478 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:46.481450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:46.757975 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:46.757943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:47.037293 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:47.037211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:47.362668 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:47.362574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:50.363695 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:50.363660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:50.535664 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:50.535593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:50.631538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:50.631442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:52.027370 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:52.027339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:52.127048 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:52.127015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:52.885135 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:52.885096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:53.614760 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:53.614726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:53.674946 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:53.674910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:53.775098 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:53.775069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:54.178896 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:54.178858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:54.257764 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:54.257729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:21:55.673175 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:21:55.673141    2562 scope.go:117] "RemoveContainer" containerID="c25106717a375952cd4dc2f798832fcc59c58c20129f578570521e1343f01b66"
Sep 15 13:22:00.923360 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:00.923325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:01.400184 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:01.400088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:02.172538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:02.172502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:03.028438 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:03.028399    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:04.007381 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:04.007350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:04.929171 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:04.929138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:05.330949 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:05.330858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:05.708352 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:05.708320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:05.823857 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:05.823828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:05.999118 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:05.999027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:06.207831 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:06.207799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:06.632164 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:06.632122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:06.916355 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:06.916260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:07.413042 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:07.413006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:08.370520 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:08.370485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:08.745689 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:08.745654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:08.836132 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:08.836099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:09.353018 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:09.352962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:10.113961 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:10.113917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:11.012730 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.012695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:11.111312 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.111278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:11.635908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.635871    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"]
Sep 15 13:22:11.639653 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.639634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.642517 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.642496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-92f861\""
Sep 15 13:22:11.642657 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.642497    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-92f861-dockercfg-lrts4\""
Sep 15 13:22:11.648849 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.648821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"]
Sep 15 13:22:11.670992 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.670930    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"]
Sep 15 13:22:11.674796 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.674776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:11.684473 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.684447    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"]
Sep 15 13:22:11.713104 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.713064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/447dc810-b1fa-4927-934d-a046cea2bd9e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.713283 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.713120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csgz2\" (UniqueName: \"kubernetes.io/projected/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-kube-api-access-csgz2\") pod \"payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:11.713283 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.713151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9zm\" (UniqueName: \"kubernetes.io/projected/447dc810-b1fa-4927-934d-a046cea2bd9e-kube-api-access-kk9zm\") pod \"payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.713283 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.713176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:11.814294 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.814257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/447dc810-b1fa-4927-934d-a046cea2bd9e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.814483 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.814314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csgz2\" (UniqueName: \"kubernetes.io/projected/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-kube-api-access-csgz2\") pod \"payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:11.814483 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.814342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9zm\" (UniqueName: \"kubernetes.io/projected/447dc810-b1fa-4927-934d-a046cea2bd9e-kube-api-access-kk9zm\") pod \"payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.814483 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.814368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:11.815068 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.815040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/447dc810-b1fa-4927-934d-a046cea2bd9e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.815188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.815111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:11.822476 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.822453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csgz2\" (UniqueName: \"kubernetes.io/projected/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-kube-api-access-csgz2\") pod \"payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:11.822476 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.822468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9zm\" (UniqueName: \"kubernetes.io/projected/447dc810-b1fa-4927-934d-a046cea2bd9e-kube-api-access-kk9zm\") pod \"payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.951578 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.951542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:11.985907 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:11.985876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:12.228422 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:12.228392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"]
Sep 15 13:22:12.230276 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:22:12.230247    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447dc810_b1fa_4927_934d_a046cea2bd9e.slice/crio-ea9ef01f9d2114d14192d73bdb322874f3a2aaec89d64a3a449534b4df27d530 WatchSource:0}: Error finding container ea9ef01f9d2114d14192d73bdb322874f3a2aaec89d64a3a449534b4df27d530: Status 404 returned error can't find the container with id ea9ef01f9d2114d14192d73bdb322874f3a2aaec89d64a3a449534b4df27d530
Sep 15 13:22:12.276008 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:12.273587    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"]
Sep 15 13:22:12.276008 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:12.274339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd" event={"ID":"447dc810-b1fa-4927-934d-a046cea2bd9e","Type":"ContainerStarted","Data":"ea9ef01f9d2114d14192d73bdb322874f3a2aaec89d64a3a449534b4df27d530"}
Sep 15 13:22:12.277487 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:22:12.277446    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b24ea4_542b_4b16_abc7_cf48b3ef5fb9.slice/crio-664e6440e6ec98cdb954a10ada809a46a03d89c17e037ab4e7018d48aaba57be WatchSource:0}: Error finding container 664e6440e6ec98cdb954a10ada809a46a03d89c17e037ab4e7018d48aaba57be: Status 404 returned error can't find the container with id 664e6440e6ec98cdb954a10ada809a46a03d89c17e037ab4e7018d48aaba57be
Sep 15 13:22:13.282590 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:13.282557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd" event={"ID":"447dc810-b1fa-4927-934d-a046cea2bd9e","Type":"ContainerStarted","Data":"e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333"}
Sep 15 13:22:13.283056 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:13.282636    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:13.284182 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:13.284155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46" event={"ID":"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9","Type":"ContainerStarted","Data":"d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d"}
Sep 15 13:22:13.284322 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:13.284205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46" event={"ID":"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9","Type":"ContainerStarted","Data":"664e6440e6ec98cdb954a10ada809a46a03d89c17e037ab4e7018d48aaba57be"}
Sep 15 13:22:13.284322 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:13.284268    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:13.304852 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:13.304799    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd" podStartSLOduration=2.304782447 podStartE2EDuration="2.304782447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:22:13.300998184 +0000 UTC m=+2238.663729816" watchObservedRunningTime="2026-09-15 13:22:13.304782447 +0000 UTC m=+2238.667514045"
Sep 15 13:22:13.321985 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:13.321915    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46" podStartSLOduration=2.321894705 podStartE2EDuration="2.321894705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:22:13.321602129 +0000 UTC m=+2238.684333728" watchObservedRunningTime="2026-09-15 13:22:13.321894705 +0000 UTC m=+2238.684626306"
Sep 15 13:22:14.169208 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:14.169176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:14.272706 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:14.272649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:17.994895 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:17.994774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:24.292008 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:24.291952    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:22:24.292436 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:24.292201    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:22:31.899030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:31.898987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:33.269090 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:33.269056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:33.632801 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:33.632715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:34.196124 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:34.196064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:34.930177 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:34.930136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:35.660315 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:35.660281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:36.564049 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.564018    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"]
Sep 15 13:22:36.567431 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.567413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:36.570242 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.570212    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:22:36.571803 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.571780    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:22:36.571933 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.571810    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:22:36.576351 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.576300    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"]
Sep 15 13:22:36.619512 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.619474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:36.643820 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.643789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlbxl\" (UniqueName: \"kubernetes.io/projected/bafecbb8-df93-43ea-9f50-decedf743ed3-kube-api-access-mlbxl\") pod \"maas-api-revoke-keys-e2e-api-a-650c57-kqs97\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:36.643947 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.643855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafecbb8-df93-43ea-9f50-decedf743ed3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-650c57-kqs97\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:36.744425 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.744387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlbxl\" (UniqueName: \"kubernetes.io/projected/bafecbb8-df93-43ea-9f50-decedf743ed3-kube-api-access-mlbxl\") pod \"maas-api-revoke-keys-e2e-api-a-650c57-kqs97\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:36.744640 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.744446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafecbb8-df93-43ea-9f50-decedf743ed3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-650c57-kqs97\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:36.745102 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.745083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafecbb8-df93-43ea-9f50-decedf743ed3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-650c57-kqs97\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:36.754418 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.754396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlbxl\" (UniqueName: \"kubernetes.io/projected/bafecbb8-df93-43ea-9f50-decedf743ed3-kube-api-access-mlbxl\") pod \"maas-api-revoke-keys-e2e-api-a-650c57-kqs97\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:36.880616 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:36.880536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:37.158947 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:37.158918    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"]
Sep 15 13:22:37.160934 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:22:37.160907    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafecbb8_df93_43ea_9f50_decedf743ed3.slice/crio-bb7ce73a0e756d4f1e91ac1c58fee0116131bdf51243e256dd861657244e29ef WatchSource:0}: Error finding container bb7ce73a0e756d4f1e91ac1c58fee0116131bdf51243e256dd861657244e29ef: Status 404 returned error can't find the container with id bb7ce73a0e756d4f1e91ac1c58fee0116131bdf51243e256dd861657244e29ef
Sep 15 13:22:37.445744 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:37.445713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97" event={"ID":"bafecbb8-df93-43ea-9f50-decedf743ed3","Type":"ContainerStarted","Data":"bb7ce73a0e756d4f1e91ac1c58fee0116131bdf51243e256dd861657244e29ef"}
Sep 15 13:22:37.497346 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:37.497312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:38.294037 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:38.293921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:38.454617 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:38.454581    2562 generic.go:356] "Generic (PLEG): container finished" podID="bafecbb8-df93-43ea-9f50-decedf743ed3" containerID="ade03eef5040e6e52f490f0f91cf5544dfa42a9428b8792f244825214cfba0ff" exitCode=0
Sep 15 13:22:38.454782 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:38.454657    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97" event={"ID":"bafecbb8-df93-43ea-9f50-decedf743ed3","Type":"ContainerDied","Data":"ade03eef5040e6e52f490f0f91cf5544dfa42a9428b8792f244825214cfba0ff"}
Sep 15 13:22:39.001983 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.001937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:39.593153 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.593116    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:39.673706 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.673668    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafecbb8-df93-43ea-9f50-decedf743ed3-maas-api-service-ca\") pod \"bafecbb8-df93-43ea-9f50-decedf743ed3\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") "
Sep 15 13:22:39.673706 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.673713    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlbxl\" (UniqueName: \"kubernetes.io/projected/bafecbb8-df93-43ea-9f50-decedf743ed3-kube-api-access-mlbxl\") pod \"bafecbb8-df93-43ea-9f50-decedf743ed3\" (UID: \"bafecbb8-df93-43ea-9f50-decedf743ed3\") "
Sep 15 13:22:39.674166 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.674133    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bafecbb8-df93-43ea-9f50-decedf743ed3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bafecbb8-df93-43ea-9f50-decedf743ed3" (UID: "bafecbb8-df93-43ea-9f50-decedf743ed3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:22:39.675773 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.675751    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bafecbb8-df93-43ea-9f50-decedf743ed3-kube-api-access-mlbxl" (OuterVolumeSpecName: "kube-api-access-mlbxl") pod "bafecbb8-df93-43ea-9f50-decedf743ed3" (UID: "bafecbb8-df93-43ea-9f50-decedf743ed3"). InnerVolumeSpecName "kube-api-access-mlbxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:22:39.775524 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.775441    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafecbb8-df93-43ea-9f50-decedf743ed3-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:22:39.775524 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.775471    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlbxl\" (UniqueName: \"kubernetes.io/projected/bafecbb8-df93-43ea-9f50-decedf743ed3-kube-api-access-mlbxl\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:22:39.980184 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:39.980147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:40.468695 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:40.468659    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"
Sep 15 13:22:40.468881 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:40.468689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97" event={"ID":"bafecbb8-df93-43ea-9f50-decedf743ed3","Type":"ContainerDied","Data":"bb7ce73a0e756d4f1e91ac1c58fee0116131bdf51243e256dd861657244e29ef"}
Sep 15 13:22:40.468881 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:40.468748    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb7ce73a0e756d4f1e91ac1c58fee0116131bdf51243e256dd861657244e29ef"
Sep 15 13:22:40.758568 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:40.758484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:41.608477 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:41.608442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:42.401474 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:42.401442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:46.697441 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:46.697406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:52.375114 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:52.375073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:52.476215 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:52.476180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:52.620003 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:52.619941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:52.698917 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:52.698887    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"]
Sep 15 13:22:52.700594 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:52.700564    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:52.702172 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:52.702150    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-650c57-kqs97"]
Sep 15 13:22:53.051538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:53.051446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:53.151421 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:53.151390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:53.262232 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:53.262191    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bafecbb8-df93-43ea-9f50-decedf743ed3" path="/var/lib/kubelet/pods/bafecbb8-df93-43ea-9f50-decedf743ed3/volumes"
Sep 15 13:22:53.854571 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:53.854539    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:54.718067 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:54.718028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:55.410941 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:55.410909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:56.227280 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:56.227245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:57.022753 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:57.022710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:58.930871 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:58.930834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:58.998629 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:58.998596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:59.184097 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.184012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:59.574058 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.573980    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"]
Sep 15 13:22:59.574424 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.574411    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bafecbb8-df93-43ea-9f50-decedf743ed3" containerName="revoke-keys"
Sep 15 13:22:59.574498 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.574425    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bafecbb8-df93-43ea-9f50-decedf743ed3" containerName="revoke-keys"
Sep 15 13:22:59.574498 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.574494    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bafecbb8-df93-43ea-9f50-decedf743ed3" containerName="revoke-keys"
Sep 15 13:22:59.579052 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.579036    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:22:59.581930 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.581910    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:22:59.582890 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.582873    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:22:59.582943 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.582907    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:22:59.590519 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.590492    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"]
Sep 15 13:22:59.659710 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.659677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzns\" (UniqueName: \"kubernetes.io/projected/3fd82aa8-414a-414d-8385-d1dd27fc843a-kube-api-access-drzns\") pod \"maas-api-revoke-keys-e2e-api-b-92f861-rbrmg\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:22:59.659894 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.659728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd82aa8-414a-414d-8385-d1dd27fc843a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92f861-rbrmg\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:22:59.672844 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.672810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:22:59.761061 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.761026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd82aa8-414a-414d-8385-d1dd27fc843a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92f861-rbrmg\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:22:59.761233 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.761132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzns\" (UniqueName: \"kubernetes.io/projected/3fd82aa8-414a-414d-8385-d1dd27fc843a-kube-api-access-drzns\") pod \"maas-api-revoke-keys-e2e-api-b-92f861-rbrmg\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:22:59.761658 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.761636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd82aa8-414a-414d-8385-d1dd27fc843a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92f861-rbrmg\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:22:59.771893 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.771859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzns\" (UniqueName: \"kubernetes.io/projected/3fd82aa8-414a-414d-8385-d1dd27fc843a-kube-api-access-drzns\") pod \"maas-api-revoke-keys-e2e-api-b-92f861-rbrmg\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:22:59.891665 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:22:59.891563    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:23:00.169874 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:00.169834    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"]
Sep 15 13:23:00.170852 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:23:00.170814    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd82aa8_414a_414d_8385_d1dd27fc843a.slice/crio-13104d1625cd1ea8cfb439a7e8af8218486658c5bf3a93ec0ae9115dac9588ce WatchSource:0}: Error finding container 13104d1625cd1ea8cfb439a7e8af8218486658c5bf3a93ec0ae9115dac9588ce: Status 404 returned error can't find the container with id 13104d1625cd1ea8cfb439a7e8af8218486658c5bf3a93ec0ae9115dac9588ce
Sep 15 13:23:00.600283 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:00.600248    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg" event={"ID":"3fd82aa8-414a-414d-8385-d1dd27fc843a","Type":"ContainerStarted","Data":"9ceebc2c8103dc0ea45387fb0a3b85f2010d60129bc6fb7245dcccdc158bc3b8"}
Sep 15 13:23:00.600488 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:00.600303    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg" event={"ID":"3fd82aa8-414a-414d-8385-d1dd27fc843a","Type":"ContainerStarted","Data":"13104d1625cd1ea8cfb439a7e8af8218486658c5bf3a93ec0ae9115dac9588ce"}
Sep 15 13:23:00.618488 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:00.618295    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg" podStartSLOduration=1.618270999 podStartE2EDuration="1.618270999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:23:00.617738204 +0000 UTC m=+2285.980469802" watchObservedRunningTime="2026-09-15 13:23:00.618270999 +0000 UTC m=+2285.981002597"
Sep 15 13:23:00.673699 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:00.673666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:01.420314 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:01.420225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:01.608204 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:01.608171    2562 generic.go:356] "Generic (PLEG): container finished" podID="3fd82aa8-414a-414d-8385-d1dd27fc843a" containerID="9ceebc2c8103dc0ea45387fb0a3b85f2010d60129bc6fb7245dcccdc158bc3b8" exitCode=0
Sep 15 13:23:01.608353 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:01.608261    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg" event={"ID":"3fd82aa8-414a-414d-8385-d1dd27fc843a","Type":"ContainerDied","Data":"9ceebc2c8103dc0ea45387fb0a3b85f2010d60129bc6fb7245dcccdc158bc3b8"}
Sep 15 13:23:02.278861 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.278817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:02.756200 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.756172    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:23:02.789994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.789936    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drzns\" (UniqueName: \"kubernetes.io/projected/3fd82aa8-414a-414d-8385-d1dd27fc843a-kube-api-access-drzns\") pod \"3fd82aa8-414a-414d-8385-d1dd27fc843a\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") "
Sep 15 13:23:02.790197 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.790083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd82aa8-414a-414d-8385-d1dd27fc843a-maas-api-service-ca\") pod \"3fd82aa8-414a-414d-8385-d1dd27fc843a\" (UID: \"3fd82aa8-414a-414d-8385-d1dd27fc843a\") "
Sep 15 13:23:02.790474 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.790447    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fd82aa8-414a-414d-8385-d1dd27fc843a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3fd82aa8-414a-414d-8385-d1dd27fc843a" (UID: "3fd82aa8-414a-414d-8385-d1dd27fc843a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:02.792057 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.792033    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fd82aa8-414a-414d-8385-d1dd27fc843a-kube-api-access-drzns" (OuterVolumeSpecName: "kube-api-access-drzns") pod "3fd82aa8-414a-414d-8385-d1dd27fc843a" (UID: "3fd82aa8-414a-414d-8385-d1dd27fc843a"). InnerVolumeSpecName "kube-api-access-drzns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:02.891429 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.891347    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd82aa8-414a-414d-8385-d1dd27fc843a-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:02.891429 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:02.891377    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drzns\" (UniqueName: \"kubernetes.io/projected/3fd82aa8-414a-414d-8385-d1dd27fc843a-kube-api-access-drzns\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:03.161556 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:03.161445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:03.622380 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:03.622351    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"
Sep 15 13:23:03.622556 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:03.622392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg" event={"ID":"3fd82aa8-414a-414d-8385-d1dd27fc843a","Type":"ContainerDied","Data":"13104d1625cd1ea8cfb439a7e8af8218486658c5bf3a93ec0ae9115dac9588ce"}
Sep 15 13:23:03.622556 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:03.622445    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13104d1625cd1ea8cfb439a7e8af8218486658c5bf3a93ec0ae9115dac9588ce"
Sep 15 13:23:03.906810 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:03.906711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:04.725439 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:04.725405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:15.147282 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.147245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:15.177423 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.177386    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"]
Sep 15 13:23:15.177693 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.177642    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd" podUID="447dc810-b1fa-4927-934d-a046cea2bd9e" containerName="payload-processing" containerID="cri-o://e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333" gracePeriod=30
Sep 15 13:23:15.183957 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.183925    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"]
Sep 15 13:23:15.184305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.184276    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46" podUID="32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" containerName="payload-pre-processing" containerID="cri-o://d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d" gracePeriod=30
Sep 15 13:23:15.337603 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.337565    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"]
Sep 15 13:23:15.340417 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.340387    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92f861-rbrmg"]
Sep 15 13:23:15.454880 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.454855    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:23:15.481587 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.481556    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:23:15.505904 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.505876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/447dc810-b1fa-4927-934d-a046cea2bd9e-plugins-config-volume\") pod \"447dc810-b1fa-4927-934d-a046cea2bd9e\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") "
Sep 15 13:23:15.506124 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.506001    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk9zm\" (UniqueName: \"kubernetes.io/projected/447dc810-b1fa-4927-934d-a046cea2bd9e-kube-api-access-kk9zm\") pod \"447dc810-b1fa-4927-934d-a046cea2bd9e\" (UID: \"447dc810-b1fa-4927-934d-a046cea2bd9e\") "
Sep 15 13:23:15.506271 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.506247    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447dc810-b1fa-4927-934d-a046cea2bd9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "447dc810-b1fa-4927-934d-a046cea2bd9e" (UID: "447dc810-b1fa-4927-934d-a046cea2bd9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:15.508123 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.508097    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447dc810-b1fa-4927-934d-a046cea2bd9e-kube-api-access-kk9zm" (OuterVolumeSpecName: "kube-api-access-kk9zm") pod "447dc810-b1fa-4927-934d-a046cea2bd9e" (UID: "447dc810-b1fa-4927-934d-a046cea2bd9e"). InnerVolumeSpecName "kube-api-access-kk9zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:15.607334 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.607285    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-plugins-config-volume\") pod \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") "
Sep 15 13:23:15.607535 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.607401    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csgz2\" (UniqueName: \"kubernetes.io/projected/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-kube-api-access-csgz2\") pod \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\" (UID: \"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9\") "
Sep 15 13:23:15.607617 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.607569    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/447dc810-b1fa-4927-934d-a046cea2bd9e-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:15.607617 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.607600    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk9zm\" (UniqueName: \"kubernetes.io/projected/447dc810-b1fa-4927-934d-a046cea2bd9e-kube-api-access-kk9zm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:15.607727 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.607671    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" (UID: "32b24ea4-542b-4b16-abc7-cf48b3ef5fb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:15.609445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.609419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-kube-api-access-csgz2" (OuterVolumeSpecName: "kube-api-access-csgz2") pod "32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" (UID: "32b24ea4-542b-4b16-abc7-cf48b3ef5fb9"). InnerVolumeSpecName "kube-api-access-csgz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:15.700828 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.700745    2562 generic.go:356] "Generic (PLEG): container finished" podID="32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" containerID="d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d" exitCode=0
Sep 15 13:23:15.700828 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.700789    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"
Sep 15 13:23:15.701105 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.700830    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46" event={"ID":"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9","Type":"ContainerDied","Data":"d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d"}
Sep 15 13:23:15.701105 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.700885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46" event={"ID":"32b24ea4-542b-4b16-abc7-cf48b3ef5fb9","Type":"ContainerDied","Data":"664e6440e6ec98cdb954a10ada809a46a03d89c17e037ab4e7018d48aaba57be"}
Sep 15 13:23:15.701105 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.700912    2562 scope.go:117] "RemoveContainer" containerID="d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d"
Sep 15 13:23:15.702426 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.702399    2562 generic.go:356] "Generic (PLEG): container finished" podID="447dc810-b1fa-4927-934d-a046cea2bd9e" containerID="e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333" exitCode=0
Sep 15 13:23:15.702528 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.702448    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"
Sep 15 13:23:15.702528 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.702447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd" event={"ID":"447dc810-b1fa-4927-934d-a046cea2bd9e","Type":"ContainerDied","Data":"e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333"}
Sep 15 13:23:15.702618 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.702541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd" event={"ID":"447dc810-b1fa-4927-934d-a046cea2bd9e","Type":"ContainerDied","Data":"ea9ef01f9d2114d14192d73bdb322874f3a2aaec89d64a3a449534b4df27d530"}
Sep 15 13:23:15.708020 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.707995    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:15.708020 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.708020    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csgz2\" (UniqueName: \"kubernetes.io/projected/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9-kube-api-access-csgz2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:15.712309 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.712290    2562 scope.go:117] "RemoveContainer" containerID="d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d"
Sep 15 13:23:15.712622 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:23:15.712603    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d\": container with ID starting with d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d not found: ID does not exist" containerID="d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d"
Sep 15 13:23:15.712708 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.712628    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d"} err="failed to get container status \"d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d\": rpc error: code = NotFound desc = could not find container \"d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d\": container with ID starting with d691ba9e9278a87ef7fc9095b0ab74255aacf05abed09a93e91041f2c275c23d not found: ID does not exist"
Sep 15 13:23:15.712708 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.712644    2562 scope.go:117] "RemoveContainer" containerID="e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333"
Sep 15 13:23:15.722550 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.722526    2562 scope.go:117] "RemoveContainer" containerID="e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333"
Sep 15 13:23:15.722855 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:23:15.722839    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333\": container with ID starting with e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333 not found: ID does not exist" containerID="e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333"
Sep 15 13:23:15.722898 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.722863    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333"} err="failed to get container status \"e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333\": rpc error: code = NotFound desc = could not find container \"e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333\": container with ID starting with e9310b7a6926c57217c49ecc06369806e9e5c881abb34790242fdf5be70d7333 not found: ID does not exist"
Sep 15 13:23:15.730791 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.730758    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"]
Sep 15 13:23:15.734236 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.734210    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-92f861-54b4ccbdf7-ch8vd"]
Sep 15 13:23:15.745385 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.745351    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"]
Sep 15 13:23:15.751602 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:15.751575    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-92f861-7c6bb58bfd-wtp46"]
Sep 15 13:23:17.263572 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:17.263528    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" path="/var/lib/kubelet/pods/32b24ea4-542b-4b16-abc7-cf48b3ef5fb9/volumes"
Sep 15 13:23:17.264119 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:17.264100    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fd82aa8-414a-414d-8385-d1dd27fc843a" path="/var/lib/kubelet/pods/3fd82aa8-414a-414d-8385-d1dd27fc843a/volumes"
Sep 15 13:23:17.264493 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:17.264474    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447dc810-b1fa-4927-934d-a046cea2bd9e" path="/var/lib/kubelet/pods/447dc810-b1fa-4927-934d-a046cea2bd9e/volumes"
Sep 15 13:23:18.378981 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:18.378937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:18.476851 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:18.476814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:18.933086 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:18.933042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:22.496010 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:22.495956    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:22.596329 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:22.596295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:22.759478 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:22.759394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:23.156124 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156049    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"]
Sep 15 13:23:23.156499 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156486    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447dc810-b1fa-4927-934d-a046cea2bd9e" containerName="payload-processing"
Sep 15 13:23:23.156543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156501    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="447dc810-b1fa-4927-934d-a046cea2bd9e" containerName="payload-processing"
Sep 15 13:23:23.156543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156510    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" containerName="payload-pre-processing"
Sep 15 13:23:23.156543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156515    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" containerName="payload-pre-processing"
Sep 15 13:23:23.156543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156531    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd82aa8-414a-414d-8385-d1dd27fc843a" containerName="revoke-keys"
Sep 15 13:23:23.156543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156537    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd82aa8-414a-414d-8385-d1dd27fc843a" containerName="revoke-keys"
Sep 15 13:23:23.156706 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156600    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b24ea4-542b-4b16-abc7-cf48b3ef5fb9" containerName="payload-pre-processing"
Sep 15 13:23:23.156706 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156611    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fd82aa8-414a-414d-8385-d1dd27fc843a" containerName="revoke-keys"
Sep 15 13:23:23.156706 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.156618    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="447dc810-b1fa-4927-934d-a046cea2bd9e" containerName="payload-processing"
Sep 15 13:23:23.161377 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.161354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.164839 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.164811    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:23:23.165451 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.165427    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:23:23.166199 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.166184    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:23:23.183115 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.183085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"]
Sep 15 13:23:23.278426 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.278396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcadc6c-a503-41c8-a305-660b77cd4256-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.278604 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.278442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndv47\" (UniqueName: \"kubernetes.io/projected/dfcadc6c-a503-41c8-a305-660b77cd4256-kube-api-access-ndv47\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.328725 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.328690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:23.379771 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.379726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndv47\" (UniqueName: \"kubernetes.io/projected/dfcadc6c-a503-41c8-a305-660b77cd4256-kube-api-access-ndv47\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.380032 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.379910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcadc6c-a503-41c8-a305-660b77cd4256-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.380567 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.380544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcadc6c-a503-41c8-a305-660b77cd4256-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.388316 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.388294    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndv47\" (UniqueName: \"kubernetes.io/projected/dfcadc6c-a503-41c8-a305-660b77cd4256-kube-api-access-ndv47\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.472115 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.472080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:23.749666 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.749631    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"]
Sep 15 13:23:23.750443 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:23:23.750416    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcadc6c_a503_41c8_a305_660b77cd4256.slice/crio-84f109fc4de90b459c1144fa2780d3901be0c76583f40291e83582a84c9ce9f7 WatchSource:0}: Error finding container 84f109fc4de90b459c1144fa2780d3901be0c76583f40291e83582a84c9ce9f7: Status 404 returned error can't find the container with id 84f109fc4de90b459c1144fa2780d3901be0c76583f40291e83582a84c9ce9f7
Sep 15 13:23:23.767614 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:23.767573    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc" event={"ID":"dfcadc6c-a503-41c8-a305-660b77cd4256","Type":"ContainerStarted","Data":"84f109fc4de90b459c1144fa2780d3901be0c76583f40291e83582a84c9ce9f7"}
Sep 15 13:23:24.518837 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:24.518801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:24.775151 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:24.775066    2562 generic.go:356] "Generic (PLEG): container finished" podID="dfcadc6c-a503-41c8-a305-660b77cd4256" containerID="b89c3234f2961a7184ea7d2e0bb166d63196aef3b6bed6313449649364986f7e" exitCode=0
Sep 15 13:23:24.775504 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:24.775154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc" event={"ID":"dfcadc6c-a503-41c8-a305-660b77cd4256","Type":"ContainerDied","Data":"b89c3234f2961a7184ea7d2e0bb166d63196aef3b6bed6313449649364986f7e"}
Sep 15 13:23:25.383688 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:25.383655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:25.921596 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:25.921569    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:26.006111 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.006079    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcadc6c-a503-41c8-a305-660b77cd4256-maas-api-service-ca\") pod \"dfcadc6c-a503-41c8-a305-660b77cd4256\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") "
Sep 15 13:23:26.006322 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.006193    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndv47\" (UniqueName: \"kubernetes.io/projected/dfcadc6c-a503-41c8-a305-660b77cd4256-kube-api-access-ndv47\") pod \"dfcadc6c-a503-41c8-a305-660b77cd4256\" (UID: \"dfcadc6c-a503-41c8-a305-660b77cd4256\") "
Sep 15 13:23:26.006457 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.006431    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfcadc6c-a503-41c8-a305-660b77cd4256-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dfcadc6c-a503-41c8-a305-660b77cd4256" (UID: "dfcadc6c-a503-41c8-a305-660b77cd4256"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:26.008286 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.008253    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfcadc6c-a503-41c8-a305-660b77cd4256-kube-api-access-ndv47" (OuterVolumeSpecName: "kube-api-access-ndv47") pod "dfcadc6c-a503-41c8-a305-660b77cd4256" (UID: "dfcadc6c-a503-41c8-a305-660b77cd4256"). InnerVolumeSpecName "kube-api-access-ndv47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:26.106274 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.106163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:26.107364 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.107335    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndv47\" (UniqueName: \"kubernetes.io/projected/dfcadc6c-a503-41c8-a305-660b77cd4256-kube-api-access-ndv47\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:26.107503 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.107366    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcadc6c-a503-41c8-a305-660b77cd4256-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:26.789079 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.789046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc" event={"ID":"dfcadc6c-a503-41c8-a305-660b77cd4256","Type":"ContainerDied","Data":"84f109fc4de90b459c1144fa2780d3901be0c76583f40291e83582a84c9ce9f7"}
Sep 15 13:23:26.789079 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.789071    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"
Sep 15 13:23:26.789301 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.789095    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84f109fc4de90b459c1144fa2780d3901be0c76583f40291e83582a84c9ce9f7"
Sep 15 13:23:26.820421 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.820388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:26.943398 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:26.943350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:27.333418 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:27.333387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:27.698311 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:27.698277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:28.521625 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:28.521589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:29.356725 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:29.356681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:30.182754 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:30.182719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:30.915821 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:30.915790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:33.258631 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:33.258597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:33.935351 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:33.935310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:33.942835 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:33.942805    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"]
Sep 15 13:23:33.945740 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:33.945721    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6a966-29824635-22pb9"]
Sep 15 13:23:33.968824 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:33.968790    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"]
Sep 15 13:23:33.969097 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:33.969071    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86" podUID="cc1291dd-f3dc-40ff-9421-21e34941680a" containerName="payload-processing" containerID="cri-o://ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60" gracePeriod=30
Sep 15 13:23:34.035696 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.035660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:34.135094 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.135042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:34.151665 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.151637    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"]
Sep 15 13:23:34.156384 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.156355    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6a966-zfxwc"]
Sep 15 13:23:34.228497 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.228472    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:23:34.381834 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.381799    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1291dd-f3dc-40ff-9421-21e34941680a-plugins-config-volume\") pod \"cc1291dd-f3dc-40ff-9421-21e34941680a\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") "
Sep 15 13:23:34.382259 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.381893    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzdtw\" (UniqueName: \"kubernetes.io/projected/cc1291dd-f3dc-40ff-9421-21e34941680a-kube-api-access-wzdtw\") pod \"cc1291dd-f3dc-40ff-9421-21e34941680a\" (UID: \"cc1291dd-f3dc-40ff-9421-21e34941680a\") "
Sep 15 13:23:34.382259 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.382242    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1291dd-f3dc-40ff-9421-21e34941680a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc1291dd-f3dc-40ff-9421-21e34941680a" (UID: "cc1291dd-f3dc-40ff-9421-21e34941680a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:34.383990 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.383945    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1291dd-f3dc-40ff-9421-21e34941680a-kube-api-access-wzdtw" (OuterVolumeSpecName: "kube-api-access-wzdtw") pod "cc1291dd-f3dc-40ff-9421-21e34941680a" (UID: "cc1291dd-f3dc-40ff-9421-21e34941680a"). InnerVolumeSpecName "kube-api-access-wzdtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:34.482693 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.482611    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzdtw\" (UniqueName: \"kubernetes.io/projected/cc1291dd-f3dc-40ff-9421-21e34941680a-kube-api-access-wzdtw\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.482693 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.482637    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1291dd-f3dc-40ff-9421-21e34941680a-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.841578 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.841492    2562 generic.go:356] "Generic (PLEG): container finished" podID="cc1291dd-f3dc-40ff-9421-21e34941680a" containerID="ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60" exitCode=0
Sep 15 13:23:34.841578 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.841557    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"
Sep 15 13:23:34.841755 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.841581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86" event={"ID":"cc1291dd-f3dc-40ff-9421-21e34941680a","Type":"ContainerDied","Data":"ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60"}
Sep 15 13:23:34.841755 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.841645    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86" event={"ID":"cc1291dd-f3dc-40ff-9421-21e34941680a","Type":"ContainerDied","Data":"725f980345ca02e65a161c8c339ac5be2932a2667236c4499bc68708a1bfc035"}
Sep 15 13:23:34.841755 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.841670    2562 scope.go:117] "RemoveContainer" containerID="ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60"
Sep 15 13:23:34.851444 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.851427    2562 scope.go:117] "RemoveContainer" containerID="ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60"
Sep 15 13:23:34.851709 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:23:34.851691    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60\": container with ID starting with ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60 not found: ID does not exist" containerID="ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60"
Sep 15 13:23:34.851748 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.851719    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60"} err="failed to get container status \"ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60\": rpc error: code = NotFound desc = could not find container \"ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60\": container with ID starting with ef89393e1c6809ff3f0370b23e36148b4dc62fb5b6ecc3522d11f67f205e4f60 not found: ID does not exist"
Sep 15 13:23:34.863804 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.863776    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"]
Sep 15 13:23:34.867747 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:34.867726    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6a966-54d8645ddf-2dd86"]
Sep 15 13:23:35.263221 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:35.263189    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47826aa3-c22d-4be0-925d-250da2786783" path="/var/lib/kubelet/pods/47826aa3-c22d-4be0-925d-250da2786783/volumes"
Sep 15 13:23:35.263537 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:35.263523    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1291dd-f3dc-40ff-9421-21e34941680a" path="/var/lib/kubelet/pods/cc1291dd-f3dc-40ff-9421-21e34941680a/volumes"
Sep 15 13:23:35.263839 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:35.263828    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfcadc6c-a503-41c8-a305-660b77cd4256" path="/var/lib/kubelet/pods/dfcadc6c-a503-41c8-a305-660b77cd4256/volumes"
Sep 15 13:23:37.367736 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:37.367702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:37.427358 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:37.427324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:41.339284 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.339237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:41.427704 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.427654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:41.583389 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.583354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:41.990298 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.990257    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"]
Sep 15 13:23:41.990694 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.990681    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfcadc6c-a503-41c8-a305-660b77cd4256" containerName="revoke-keys"
Sep 15 13:23:41.990742 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.990696    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfcadc6c-a503-41c8-a305-660b77cd4256" containerName="revoke-keys"
Sep 15 13:23:41.990742 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.990712    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1291dd-f3dc-40ff-9421-21e34941680a" containerName="payload-processing"
Sep 15 13:23:41.990742 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.990718    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1291dd-f3dc-40ff-9421-21e34941680a" containerName="payload-processing"
Sep 15 13:23:41.990850 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.990783    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1291dd-f3dc-40ff-9421-21e34941680a" containerName="payload-processing"
Sep 15 13:23:41.990850 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.990795    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfcadc6c-a503-41c8-a305-660b77cd4256" containerName="revoke-keys"
Sep 15 13:23:41.995305 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.995288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:41.997954 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.997930    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:23:41.999089 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.999063    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:23:41.999372 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:41.999352    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:23:42.003876 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.003857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"]
Sep 15 13:23:42.139065 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.139033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:42.152789 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.152762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:42.152994 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.152851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqpnf\" (UniqueName: \"kubernetes.io/projected/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-kube-api-access-hqpnf\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:42.253865 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.253759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpnf\" (UniqueName: \"kubernetes.io/projected/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-kube-api-access-hqpnf\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:42.253865 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.253853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:42.254467 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.254447    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:42.262411 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.262384    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqpnf\" (UniqueName: \"kubernetes.io/projected/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-kube-api-access-hqpnf\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:42.306918 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.306885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:42.590634 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.590605    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"]
Sep 15 13:23:42.591444 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:23:42.591420    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f93f4a8_b24c_4c6c_883d_68d320f61b0c.slice/crio-b9b15dffb44adb79103f49c8ad8b94c76a3a331613942b8f8a906712252390f9 WatchSource:0}: Error finding container b9b15dffb44adb79103f49c8ad8b94c76a3a331613942b8f8a906712252390f9: Status 404 returned error can't find the container with id b9b15dffb44adb79103f49c8ad8b94c76a3a331613942b8f8a906712252390f9
Sep 15 13:23:42.895581 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:42.895496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9" event={"ID":"0f93f4a8-b24c-4c6c-883d-68d320f61b0c","Type":"ContainerStarted","Data":"b9b15dffb44adb79103f49c8ad8b94c76a3a331613942b8f8a906712252390f9"}
Sep 15 13:23:43.903020 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:43.902990    2562 generic.go:356] "Generic (PLEG): container finished" podID="0f93f4a8-b24c-4c6c-883d-68d320f61b0c" containerID="3a54125b980218d9d45dc69d40adc966d1dd4b180ef878db2188dd1fd47984be" exitCode=0
Sep 15 13:23:43.903410 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:43.903091    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9" event={"ID":"0f93f4a8-b24c-4c6c-883d-68d320f61b0c","Type":"ContainerDied","Data":"3a54125b980218d9d45dc69d40adc966d1dd4b180ef878db2188dd1fd47984be"}
Sep 15 13:23:45.048993 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.048951    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:45.182480 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.182445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqpnf\" (UniqueName: \"kubernetes.io/projected/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-kube-api-access-hqpnf\") pod \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") "
Sep 15 13:23:45.182672 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.182550    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-maas-api-service-ca\") pod \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\" (UID: \"0f93f4a8-b24c-4c6c-883d-68d320f61b0c\") "
Sep 15 13:23:45.182905 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.182883    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f93f4a8-b24c-4c6c-883d-68d320f61b0c" (UID: "0f93f4a8-b24c-4c6c-883d-68d320f61b0c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:45.184655 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.184631    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-kube-api-access-hqpnf" (OuterVolumeSpecName: "kube-api-access-hqpnf") pod "0f93f4a8-b24c-4c6c-883d-68d320f61b0c" (UID: "0f93f4a8-b24c-4c6c-883d-68d320f61b0c"). InnerVolumeSpecName "kube-api-access-hqpnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:45.284210 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.284181    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqpnf\" (UniqueName: \"kubernetes.io/projected/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-kube-api-access-hqpnf\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:45.284210 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.284209    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f93f4a8-b24c-4c6c-883d-68d320f61b0c-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:45.917207 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.917171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9" event={"ID":"0f93f4a8-b24c-4c6c-883d-68d320f61b0c","Type":"ContainerDied","Data":"b9b15dffb44adb79103f49c8ad8b94c76a3a331613942b8f8a906712252390f9"}
Sep 15 13:23:45.917207 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.917203    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"
Sep 15 13:23:45.917437 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:45.917226    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9b15dffb44adb79103f49c8ad8b94c76a3a331613942b8f8a906712252390f9"
Sep 15 13:23:46.044002 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:46.043960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:46.144563 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:46.144529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:52.495882 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.495794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:52.527166 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.527137    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"]
Sep 15 13:23:52.527409 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.527384    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz" podUID="f8f74299-8c73-4832-84f5-73efb2a12539" containerName="payload-processing" containerID="cri-o://492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965" gracePeriod=30
Sep 15 13:23:52.593982 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.593931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:52.694212 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.694175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:52.703222 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.703156    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"]
Sep 15 13:23:52.706760 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.706732    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ddd0eb-qn8z9"]
Sep 15 13:23:52.771279 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.771256    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:23:52.796126 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.796088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:52.954521 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.954495    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f74299-8c73-4832-84f5-73efb2a12539-plugins-config-volume\") pod \"f8f74299-8c73-4832-84f5-73efb2a12539\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") "
Sep 15 13:23:52.954696 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.954531    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glh6j\" (UniqueName: \"kubernetes.io/projected/f8f74299-8c73-4832-84f5-73efb2a12539-kube-api-access-glh6j\") pod \"f8f74299-8c73-4832-84f5-73efb2a12539\" (UID: \"f8f74299-8c73-4832-84f5-73efb2a12539\") "
Sep 15 13:23:52.954934 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.954916    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f74299-8c73-4832-84f5-73efb2a12539-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8f74299-8c73-4832-84f5-73efb2a12539" (UID: "f8f74299-8c73-4832-84f5-73efb2a12539"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:52.956812 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.956780    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f74299-8c73-4832-84f5-73efb2a12539-kube-api-access-glh6j" (OuterVolumeSpecName: "kube-api-access-glh6j") pod "f8f74299-8c73-4832-84f5-73efb2a12539" (UID: "f8f74299-8c73-4832-84f5-73efb2a12539"). InnerVolumeSpecName "kube-api-access-glh6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:52.962699 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.962671    2562 generic.go:356] "Generic (PLEG): container finished" podID="f8f74299-8c73-4832-84f5-73efb2a12539" containerID="492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965" exitCode=0
Sep 15 13:23:52.962814 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.962708    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"
Sep 15 13:23:52.962814 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.962729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz" event={"ID":"f8f74299-8c73-4832-84f5-73efb2a12539","Type":"ContainerDied","Data":"492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965"}
Sep 15 13:23:52.962814 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.962782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz" event={"ID":"f8f74299-8c73-4832-84f5-73efb2a12539","Type":"ContainerDied","Data":"d81bbb67ee5a4df7da86c27674149c7a470be3c8a33464a04b614fb8b772b88a"}
Sep 15 13:23:52.962814 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.962811    2562 scope.go:117] "RemoveContainer" containerID="492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965"
Sep 15 13:23:52.973133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.973110    2562 scope.go:117] "RemoveContainer" containerID="492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965"
Sep 15 13:23:52.973453 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:23:52.973436    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965\": container with ID starting with 492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965 not found: ID does not exist" containerID="492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965"
Sep 15 13:23:52.973520 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.973462    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965"} err="failed to get container status \"492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965\": rpc error: code = NotFound desc = could not find container \"492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965\": container with ID starting with 492334f787c3dc50579ba084aed276ff48ddf758f1ec98e9a8994e3207d9d965 not found: ID does not exist"
Sep 15 13:23:52.986876 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.986839    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"]
Sep 15 13:23:52.990533 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:52.990506    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ddd0eb-f9c79d45-fbmrz"]
Sep 15 13:23:53.056129 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:53.056039    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f74299-8c73-4832-84f5-73efb2a12539-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:53.056129 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:53.056074    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glh6j\" (UniqueName: \"kubernetes.io/projected/f8f74299-8c73-4832-84f5-73efb2a12539-kube-api-access-glh6j\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:23:53.100204 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:53.100158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:53.245066 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:53.245034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:53.262202 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:53.262171    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f93f4a8-b24c-4c6c-883d-68d320f61b0c" path="/var/lib/kubelet/pods/0f93f4a8-b24c-4c6c-883d-68d320f61b0c/volumes"
Sep 15 13:23:53.262546 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:53.262533    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f74299-8c73-4832-84f5-73efb2a12539" path="/var/lib/kubelet/pods/f8f74299-8c73-4832-84f5-73efb2a12539/volumes"
Sep 15 13:23:54.139856 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:54.139823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:55.186936 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:55.186901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:55.708357 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:55.708326    2562 scope.go:117] "RemoveContainer" containerID="0e2c259345526e00c4df98836ae88b68f28a74b13b2f65f831e70a4201048f4f"
Sep 15 13:23:58.817119 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:58.817068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:58.919214 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:58.919169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:23:59.090392 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:23:59.090301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:24:55.483233 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:24:55.483205    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:24:55.491224 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:24:55.491203    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:25:10.703721 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:25:10.703677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:25:36.816955 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:25:36.816856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:25:58.238319 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:25:58.238273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:26:57.027370 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:26:57.027260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:27:07.541976 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:27:07.541925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:27:07.642130 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:27:07.642072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:27:09.231952 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:27:09.231918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:28:27.638564 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:28:27.638471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:28:29.258566 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:28:29.258525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:28:55.792204 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:28:55.792172    2562 scope.go:117] "RemoveContainer" containerID="ade03eef5040e6e52f490f0f91cf5544dfa42a9428b8792f244825214cfba0ff"
Sep 15 13:29:37.496336 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:29:37.496299    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:29:37.597697 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:29:37.597665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:29:55.524608 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:29:55.524513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:29:55.532150 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:29:55.532126    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:29:55.815490 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:29:55.815404    2562 scope.go:117] "RemoveContainer" containerID="9ceebc2c8103dc0ea45387fb0a3b85f2010d60129bc6fb7245dcccdc158bc3b8"
Sep 15 13:29:55.824890 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:29:55.824868    2562 scope.go:117] "RemoveContainer" containerID="3a54125b980218d9d45dc69d40adc966d1dd4b180ef878db2188dd1fd47984be"
Sep 15 13:29:55.833230 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:29:55.833211    2562 scope.go:117] "RemoveContainer" containerID="b89c3234f2961a7184ea7d2e0bb166d63196aef3b6bed6313449649364986f7e"
Sep 15 13:30:00.159389 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.159355    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"]
Sep 15 13:30:00.159812 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.159799    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f74299-8c73-4832-84f5-73efb2a12539" containerName="payload-processing"
Sep 15 13:30:00.159812 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.159813    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f74299-8c73-4832-84f5-73efb2a12539" containerName="payload-processing"
Sep 15 13:30:00.159891 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.159831    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f93f4a8-b24c-4c6c-883d-68d320f61b0c" containerName="revoke-keys"
Sep 15 13:30:00.159891 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.159837    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f93f4a8-b24c-4c6c-883d-68d320f61b0c" containerName="revoke-keys"
Sep 15 13:30:00.159958 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.159896    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f93f4a8-b24c-4c6c-883d-68d320f61b0c" containerName="revoke-keys"
Sep 15 13:30:00.159958 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.159908    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8f74299-8c73-4832-84f5-73efb2a12539" containerName="payload-processing"
Sep 15 13:30:00.164413 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.164393    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"]
Sep 15 13:30:00.164555 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.164523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"
Sep 15 13:30:00.167875 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.167855    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"]
Sep 15 13:30:00.168010 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.167915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"
Sep 15 13:30:00.168010 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.167858    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:30:00.168122 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.168089    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:30:00.168165 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.168154    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:30:00.172183 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.171788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"
Sep 15 13:30:00.201664 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.201631    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"]
Sep 15 13:30:00.205765 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.205726    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"]
Sep 15 13:30:00.205891 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.205830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"
Sep 15 13:30:00.207869 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.207845    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"]
Sep 15 13:30:00.211117 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.211094    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"]
Sep 15 13:30:00.218047 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.218024    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"]
Sep 15 13:30:00.293880 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.293846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jsn9\" (UniqueName: \"kubernetes.io/projected/283450c4-dda7-4651-91b1-40caf96399e6-kube-api-access-5jsn9\") pod \"maas-api-key-cleanup-29824650-xr64f\" (UID: \"283450c4-dda7-4651-91b1-40caf96399e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"
Sep 15 13:30:00.294069 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.293892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvc8g\" (UniqueName: \"kubernetes.io/projected/25ee6ce8-b920-4392-9ca9-8544ded01058-kube-api-access-bvc8g\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7\" (UID: \"25ee6ce8-b920-4392-9ca9-8544ded01058\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"
Sep 15 13:30:00.294126 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.294099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d24x\" (UniqueName: \"kubernetes.io/projected/91f74c3f-c8af-4060-bfdc-cb901005e7a4-kube-api-access-9d24x\") pod \"maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6\" (UID: \"91f74c3f-c8af-4060-bfdc-cb901005e7a4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"
Sep 15 13:30:00.294171 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.294148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6srsk\" (UniqueName: \"kubernetes.io/projected/ba7a17d8-bc4e-47c7-8d34-80b6739e4066-kube-api-access-6srsk\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z\" (UID: \"ba7a17d8-bc4e-47c7-8d34-80b6739e4066\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"
Sep 15 13:30:00.395692 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.395649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d24x\" (UniqueName: \"kubernetes.io/projected/91f74c3f-c8af-4060-bfdc-cb901005e7a4-kube-api-access-9d24x\") pod \"maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6\" (UID: \"91f74c3f-c8af-4060-bfdc-cb901005e7a4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"
Sep 15 13:30:00.395692 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.395695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6srsk\" (UniqueName: \"kubernetes.io/projected/ba7a17d8-bc4e-47c7-8d34-80b6739e4066-kube-api-access-6srsk\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z\" (UID: \"ba7a17d8-bc4e-47c7-8d34-80b6739e4066\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"
Sep 15 13:30:00.395961 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.395750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jsn9\" (UniqueName: \"kubernetes.io/projected/283450c4-dda7-4651-91b1-40caf96399e6-kube-api-access-5jsn9\") pod \"maas-api-key-cleanup-29824650-xr64f\" (UID: \"283450c4-dda7-4651-91b1-40caf96399e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"
Sep 15 13:30:00.395961 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.395782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvc8g\" (UniqueName: \"kubernetes.io/projected/25ee6ce8-b920-4392-9ca9-8544ded01058-kube-api-access-bvc8g\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7\" (UID: \"25ee6ce8-b920-4392-9ca9-8544ded01058\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"
Sep 15 13:30:00.407816 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.407771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6srsk\" (UniqueName: \"kubernetes.io/projected/ba7a17d8-bc4e-47c7-8d34-80b6739e4066-kube-api-access-6srsk\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z\" (UID: \"ba7a17d8-bc4e-47c7-8d34-80b6739e4066\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"
Sep 15 13:30:00.410263 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.410201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d24x\" (UniqueName: \"kubernetes.io/projected/91f74c3f-c8af-4060-bfdc-cb901005e7a4-kube-api-access-9d24x\") pod \"maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6\" (UID: \"91f74c3f-c8af-4060-bfdc-cb901005e7a4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"
Sep 15 13:30:00.410587 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.410567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jsn9\" (UniqueName: \"kubernetes.io/projected/283450c4-dda7-4651-91b1-40caf96399e6-kube-api-access-5jsn9\") pod \"maas-api-key-cleanup-29824650-xr64f\" (UID: \"283450c4-dda7-4651-91b1-40caf96399e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"
Sep 15 13:30:00.410690 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.410668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvc8g\" (UniqueName: \"kubernetes.io/projected/25ee6ce8-b920-4392-9ca9-8544ded01058-kube-api-access-bvc8g\") pod \"maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7\" (UID: \"25ee6ce8-b920-4392-9ca9-8544ded01058\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"
Sep 15 13:30:00.476714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.476684    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"
Sep 15 13:30:00.483841 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.483819    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"
Sep 15 13:30:00.489824 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.489797    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"
Sep 15 13:30:00.518185 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.518151    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"
Sep 15 13:30:00.768673 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.768636    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"]
Sep 15 13:30:00.769484 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:30:00.769458    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283450c4_dda7_4651_91b1_40caf96399e6.slice/crio-d71c93ec3816f3c893b9a83212c5a2c9ea9d970fd635b8408d14b1a681f3031a WatchSource:0}: Error finding container d71c93ec3816f3c893b9a83212c5a2c9ea9d970fd635b8408d14b1a681f3031a: Status 404 returned error can't find the container with id d71c93ec3816f3c893b9a83212c5a2c9ea9d970fd635b8408d14b1a681f3031a
Sep 15 13:30:00.776291 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.776152    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"]
Sep 15 13:30:00.779452 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:30:00.779291    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f74c3f_c8af_4060_bfdc_cb901005e7a4.slice/crio-03df3356b704329dc476c11073bc02e3adf323d3938e2e31a3303d30efc9a0a4 WatchSource:0}: Error finding container 03df3356b704329dc476c11073bc02e3adf323d3938e2e31a3303d30efc9a0a4: Status 404 returned error can't find the container with id 03df3356b704329dc476c11073bc02e3adf323d3938e2e31a3303d30efc9a0a4
Sep 15 13:30:00.782471 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.782451    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"]
Sep 15 13:30:00.786567 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:30:00.786542    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ee6ce8_b920_4392_9ca9_8544ded01058.slice/crio-8ae06195d02c4933ae8059ee777dd58158c3df30b60e62e1ee1b94eb134d2c60 WatchSource:0}: Error finding container 8ae06195d02c4933ae8059ee777dd58158c3df30b60e62e1ee1b94eb134d2c60: Status 404 returned error can't find the container with id 8ae06195d02c4933ae8059ee777dd58158c3df30b60e62e1ee1b94eb134d2c60
Sep 15 13:30:00.827949 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:00.827926    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"]
Sep 15 13:30:00.829695 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:30:00.829669    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7a17d8_bc4e_47c7_8d34_80b6739e4066.slice/crio-660551d8cccfe15d646cf7f8f34ba93fcfb85bb53ad539bb260d7451960c683d WatchSource:0}: Error finding container 660551d8cccfe15d646cf7f8f34ba93fcfb85bb53ad539bb260d7451960c683d: Status 404 returned error can't find the container with id 660551d8cccfe15d646cf7f8f34ba93fcfb85bb53ad539bb260d7451960c683d
Sep 15 13:30:01.279793 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.279700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6" event={"ID":"91f74c3f-c8af-4060-bfdc-cb901005e7a4","Type":"ContainerStarted","Data":"83b4685828d1f53dcd4337046abc385215116831a91a4f9763518d49034f7f8b"}
Sep 15 13:30:01.279793 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.279761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6" event={"ID":"91f74c3f-c8af-4060-bfdc-cb901005e7a4","Type":"ContainerStarted","Data":"03df3356b704329dc476c11073bc02e3adf323d3938e2e31a3303d30efc9a0a4"}
Sep 15 13:30:01.281403 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.281376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f" event={"ID":"283450c4-dda7-4651-91b1-40caf96399e6","Type":"ContainerStarted","Data":"5bc403e139c633455e2068b5c3f4f1f577b551c3a6cf63547c42eadb00679471"}
Sep 15 13:30:01.281538 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.281421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f" event={"ID":"283450c4-dda7-4651-91b1-40caf96399e6","Type":"ContainerStarted","Data":"d71c93ec3816f3c893b9a83212c5a2c9ea9d970fd635b8408d14b1a681f3031a"}
Sep 15 13:30:01.282952 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.282929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7" event={"ID":"25ee6ce8-b920-4392-9ca9-8544ded01058","Type":"ContainerStarted","Data":"6b5b84fbbe4f186f1caaaf472a62af802321d8390ce859f99770a30074ae8a63"}
Sep 15 13:30:01.283071 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.283001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7" event={"ID":"25ee6ce8-b920-4392-9ca9-8544ded01058","Type":"ContainerStarted","Data":"8ae06195d02c4933ae8059ee777dd58158c3df30b60e62e1ee1b94eb134d2c60"}
Sep 15 13:30:01.284685 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.284662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z" event={"ID":"ba7a17d8-bc4e-47c7-8d34-80b6739e4066","Type":"ContainerStarted","Data":"68986dc0dd86c709ffc319bca10528c9ee4855de82d41feb97104a019afdd09c"}
Sep 15 13:30:01.284786 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.284701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z" event={"ID":"ba7a17d8-bc4e-47c7-8d34-80b6739e4066","Type":"ContainerStarted","Data":"660551d8cccfe15d646cf7f8f34ba93fcfb85bb53ad539bb260d7451960c683d"}
Sep 15 13:30:01.299515 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.299466    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6" podStartSLOduration=1.2994522179999999 podStartE2EDuration="1.299452218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:30:01.297824162 +0000 UTC m=+2706.660555786" watchObservedRunningTime="2026-09-15 13:30:01.299452218 +0000 UTC m=+2706.662183817"
Sep 15 13:30:01.318826 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.318777    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f" podStartSLOduration=1.318761385 podStartE2EDuration="1.318761385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:30:01.31578303 +0000 UTC m=+2706.678514628" watchObservedRunningTime="2026-09-15 13:30:01.318761385 +0000 UTC m=+2706.681492984"
Sep 15 13:30:01.338436 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.338384    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z" podStartSLOduration=1.338367965 podStartE2EDuration="1.338367965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:30:01.335469717 +0000 UTC m=+2706.698201316" watchObservedRunningTime="2026-09-15 13:30:01.338367965 +0000 UTC m=+2706.701099560"
Sep 15 13:30:01.353429 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:01.353382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7" podStartSLOduration=1.353369869 podStartE2EDuration="1.353369869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:30:01.351954122 +0000 UTC m=+2706.714685722" watchObservedRunningTime="2026-09-15 13:30:01.353369869 +0000 UTC m=+2706.716101468"
Sep 15 13:30:02.295852 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.295814    2562 generic.go:356] "Generic (PLEG): container finished" podID="91f74c3f-c8af-4060-bfdc-cb901005e7a4" containerID="83b4685828d1f53dcd4337046abc385215116831a91a4f9763518d49034f7f8b" exitCode=0
Sep 15 13:30:02.296362 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.295899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6" event={"ID":"91f74c3f-c8af-4060-bfdc-cb901005e7a4","Type":"ContainerDied","Data":"83b4685828d1f53dcd4337046abc385215116831a91a4f9763518d49034f7f8b"}
Sep 15 13:30:02.297419 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.297396    2562 generic.go:356] "Generic (PLEG): container finished" podID="283450c4-dda7-4651-91b1-40caf96399e6" containerID="5bc403e139c633455e2068b5c3f4f1f577b551c3a6cf63547c42eadb00679471" exitCode=0
Sep 15 13:30:02.297535 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.297478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f" event={"ID":"283450c4-dda7-4651-91b1-40caf96399e6","Type":"ContainerDied","Data":"5bc403e139c633455e2068b5c3f4f1f577b551c3a6cf63547c42eadb00679471"}
Sep 15 13:30:02.299045 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.299026    2562 generic.go:356] "Generic (PLEG): container finished" podID="25ee6ce8-b920-4392-9ca9-8544ded01058" containerID="6b5b84fbbe4f186f1caaaf472a62af802321d8390ce859f99770a30074ae8a63" exitCode=0
Sep 15 13:30:02.299122 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.299099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7" event={"ID":"25ee6ce8-b920-4392-9ca9-8544ded01058","Type":"ContainerDied","Data":"6b5b84fbbe4f186f1caaaf472a62af802321d8390ce859f99770a30074ae8a63"}
Sep 15 13:30:02.300640 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.300624    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba7a17d8-bc4e-47c7-8d34-80b6739e4066" containerID="68986dc0dd86c709ffc319bca10528c9ee4855de82d41feb97104a019afdd09c" exitCode=0
Sep 15 13:30:02.300723 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:02.300646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z" event={"ID":"ba7a17d8-bc4e-47c7-8d34-80b6739e4066","Type":"ContainerDied","Data":"68986dc0dd86c709ffc319bca10528c9ee4855de82d41feb97104a019afdd09c"}
Sep 15 13:30:03.477947 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.477918    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"
Sep 15 13:30:03.526881 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.526855    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvc8g\" (UniqueName: \"kubernetes.io/projected/25ee6ce8-b920-4392-9ca9-8544ded01058-kube-api-access-bvc8g\") pod \"25ee6ce8-b920-4392-9ca9-8544ded01058\" (UID: \"25ee6ce8-b920-4392-9ca9-8544ded01058\") "
Sep 15 13:30:03.529022 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.528993    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ee6ce8-b920-4392-9ca9-8544ded01058-kube-api-access-bvc8g" (OuterVolumeSpecName: "kube-api-access-bvc8g") pod "25ee6ce8-b920-4392-9ca9-8544ded01058" (UID: "25ee6ce8-b920-4392-9ca9-8544ded01058"). InnerVolumeSpecName "kube-api-access-bvc8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:30:03.532954 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.532932    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"
Sep 15 13:30:03.536118 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.536097    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"
Sep 15 13:30:03.539626 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.539608    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"
Sep 15 13:30:03.628543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.628453    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jsn9\" (UniqueName: \"kubernetes.io/projected/283450c4-dda7-4651-91b1-40caf96399e6-kube-api-access-5jsn9\") pod \"283450c4-dda7-4651-91b1-40caf96399e6\" (UID: \"283450c4-dda7-4651-91b1-40caf96399e6\") "
Sep 15 13:30:03.628543 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.628509    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d24x\" (UniqueName: \"kubernetes.io/projected/91f74c3f-c8af-4060-bfdc-cb901005e7a4-kube-api-access-9d24x\") pod \"91f74c3f-c8af-4060-bfdc-cb901005e7a4\" (UID: \"91f74c3f-c8af-4060-bfdc-cb901005e7a4\") "
Sep 15 13:30:03.628772 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.628582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6srsk\" (UniqueName: \"kubernetes.io/projected/ba7a17d8-bc4e-47c7-8d34-80b6739e4066-kube-api-access-6srsk\") pod \"ba7a17d8-bc4e-47c7-8d34-80b6739e4066\" (UID: \"ba7a17d8-bc4e-47c7-8d34-80b6739e4066\") "
Sep 15 13:30:03.628772 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.628745    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvc8g\" (UniqueName: \"kubernetes.io/projected/25ee6ce8-b920-4392-9ca9-8544ded01058-kube-api-access-bvc8g\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:30:03.630690 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.630649    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283450c4-dda7-4651-91b1-40caf96399e6-kube-api-access-5jsn9" (OuterVolumeSpecName: "kube-api-access-5jsn9") pod "283450c4-dda7-4651-91b1-40caf96399e6" (UID: "283450c4-dda7-4651-91b1-40caf96399e6"). InnerVolumeSpecName "kube-api-access-5jsn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:30:03.630690 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.630666    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f74c3f-c8af-4060-bfdc-cb901005e7a4-kube-api-access-9d24x" (OuterVolumeSpecName: "kube-api-access-9d24x") pod "91f74c3f-c8af-4060-bfdc-cb901005e7a4" (UID: "91f74c3f-c8af-4060-bfdc-cb901005e7a4"). InnerVolumeSpecName "kube-api-access-9d24x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:30:03.630849 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.630693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7a17d8-bc4e-47c7-8d34-80b6739e4066-kube-api-access-6srsk" (OuterVolumeSpecName: "kube-api-access-6srsk") pod "ba7a17d8-bc4e-47c7-8d34-80b6739e4066" (UID: "ba7a17d8-bc4e-47c7-8d34-80b6739e4066"). InnerVolumeSpecName "kube-api-access-6srsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:30:03.729520 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.729479    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jsn9\" (UniqueName: \"kubernetes.io/projected/283450c4-dda7-4651-91b1-40caf96399e6-kube-api-access-5jsn9\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:30:03.729520 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.729513    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d24x\" (UniqueName: \"kubernetes.io/projected/91f74c3f-c8af-4060-bfdc-cb901005e7a4-kube-api-access-9d24x\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:30:03.729520 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:03.729524    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6srsk\" (UniqueName: \"kubernetes.io/projected/ba7a17d8-bc4e-47c7-8d34-80b6739e4066-kube-api-access-6srsk\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:30:04.315131 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.315100    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6"
Sep 15 13:30:04.315340 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.315099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6" event={"ID":"91f74c3f-c8af-4060-bfdc-cb901005e7a4","Type":"ContainerDied","Data":"03df3356b704329dc476c11073bc02e3adf323d3938e2e31a3303d30efc9a0a4"}
Sep 15 13:30:04.315340 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.315227    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03df3356b704329dc476c11073bc02e3adf323d3938e2e31a3303d30efc9a0a4"
Sep 15 13:30:04.316489 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.316469    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f"
Sep 15 13:30:04.316613 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.316499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824650-xr64f" event={"ID":"283450c4-dda7-4651-91b1-40caf96399e6","Type":"ContainerDied","Data":"d71c93ec3816f3c893b9a83212c5a2c9ea9d970fd635b8408d14b1a681f3031a"}
Sep 15 13:30:04.316613 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.316539    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d71c93ec3816f3c893b9a83212c5a2c9ea9d970fd635b8408d14b1a681f3031a"
Sep 15 13:30:04.317861 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.317843    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7"
Sep 15 13:30:04.317975 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.317865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7" event={"ID":"25ee6ce8-b920-4392-9ca9-8544ded01058","Type":"ContainerDied","Data":"8ae06195d02c4933ae8059ee777dd58158c3df30b60e62e1ee1b94eb134d2c60"}
Sep 15 13:30:04.317975 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.317902    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ae06195d02c4933ae8059ee777dd58158c3df30b60e62e1ee1b94eb134d2c60"
Sep 15 13:30:04.319325 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.319305    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"
Sep 15 13:30:04.319451 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.319327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z" event={"ID":"ba7a17d8-bc4e-47c7-8d34-80b6739e4066","Type":"ContainerDied","Data":"660551d8cccfe15d646cf7f8f34ba93fcfb85bb53ad539bb260d7451960c683d"}
Sep 15 13:30:04.319451 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:04.319363    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="660551d8cccfe15d646cf7f8f34ba93fcfb85bb53ad539bb260d7451960c683d"
Sep 15 13:30:11.434210 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:11.434178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:30:37.761978 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:37.761941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:30:58.922248 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:30:58.922201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:31:14.201689 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:31:14.201636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:31:30.942516 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:31:30.942418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:31:37.897976 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:31:37.897921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:06.780665 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:06.780624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:07.871923 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:07.871885    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"]
Sep 15 13:32:08.009293 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009254    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"]
Sep 15 13:32:08.009691 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009676    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ee6ce8-b920-4392-9ca9-8544ded01058" containerName="cleanup"
Sep 15 13:32:08.009750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009692    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ee6ce8-b920-4392-9ca9-8544ded01058" containerName="cleanup"
Sep 15 13:32:08.009750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009702    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f74c3f-c8af-4060-bfdc-cb901005e7a4" containerName="cleanup"
Sep 15 13:32:08.009750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009709    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f74c3f-c8af-4060-bfdc-cb901005e7a4" containerName="cleanup"
Sep 15 13:32:08.009750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009725    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283450c4-dda7-4651-91b1-40caf96399e6" containerName="cleanup"
Sep 15 13:32:08.009750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009732    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="283450c4-dda7-4651-91b1-40caf96399e6" containerName="cleanup"
Sep 15 13:32:08.009750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009743    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7a17d8-bc4e-47c7-8d34-80b6739e4066" containerName="cleanup"
Sep 15 13:32:08.009750 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009749    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7a17d8-bc4e-47c7-8d34-80b6739e4066" containerName="cleanup"
Sep 15 13:32:08.009978 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009811    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="283450c4-dda7-4651-91b1-40caf96399e6" containerName="cleanup"
Sep 15 13:32:08.009978 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009820    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f74c3f-c8af-4060-bfdc-cb901005e7a4" containerName="cleanup"
Sep 15 13:32:08.009978 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009828    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="25ee6ce8-b920-4392-9ca9-8544ded01058" containerName="cleanup"
Sep 15 13:32:08.009978 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.009833    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7a17d8-bc4e-47c7-8d34-80b6739e4066" containerName="cleanup"
Sep 15 13:32:08.013055 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.013035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.017047 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.017018    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mn87z\""
Sep 15 13:32:08.017326 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.017306    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:32:08.017440 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.017313    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:32:08.024011 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.023954    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"]
Sep 15 13:32:08.178378 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.178328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f692ff0-699e-48c5-8e4d-0d36971f84a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.178568 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.178397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffcc2\" (UniqueName: \"kubernetes.io/projected/0f692ff0-699e-48c5-8e4d-0d36971f84a2-kube-api-access-ffcc2\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.279458 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.279414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f692ff0-699e-48c5-8e4d-0d36971f84a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.279458 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.279470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffcc2\" (UniqueName: \"kubernetes.io/projected/0f692ff0-699e-48c5-8e4d-0d36971f84a2-kube-api-access-ffcc2\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.280229 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.280204    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f692ff0-699e-48c5-8e4d-0d36971f84a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.289874 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.289841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffcc2\" (UniqueName: \"kubernetes.io/projected/0f692ff0-699e-48c5-8e4d-0d36971f84a2-kube-api-access-ffcc2\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.326211 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.326156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:08.506285 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.506192    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:08.606985 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:08.606894    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"]
Sep 15 13:32:08.607226 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:32:08.607191    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f692ff0_699e_48c5_8e4d_0d36971f84a2.slice/crio-b373b5c90433b8fa7458e111a204028f0e4e142748b347241bbbdc207565bfeb WatchSource:0}: Error finding container b373b5c90433b8fa7458e111a204028f0e4e142748b347241bbbdc207565bfeb: Status 404 returned error can't find the container with id b373b5c90433b8fa7458e111a204028f0e4e142748b347241bbbdc207565bfeb
Sep 15 13:32:09.107029 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:09.106917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:09.128593 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:09.128557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj" event={"ID":"0f692ff0-699e-48c5-8e4d-0d36971f84a2","Type":"ContainerStarted","Data":"710e35ace350889a2dbbd462ff2fcefe3226fcdd39eadd7ad91b6eaf993dccbc"}
Sep 15 13:32:09.128803 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:09.128614    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj" event={"ID":"0f692ff0-699e-48c5-8e4d-0d36971f84a2","Type":"ContainerStarted","Data":"b373b5c90433b8fa7458e111a204028f0e4e142748b347241bbbdc207565bfeb"}
Sep 15 13:32:09.149032 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:09.148949    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj" podStartSLOduration=2.148930726 podStartE2EDuration="2.148930726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:32:09.146322649 +0000 UTC m=+2834.509054248" watchObservedRunningTime="2026-09-15 13:32:09.148930726 +0000 UTC m=+2834.511662325"
Sep 15 13:32:09.855429 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:09.855398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:10.135825 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:10.135727    2562 generic.go:356] "Generic (PLEG): container finished" podID="0f692ff0-699e-48c5-8e4d-0d36971f84a2" containerID="710e35ace350889a2dbbd462ff2fcefe3226fcdd39eadd7ad91b6eaf993dccbc" exitCode=0
Sep 15 13:32:10.136251 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:10.135814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj" event={"ID":"0f692ff0-699e-48c5-8e4d-0d36971f84a2","Type":"ContainerDied","Data":"710e35ace350889a2dbbd462ff2fcefe3226fcdd39eadd7ad91b6eaf993dccbc"}
Sep 15 13:32:10.737298 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:10.737243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:11.287721 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:11.287688    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:11.307528 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:11.307494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f692ff0-699e-48c5-8e4d-0d36971f84a2-maas-api-service-ca\") pod \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") "
Sep 15 13:32:11.307723 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:11.307586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffcc2\" (UniqueName: \"kubernetes.io/projected/0f692ff0-699e-48c5-8e4d-0d36971f84a2-kube-api-access-ffcc2\") pod \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\" (UID: \"0f692ff0-699e-48c5-8e4d-0d36971f84a2\") "
Sep 15 13:32:11.308010 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:11.307954    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f692ff0-699e-48c5-8e4d-0d36971f84a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f692ff0-699e-48c5-8e4d-0d36971f84a2" (UID: "0f692ff0-699e-48c5-8e4d-0d36971f84a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:32:11.310546 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:11.310477    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f692ff0-699e-48c5-8e4d-0d36971f84a2-kube-api-access-ffcc2" (OuterVolumeSpecName: "kube-api-access-ffcc2") pod "0f692ff0-699e-48c5-8e4d-0d36971f84a2" (UID: "0f692ff0-699e-48c5-8e4d-0d36971f84a2"). InnerVolumeSpecName "kube-api-access-ffcc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:32:11.408672 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:11.408580    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffcc2\" (UniqueName: \"kubernetes.io/projected/0f692ff0-699e-48c5-8e4d-0d36971f84a2-kube-api-access-ffcc2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:11.408672 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:11.408613    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f692ff0-699e-48c5-8e4d-0d36971f84a2-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:12.151601 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:12.151570    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"
Sep 15 13:32:12.151791 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:12.151603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj" event={"ID":"0f692ff0-699e-48c5-8e4d-0d36971f84a2","Type":"ContainerDied","Data":"b373b5c90433b8fa7458e111a204028f0e4e142748b347241bbbdc207565bfeb"}
Sep 15 13:32:12.151791 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:12.151653    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b373b5c90433b8fa7458e111a204028f0e4e142748b347241bbbdc207565bfeb"
Sep 15 13:32:18.596947 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.596899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:18.625544 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.625508    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"]
Sep 15 13:32:18.625772 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.625726    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk" podUID="364d6b31-015e-4df6-a899-5b46fd271cc4" containerName="payload-processing" containerID="cri-o://0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9" gracePeriod=30
Sep 15 13:32:18.639420 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.639377    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"]
Sep 15 13:32:18.639651 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.639626    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567" podUID="e059f95b-9c01-4a4e-9f15-d185aeff0425" containerName="payload-pre-processing" containerID="cri-o://1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a" gracePeriod=30
Sep 15 13:32:18.670984 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.670929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:18.770165 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.770128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:18.831702 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.831671    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"]
Sep 15 13:32:18.834563 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.834537    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-aa8ef1-5nbfj"]
Sep 15 13:32:18.836550 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.836511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:18.925155 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.925132    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:32:18.928357 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.928335    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:32:18.974426 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.974394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk9qw\" (UniqueName: \"kubernetes.io/projected/e059f95b-9c01-4a4e-9f15-d185aeff0425-kube-api-access-mk9qw\") pod \"e059f95b-9c01-4a4e-9f15-d185aeff0425\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") "
Sep 15 13:32:18.974426 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.974431    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364d6b31-015e-4df6-a899-5b46fd271cc4-plugins-config-volume\") pod \"364d6b31-015e-4df6-a899-5b46fd271cc4\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") "
Sep 15 13:32:18.974675 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.974460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h6l7\" (UniqueName: \"kubernetes.io/projected/364d6b31-015e-4df6-a899-5b46fd271cc4-kube-api-access-6h6l7\") pod \"364d6b31-015e-4df6-a899-5b46fd271cc4\" (UID: \"364d6b31-015e-4df6-a899-5b46fd271cc4\") "
Sep 15 13:32:18.974675 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.974522    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e059f95b-9c01-4a4e-9f15-d185aeff0425-plugins-config-volume\") pod \"e059f95b-9c01-4a4e-9f15-d185aeff0425\" (UID: \"e059f95b-9c01-4a4e-9f15-d185aeff0425\") "
Sep 15 13:32:18.974871 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.974839    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364d6b31-015e-4df6-a899-5b46fd271cc4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "364d6b31-015e-4df6-a899-5b46fd271cc4" (UID: "364d6b31-015e-4df6-a899-5b46fd271cc4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:32:18.974997 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.974938    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e059f95b-9c01-4a4e-9f15-d185aeff0425-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e059f95b-9c01-4a4e-9f15-d185aeff0425" (UID: "e059f95b-9c01-4a4e-9f15-d185aeff0425"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:32:18.976585 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.976562    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e059f95b-9c01-4a4e-9f15-d185aeff0425-kube-api-access-mk9qw" (OuterVolumeSpecName: "kube-api-access-mk9qw") pod "e059f95b-9c01-4a4e-9f15-d185aeff0425" (UID: "e059f95b-9c01-4a4e-9f15-d185aeff0425"). InnerVolumeSpecName "kube-api-access-mk9qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:32:18.976585 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:18.976576    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364d6b31-015e-4df6-a899-5b46fd271cc4-kube-api-access-6h6l7" (OuterVolumeSpecName: "kube-api-access-6h6l7") pod "364d6b31-015e-4df6-a899-5b46fd271cc4" (UID: "364d6b31-015e-4df6-a899-5b46fd271cc4"). InnerVolumeSpecName "kube-api-access-6h6l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:32:19.075572 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.075528    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e059f95b-9c01-4a4e-9f15-d185aeff0425-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:19.075572 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.075562    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk9qw\" (UniqueName: \"kubernetes.io/projected/e059f95b-9c01-4a4e-9f15-d185aeff0425-kube-api-access-mk9qw\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:19.075572 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.075572    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/364d6b31-015e-4df6-a899-5b46fd271cc4-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:19.075572 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.075581    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h6l7\" (UniqueName: \"kubernetes.io/projected/364d6b31-015e-4df6-a899-5b46fd271cc4-kube-api-access-6h6l7\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:19.195864 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.195832    2562 generic.go:356] "Generic (PLEG): container finished" podID="364d6b31-015e-4df6-a899-5b46fd271cc4" containerID="0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9" exitCode=0
Sep 15 13:32:19.196104 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.195885    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"
Sep 15 13:32:19.196104 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.195911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk" event={"ID":"364d6b31-015e-4df6-a899-5b46fd271cc4","Type":"ContainerDied","Data":"0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9"}
Sep 15 13:32:19.196104 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.195985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk" event={"ID":"364d6b31-015e-4df6-a899-5b46fd271cc4","Type":"ContainerDied","Data":"c4513ea5e9b91227c7fb1c891822799b535ca113ca5734f0da71169d92d2594a"}
Sep 15 13:32:19.196104 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.196006    2562 scope.go:117] "RemoveContainer" containerID="0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9"
Sep 15 13:32:19.197338 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.197317    2562 generic.go:356] "Generic (PLEG): container finished" podID="e059f95b-9c01-4a4e-9f15-d185aeff0425" containerID="1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a" exitCode=0
Sep 15 13:32:19.197431 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.197349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567" event={"ID":"e059f95b-9c01-4a4e-9f15-d185aeff0425","Type":"ContainerDied","Data":"1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a"}
Sep 15 13:32:19.197431 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.197366    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"
Sep 15 13:32:19.197431 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.197381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567" event={"ID":"e059f95b-9c01-4a4e-9f15-d185aeff0425","Type":"ContainerDied","Data":"81ee58c99d669c5cac375bda6bdd35c905924e504bf43f0a80ed0d47113c8bc6"}
Sep 15 13:32:19.206013 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.205993    2562 scope.go:117] "RemoveContainer" containerID="0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9"
Sep 15 13:32:19.206346 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:32:19.206322    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9\": container with ID starting with 0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9 not found: ID does not exist" containerID="0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9"
Sep 15 13:32:19.206442 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.206351    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9"} err="failed to get container status \"0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9\": rpc error: code = NotFound desc = could not find container \"0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9\": container with ID starting with 0fb822d0a0946af4d4ebc37e82c44c7764da827ecf4553fe72fa10430ab2b0e9 not found: ID does not exist"
Sep 15 13:32:19.206442 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.206367    2562 scope.go:117] "RemoveContainer" containerID="1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a"
Sep 15 13:32:19.215531 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.215509    2562 scope.go:117] "RemoveContainer" containerID="1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a"
Sep 15 13:32:19.215835 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:32:19.215814    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a\": container with ID starting with 1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a not found: ID does not exist" containerID="1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a"
Sep 15 13:32:19.215910 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.215849    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a"} err="failed to get container status \"1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a\": rpc error: code = NotFound desc = could not find container \"1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a\": container with ID starting with 1104c859cea3ec1fee2829f4bc9298aaf9483bcbc28f0c778627f3a44942128a not found: ID does not exist"
Sep 15 13:32:19.223381 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.223353    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"]
Sep 15 13:32:19.233301 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.233271    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-aa8ef1-6cc98dbb87-rrvmk"]
Sep 15 13:32:19.249095 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.249065    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"]
Sep 15 13:32:19.252041 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.252017    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aa8ef1-54bcdf8778-5v567"]
Sep 15 13:32:19.262877 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.262851    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f692ff0-699e-48c5-8e4d-0d36971f84a2" path="/var/lib/kubelet/pods/0f692ff0-699e-48c5-8e4d-0d36971f84a2/volumes"
Sep 15 13:32:19.263229 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.263217    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="364d6b31-015e-4df6-a899-5b46fd271cc4" path="/var/lib/kubelet/pods/364d6b31-015e-4df6-a899-5b46fd271cc4/volumes"
Sep 15 13:32:19.263532 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:19.263521    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e059f95b-9c01-4a4e-9f15-d185aeff0425" path="/var/lib/kubelet/pods/e059f95b-9c01-4a4e-9f15-d185aeff0425/volumes"
Sep 15 13:32:20.128725 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:20.128685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:20.330264 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:20.330223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:22.892054 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:22.891995    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r" podUID="abfc350c-7622-4b50-9c48-271d99de2d78" containerName="main" containerID="cri-o://6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d" gracePeriod=45
Sep 15 13:32:23.152317 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.152249    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:32:23.214918 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.214883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-dshm\") pod \"abfc350c-7622-4b50-9c48-271d99de2d78\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") "
Sep 15 13:32:23.214918 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.214928    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-tmp-dir\") pod \"abfc350c-7622-4b50-9c48-271d99de2d78\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") "
Sep 15 13:32:23.215218 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.214993    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-home\") pod \"abfc350c-7622-4b50-9c48-271d99de2d78\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") "
Sep 15 13:32:23.215218 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215020    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-model-cache\") pod \"abfc350c-7622-4b50-9c48-271d99de2d78\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") "
Sep 15 13:32:23.215218 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215048    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlvck\" (UniqueName: \"kubernetes.io/projected/abfc350c-7622-4b50-9c48-271d99de2d78-kube-api-access-vlvck\") pod \"abfc350c-7622-4b50-9c48-271d99de2d78\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") "
Sep 15 13:32:23.215218 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215093    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abfc350c-7622-4b50-9c48-271d99de2d78-tls-certs\") pod \"abfc350c-7622-4b50-9c48-271d99de2d78\" (UID: \"abfc350c-7622-4b50-9c48-271d99de2d78\") "
Sep 15 13:32:23.215526 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215274    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "abfc350c-7622-4b50-9c48-271d99de2d78" (UID: "abfc350c-7622-4b50-9c48-271d99de2d78"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:32:23.215526 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215307    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-model-cache" (OuterVolumeSpecName: "model-cache") pod "abfc350c-7622-4b50-9c48-271d99de2d78" (UID: "abfc350c-7622-4b50-9c48-271d99de2d78"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:32:23.215526 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215322    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-home" (OuterVolumeSpecName: "home") pod "abfc350c-7622-4b50-9c48-271d99de2d78" (UID: "abfc350c-7622-4b50-9c48-271d99de2d78"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:32:23.215526 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215410    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-home\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:23.215526 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215428    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-model-cache\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:23.215526 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.215447    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-tmp-dir\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:23.217346 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.217320    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abfc350c-7622-4b50-9c48-271d99de2d78-kube-api-access-vlvck" (OuterVolumeSpecName: "kube-api-access-vlvck") pod "abfc350c-7622-4b50-9c48-271d99de2d78" (UID: "abfc350c-7622-4b50-9c48-271d99de2d78"). InnerVolumeSpecName "kube-api-access-vlvck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:32:23.217554 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.217532    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abfc350c-7622-4b50-9c48-271d99de2d78-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "abfc350c-7622-4b50-9c48-271d99de2d78" (UID: "abfc350c-7622-4b50-9c48-271d99de2d78"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:32:23.217622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.217544    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-dshm" (OuterVolumeSpecName: "dshm") pod "abfc350c-7622-4b50-9c48-271d99de2d78" (UID: "abfc350c-7622-4b50-9c48-271d99de2d78"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:32:23.224669 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.224641    2562 generic.go:356] "Generic (PLEG): container finished" podID="abfc350c-7622-4b50-9c48-271d99de2d78" containerID="6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d" exitCode=0
Sep 15 13:32:23.224836 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.224683    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"
Sep 15 13:32:23.224836 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.224722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r" event={"ID":"abfc350c-7622-4b50-9c48-271d99de2d78","Type":"ContainerDied","Data":"6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d"}
Sep 15 13:32:23.224836 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.224767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r" event={"ID":"abfc350c-7622-4b50-9c48-271d99de2d78","Type":"ContainerDied","Data":"b608ef5eeb947fd1ef4599711561570648ec80b3c4b14636dc3876fd9b698fbc"}
Sep 15 13:32:23.224836 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.224787    2562 scope.go:117] "RemoveContainer" containerID="6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d"
Sep 15 13:32:23.238091 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.238065    2562 scope.go:117] "RemoveContainer" containerID="6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d"
Sep 15 13:32:23.238439 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:32:23.238419    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d\": container with ID starting with 6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d not found: ID does not exist" containerID="6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d"
Sep 15 13:32:23.238500 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.238450    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d"} err="failed to get container status \"6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d\": rpc error: code = NotFound desc = could not find container \"6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d\": container with ID starting with 6fb43b6eb6e297dfd5a6763a4b3f73563e83a2d573044f8565d96fc799804a0d not found: ID does not exist"
Sep 15 13:32:23.250652 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.250616    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"]
Sep 15 13:32:23.263133 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.263108    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-38d90f/auth-test-model-38d90f-kserve-76cf5465ff-5pz2r"]
Sep 15 13:32:23.316219 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.316186    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abfc350c-7622-4b50-9c48-271d99de2d78-dshm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:23.316219 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.316217    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlvck\" (UniqueName: \"kubernetes.io/projected/abfc350c-7622-4b50-9c48-271d99de2d78-kube-api-access-vlvck\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:23.316429 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:23.316227    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abfc350c-7622-4b50-9c48-271d99de2d78-tls-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:25.246058 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:25.246025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:25.263160 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:25.263130    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abfc350c-7622-4b50-9c48-271d99de2d78" path="/var/lib/kubelet/pods/abfc350c-7622-4b50-9c48-271d99de2d78/volumes"
Sep 15 13:32:25.317433 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:25.317400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:25.526621 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:25.526536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:26.018676 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:26.018642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:26.954556 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:26.954516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:28.007294 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:28.007256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:36.343884 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.343843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:36.345838 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.345803    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"]
Sep 15 13:32:36.348930 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.348893    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-38d90f-29824650-x9f8z"]
Sep 15 13:32:36.373060 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.373021    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"]
Sep 15 13:32:36.373309 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.373254    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54" podUID="14e24461-c9be-4e01-a13c-c108407dfc88" containerName="payload-processing" containerID="cri-o://ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7" gracePeriod=30
Sep 15 13:32:36.379990 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.379937    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"]
Sep 15 13:32:36.380335 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.380264    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4" podUID="71aae9d2-a259-43bc-bd72-287b62b8fd7a" containerName="payload-pre-processing" containerID="cri-o://35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f" gracePeriod=30
Sep 15 13:32:36.417685 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.417643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:36.485642 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.485612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:36.551075 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.551030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:36.616694 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.616650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:36.634445 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.634415    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:32:36.667910 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.667882    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:32:36.735153 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.735118    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft5p4\" (UniqueName: \"kubernetes.io/projected/14e24461-c9be-4e01-a13c-c108407dfc88-kube-api-access-ft5p4\") pod \"14e24461-c9be-4e01-a13c-c108407dfc88\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") "
Sep 15 13:32:36.735153 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.735159    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsb7f\" (UniqueName: \"kubernetes.io/projected/71aae9d2-a259-43bc-bd72-287b62b8fd7a-kube-api-access-lsb7f\") pod \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") "
Sep 15 13:32:36.735405 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.735202    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14e24461-c9be-4e01-a13c-c108407dfc88-plugins-config-volume\") pod \"14e24461-c9be-4e01-a13c-c108407dfc88\" (UID: \"14e24461-c9be-4e01-a13c-c108407dfc88\") "
Sep 15 13:32:36.735405 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.735285    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71aae9d2-a259-43bc-bd72-287b62b8fd7a-plugins-config-volume\") pod \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\" (UID: \"71aae9d2-a259-43bc-bd72-287b62b8fd7a\") "
Sep 15 13:32:36.735683 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.735658    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14e24461-c9be-4e01-a13c-c108407dfc88-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14e24461-c9be-4e01-a13c-c108407dfc88" (UID: "14e24461-c9be-4e01-a13c-c108407dfc88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:32:36.735763 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.735699    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71aae9d2-a259-43bc-bd72-287b62b8fd7a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71aae9d2-a259-43bc-bd72-287b62b8fd7a" (UID: "71aae9d2-a259-43bc-bd72-287b62b8fd7a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:32:36.737535 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.737506    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e24461-c9be-4e01-a13c-c108407dfc88-kube-api-access-ft5p4" (OuterVolumeSpecName: "kube-api-access-ft5p4") pod "14e24461-c9be-4e01-a13c-c108407dfc88" (UID: "14e24461-c9be-4e01-a13c-c108407dfc88"). InnerVolumeSpecName "kube-api-access-ft5p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:32:36.737619 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.737505    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71aae9d2-a259-43bc-bd72-287b62b8fd7a-kube-api-access-lsb7f" (OuterVolumeSpecName: "kube-api-access-lsb7f") pod "71aae9d2-a259-43bc-bd72-287b62b8fd7a" (UID: "71aae9d2-a259-43bc-bd72-287b62b8fd7a"). InnerVolumeSpecName "kube-api-access-lsb7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:32:36.836410 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.836369    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71aae9d2-a259-43bc-bd72-287b62b8fd7a-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:36.836410 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.836404    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft5p4\" (UniqueName: \"kubernetes.io/projected/14e24461-c9be-4e01-a13c-c108407dfc88-kube-api-access-ft5p4\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:36.836410 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.836414    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsb7f\" (UniqueName: \"kubernetes.io/projected/71aae9d2-a259-43bc-bd72-287b62b8fd7a-kube-api-access-lsb7f\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:36.836682 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.836423    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14e24461-c9be-4e01-a13c-c108407dfc88-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 15 13:32:36.907574 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:36.907471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:37.006499 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.006459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:37.262840 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.262797    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba7a17d8-bc4e-47c7-8d34-80b6739e4066" path="/var/lib/kubelet/pods/ba7a17d8-bc4e-47c7-8d34-80b6739e4066/volumes"
Sep 15 13:32:37.326548 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.326517    2562 generic.go:356] "Generic (PLEG): container finished" podID="71aae9d2-a259-43bc-bd72-287b62b8fd7a" containerID="35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f" exitCode=0
Sep 15 13:32:37.326714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.326571    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"
Sep 15 13:32:37.326714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.326606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4" event={"ID":"71aae9d2-a259-43bc-bd72-287b62b8fd7a","Type":"ContainerDied","Data":"35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f"}
Sep 15 13:32:37.326714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.326665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4" event={"ID":"71aae9d2-a259-43bc-bd72-287b62b8fd7a","Type":"ContainerDied","Data":"ed4c86dddaf27cc2216a46ce42a3385e9e6b045840a299536fcce32db4229582"}
Sep 15 13:32:37.326714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.326701    2562 scope.go:117] "RemoveContainer" containerID="35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f"
Sep 15 13:32:37.328252 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.328220    2562 generic.go:356] "Generic (PLEG): container finished" podID="14e24461-c9be-4e01-a13c-c108407dfc88" containerID="ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7" exitCode=0
Sep 15 13:32:37.328373 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.328250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54" event={"ID":"14e24461-c9be-4e01-a13c-c108407dfc88","Type":"ContainerDied","Data":"ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7"}
Sep 15 13:32:37.328373 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.328278    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"
Sep 15 13:32:37.328373 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.328300    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54" event={"ID":"14e24461-c9be-4e01-a13c-c108407dfc88","Type":"ContainerDied","Data":"aef9e71d94072aca5618859e0296cc5fe479ec2c77521087d4217528641e5e96"}
Sep 15 13:32:37.336882 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.336856    2562 scope.go:117] "RemoveContainer" containerID="35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f"
Sep 15 13:32:37.337232 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:32:37.337210    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f\": container with ID starting with 35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f not found: ID does not exist" containerID="35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f"
Sep 15 13:32:37.337326 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.337240    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f"} err="failed to get container status \"35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f\": rpc error: code = NotFound desc = could not find container \"35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f\": container with ID starting with 35966dae87805bb559221a3fa822f1d7d1ffd6acc5dc2d9baa49fbfeedcecd6f not found: ID does not exist"
Sep 15 13:32:37.337326 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.337257    2562 scope.go:117] "RemoveContainer" containerID="ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7"
Sep 15 13:32:37.346714 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.346689    2562 scope.go:117] "RemoveContainer" containerID="ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7"
Sep 15 13:32:37.347152 ip-10-0-143-85 kubenswrapper[2562]: E0915 13:32:37.347124    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7\": container with ID starting with ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7 not found: ID does not exist" containerID="ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7"
Sep 15 13:32:37.347220 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.347167    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7"} err="failed to get container status \"ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7\": rpc error: code = NotFound desc = could not find container \"ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7\": container with ID starting with ff28547bdadbb370523f8fc98de9426c5cd08eb163f0f860e61819bcdb7944c7 not found: ID does not exist"
Sep 15 13:32:37.348030 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.348012    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"]
Sep 15 13:32:37.353659 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.353627    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-38d90f-85f4d8fd7d-ql5x4"]
Sep 15 13:32:37.366358 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.366315    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"]
Sep 15 13:32:37.370777 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:37.370743    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-38d90f-6db664bc7-p7k54"]
Sep 15 13:32:39.263060 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:39.263021    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14e24461-c9be-4e01-a13c-c108407dfc88" path="/var/lib/kubelet/pods/14e24461-c9be-4e01-a13c-c108407dfc88/volumes"
Sep 15 13:32:39.263515 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:39.263414    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71aae9d2-a259-43bc-bd72-287b62b8fd7a" path="/var/lib/kubelet/pods/71aae9d2-a259-43bc-bd72-287b62b8fd7a/volumes"
Sep 15 13:32:43.364271 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:43.364234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:43.457377 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:43.457340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:32:43.616702 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:32:43.616596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:34:23.427258 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:34:23.427174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:34:23.502519 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:34:23.502476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:34:55.564592 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:34:55.564568    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:34:55.573627 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:34:55.573604    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:36:55.942899 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:36:55.942857    2562 scope.go:117] "RemoveContainer" containerID="68986dc0dd86c709ffc319bca10528c9ee4855de82d41feb97104a019afdd09c"
Sep 15 13:37:30.615441 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:37:30.615344    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:37:32.061502 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:37:32.061461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:38:20.054332 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:38:20.054281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:38:21.433730 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:38:21.433690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:38:55.974003 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:38:55.973912    2562 scope.go:117] "RemoveContainer" containerID="710e35ace350889a2dbbd462ff2fcefe3226fcdd39eadd7ad91b6eaf993dccbc"
Sep 15 13:39:25.657350 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:25.657316    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-648d6585f5-nll68_79057d7a-8b7c-4e50-97b2-fa61646845db/authorino/0.log"
Sep 15 13:39:31.256488 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:31.256458    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-phl5g_1dc6db00-906e-412e-a058-3aec25177aa9/server/0.log"
Sep 15 13:39:31.753803 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:31.753776    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-z4rkw_a353736b-020d-49ac-bc12-3c41d7515d17/copy-manifests/0.log"
Sep 15 13:39:31.760638 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:31.760613    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-z4rkw_a353736b-020d-49ac-bc12-3c41d7515d17/manager/0.log"
Sep 15 13:39:32.684039 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:32.684013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824620-wbdxh_1cb2f50f-6a20-4855-a740-912b434450c9/cleanup/0.log"
Sep 15 13:39:32.791101 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:32.791068    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824635-tvwwt_6ef0e692-0903-4479-893f-627fd59261ff/cleanup/0.log"
Sep 15 13:39:32.904605 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:32.904572    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824650-xr64f_283450c4-dda7-4651-91b1-40caf96399e6/cleanup/0.log"
Sep 15 13:39:33.129194 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:33.129112    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-a-528f6b-29824635-g4drz_8379fe2b-ceae-4ac7-bed3-134e195f3121/cleanup/0.log"
Sep 15 13:39:33.348982 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:33.348941    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-1c35dd-29824620-vwt4q_46d744a5-99e7-4d34-8be0-e039b0d1827b/cleanup/0.log"
Sep 15 13:39:33.458425 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:33.458391    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-1c35dd-29824635-6gf4m_92f8d0c7-e371-4b37-b9cd-8843c53351ca/cleanup/0.log"
Sep 15 13:39:33.566260 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:33.566228    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-1c35dd-29824650-5qpq7_25ee6ce8-b920-4392-9ca9-8544ded01058/cleanup/0.log"
Sep 15 13:39:33.887732 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:33.887647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-worker-w0-6c9f0b-29824650-2lfz6_91f74c3f-c8af-4060-bfdc-cb901005e7a4/cleanup/0.log"
Sep 15 13:39:33.998671 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:33.998640    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824620-nbjf5_62bcbdd7-cdb4-4c2d-a0c0-61b14e957e96/cleanup/0.log"
Sep 15 13:39:34.108577 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:34.108552    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-worker-w4-2af9a3-29824635-8kmm2_8e2dbfb2-a592-4f38-9bec-00877ec77f42/cleanup/0.log"
Sep 15 13:39:35.104502 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:35.104469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-648d6585f5-nll68_79057d7a-8b7c-4e50-97b2-fa61646845db/authorino/0.log"
Sep 15 13:39:36.461314 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:36.461284    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-nnz8j_72313d42-b2b9-4024-a745-0b84fba93f1c/kube-auth-proxy/0.log"
Sep 15 13:39:36.700002 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:36.699939    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zsbgn_c6234b8f-9049-4f77-a297-a359d40ba616/payload-pre-processing/0.log"
Sep 15 13:39:36.805945 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:36.805861    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm_5d98bcc8-73e3-4663-80c3-1f0c78154f9b/payload-pre-processing/0.log"
Sep 15 13:39:37.139992 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:37.139884    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp_b9243bf1-65f7-48e4-88ea-581ac2539cdc/payload-pre-processing/0.log"
Sep 15 13:39:37.362451 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:37.362418    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr_1208ec3b-9e64-474e-8215-b4abfedad817/payload-processing/0.log"
Sep 15 13:39:37.470199 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:37.470171    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg_2f173d2d-91dc-4268-8485-0b542e6d82f1/payload-processing/0.log"
Sep 15 13:39:37.580324 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:37.580286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5_7be8861f-ae2b-49b8-9b0f-02d0ab7a631a/payload-processing/0.log"
Sep 15 13:39:37.690116 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:37.690081    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4_80158ddc-cd5f-4cc2-be1d-3710aa7d8380/payload-processing/0.log"
Sep 15 13:39:38.486947 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:38.486915    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-h4sdl_3702dcb8-619a-4635-9da2-299a69e72c40/main/0.log"
Sep 15 13:39:38.818277 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:38.818176    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dnz7t_2cc5b859-dcff-41ca-b011-8a31ef693ee8/main/0.log"
Sep 15 13:39:45.110117 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:45.110077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:39:46.660937 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:46.660897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log" limit=1024
Sep 15 13:39:47.170877 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:47.170843    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x4ztz_4a495889-b555-4136-8810-50a9f9321749/global-pull-secret-syncer/0.log"
Sep 15 13:39:47.233346 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:47.233307    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b6z56_2011e93e-12ec-41e0-98a9-a8bdec2421f3/konnectivity-agent/0.log"
Sep 15 13:39:47.376399 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:47.376368    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-85.ec2.internal_d8fd76400f9433d06743f51faa0c5dcb/haproxy/0.log"
Sep 15 13:39:52.102097 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:52.102035    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-648d6585f5-nll68_79057d7a-8b7c-4e50-97b2-fa61646845db/authorino/0.log"
Sep 15 13:39:54.106628 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.106590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-m56ht_b01fbe78-3cfb-4aeb-9c79-b0f085f08215/monitoring-plugin/0.log"
Sep 15 13:39:54.133424 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.133391    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qptp_918d70b7-b95e-4226-bc03-b7b8f69a9f52/node-exporter/0.log"
Sep 15 13:39:54.164154 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.164128    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qptp_918d70b7-b95e-4226-bc03-b7b8f69a9f52/kube-rbac-proxy/0.log"
Sep 15 13:39:54.182887 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.182865    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qptp_918d70b7-b95e-4226-bc03-b7b8f69a9f52/init-textfile/0.log"
Sep 15 13:39:54.374005 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.373903    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-49gb5_90ebcf29-821c-4c1a-b80f-d0cded64a993/kube-rbac-proxy-main/0.log"
Sep 15 13:39:54.399085 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.399057    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-49gb5_90ebcf29-821c-4c1a-b80f-d0cded64a993/kube-rbac-proxy-self/0.log"
Sep 15 13:39:54.429486 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.429455    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-49gb5_90ebcf29-821c-4c1a-b80f-d0cded64a993/openshift-state-metrics/0.log"
Sep 15 13:39:54.764926 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:54.764888    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-rjx45_2dbaa567-2f8d-4e2e-b87d-bf37583d3b33/prometheus-operator-admission-webhook/0.log"
Sep 15 13:39:55.608615 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:55.608590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:39:55.617357 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:55.617331    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtgfv_614d58f9-3b8a-4a06-9eae-a294ff8ffa01/ovn-acl-logging/0.log"
Sep 15 13:39:56.470014 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:56.469984    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-gddk5_2b3ff397-8f4f-4936-82eb-33c4307340fd/networking-console-plugin/0.log"
Sep 15 13:39:57.146294 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146251    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"]
Sep 15 13:39:57.146823 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146802    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f692ff0-699e-48c5-8e4d-0d36971f84a2" containerName="revoke-keys"
Sep 15 13:39:57.146908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146827    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f692ff0-699e-48c5-8e4d-0d36971f84a2" containerName="revoke-keys"
Sep 15 13:39:57.146908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146844    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e059f95b-9c01-4a4e-9f15-d185aeff0425" containerName="payload-pre-processing"
Sep 15 13:39:57.146908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146853    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e059f95b-9c01-4a4e-9f15-d185aeff0425" containerName="payload-pre-processing"
Sep 15 13:39:57.146908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146875    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364d6b31-015e-4df6-a899-5b46fd271cc4" containerName="payload-processing"
Sep 15 13:39:57.146908 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146885    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="364d6b31-015e-4df6-a899-5b46fd271cc4" containerName="payload-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146909    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abfc350c-7622-4b50-9c48-271d99de2d78" containerName="main"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146917    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="abfc350c-7622-4b50-9c48-271d99de2d78" containerName="main"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146928    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e24461-c9be-4e01-a13c-c108407dfc88" containerName="payload-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146937    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e24461-c9be-4e01-a13c-c108407dfc88" containerName="payload-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146950    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71aae9d2-a259-43bc-bd72-287b62b8fd7a" containerName="payload-pre-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.146958    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="71aae9d2-a259-43bc-bd72-287b62b8fd7a" containerName="payload-pre-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.147079    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14e24461-c9be-4e01-a13c-c108407dfc88" containerName="payload-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.147092    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="71aae9d2-a259-43bc-bd72-287b62b8fd7a" containerName="payload-pre-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.147101    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e059f95b-9c01-4a4e-9f15-d185aeff0425" containerName="payload-pre-processing"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.147112    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="abfc350c-7622-4b50-9c48-271d99de2d78" containerName="main"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.147120    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f692ff0-699e-48c5-8e4d-0d36971f84a2" containerName="revoke-keys"
Sep 15 13:39:57.147188 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.147128    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="364d6b31-015e-4df6-a899-5b46fd271cc4" containerName="payload-processing"
Sep 15 13:39:57.150506 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.150483    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.153079 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.153049    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvzq\"/\"kube-root-ca.crt\""
Sep 15 13:39:57.154242 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.154223    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpvzq\"/\"default-dockercfg-4dw7n\""
Sep 15 13:39:57.154363 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.154223    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvzq\"/\"openshift-service-ca.crt\""
Sep 15 13:39:57.163952 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.163913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"]
Sep 15 13:39:57.254370 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.254330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrfsz\" (UniqueName: \"kubernetes.io/projected/a69c1c69-83cc-48d2-92ff-66847f78e18c-kube-api-access-jrfsz\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.254370 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.254374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-podres\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.254586 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.254464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-proc\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.254586 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.254485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-lib-modules\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.254586 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.254510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-sys\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355159 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-proc\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355159 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-lib-modules\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-sys\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrfsz\" (UniqueName: \"kubernetes.io/projected/a69c1c69-83cc-48d2-92ff-66847f78e18c-kube-api-access-jrfsz\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-podres\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-proc\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-sys\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355339    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-lib-modules\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.355404 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.355357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a69c1c69-83cc-48d2-92ff-66847f78e18c-podres\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.364161 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.364131    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrfsz\" (UniqueName: \"kubernetes.io/projected/a69c1c69-83cc-48d2-92ff-66847f78e18c-kube-api-access-jrfsz\") pod \"perf-node-gather-daemonset-tm2gg\" (UID: \"a69c1c69-83cc-48d2-92ff-66847f78e18c\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.469920 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.469885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:57.610096 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.610068    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d848f7b8f-csn67_5df09846-c7e0-46ea-8579-58b1a80385d3/console/0.log"
Sep 15 13:39:57.648401 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.648366    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-k66zp_71cd4cc7-fbc6-435a-b8f4-43e41faf6e97/download-server/0.log"
Sep 15 13:39:57.745561 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.745530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"]
Sep 15 13:39:57.747115 ip-10-0-143-85 kubenswrapper[2562]: W0915 13:39:57.747084    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda69c1c69_83cc_48d2_92ff_66847f78e18c.slice/crio-442b1aeccb9d5269f56834001899e894b554ab19a39001af26a79c6ebabbb1de WatchSource:0}: Error finding container 442b1aeccb9d5269f56834001899e894b554ab19a39001af26a79c6ebabbb1de: Status 404 returned error can't find the container with id 442b1aeccb9d5269f56834001899e894b554ab19a39001af26a79c6ebabbb1de
Sep 15 13:39:57.999084 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.998988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg" event={"ID":"a69c1c69-83cc-48d2-92ff-66847f78e18c","Type":"ContainerStarted","Data":"f5f198b02217690095bc8fd329aa83bab2770cc6bf4b30a450d38c9d0903b301"}
Sep 15 13:39:57.999084 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.999045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg" event={"ID":"a69c1c69-83cc-48d2-92ff-66847f78e18c","Type":"ContainerStarted","Data":"442b1aeccb9d5269f56834001899e894b554ab19a39001af26a79c6ebabbb1de"}
Sep 15 13:39:57.999084 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:57.999073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:39:58.016998 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:58.016822    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg" podStartSLOduration=1.016799769 podStartE2EDuration="1.016799769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:58.016473171 +0000 UTC m=+3303.379204770" watchObservedRunningTime="2026-09-15 13:39:58.016799769 +0000 UTC m=+3303.379531367"
Sep 15 13:39:59.395127 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:59.395104    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sv54n_47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1/dns/0.log"
Sep 15 13:39:59.412666 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:59.412634    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sv54n_47b6fb0c-3c65-46f7-b1e8-1ac7c4af13b1/kube-rbac-proxy/0.log"
Sep 15 13:39:59.526084 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:39:59.526056    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qq2q2_ebdf428a-ff17-4bba-a692-f9d171fa14ec/dns-node-resolver/0.log"
Sep 15 13:40:00.048343 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:00.048313    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7665f8bd6f-4gwhz_01f35f51-1f55-4a87-b712-e39d4464ed3e/registry/0.log"
Sep 15 13:40:00.068693 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:00.068661    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6r25_307a6080-bd75-4ed9-83c5-a4fb4b919a7d/node-ca/0.log"
Sep 15 13:40:01.374904 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.374870    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-nnz8j_72313d42-b2b9-4024-a745-0b84fba93f1c/kube-auth-proxy/0.log"
Sep 15 13:40:01.431513 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.431486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zsbgn_c6234b8f-9049-4f77-a297-a359d40ba616/payload-pre-processing/0.log"
Sep 15 13:40:01.452814 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.452786    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm_5d98bcc8-73e3-4663-80c3-1f0c78154f9b/payload-pre-processing/0.log"
Sep 15 13:40:01.522627 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.522589    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp_b9243bf1-65f7-48e4-88ea-581ac2539cdc/payload-pre-processing/0.log"
Sep 15 13:40:01.573681 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.573653    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr_1208ec3b-9e64-474e-8215-b4abfedad817/payload-processing/0.log"
Sep 15 13:40:01.592797 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.592761    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg_2f173d2d-91dc-4268-8485-0b542e6d82f1/payload-processing/0.log"
Sep 15 13:40:01.615762 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.615727    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5_7be8861f-ae2b-49b8-9b0f-02d0ab7a631a/payload-processing/0.log"
Sep 15 13:40:01.634680 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:01.634579    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4_80158ddc-cd5f-4cc2-be1d-3710aa7d8380/payload-processing/0.log"
Sep 15 13:40:02.627372 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:02.627333    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rthbg_e89219d5-94e0-4b6d-9049-8ec43b094910/serve-healthcheck-canary/0.log"
Sep 15 13:40:03.261562 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:03.261529    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb7jf_628d798d-b2be-4827-92a1-662daf8f7d32/kube-rbac-proxy/0.log"
Sep 15 13:40:03.278439 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:03.278413    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb7jf_628d798d-b2be-4827-92a1-662daf8f7d32/exporter/0.log"
Sep 15 13:40:03.297002 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:03.296977    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb7jf_628d798d-b2be-4827-92a1-662daf8f7d32/extractor/0.log"
Sep 15 13:40:04.015466 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:04.015438    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-tm2gg"
Sep 15 13:40:05.746690 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:05.746659    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-phl5g_1dc6db00-906e-412e-a058-3aec25177aa9/server/0.log"
Sep 15 13:40:06.011783 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:06.011758    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-z4rkw_a353736b-020d-49ac-bc12-3c41d7515d17/manager/0.log"
Sep 15 13:40:06.036998 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:06.036952    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-z4rkw_a353736b-020d-49ac-bc12-3c41d7515d17/copy-manifests/0.log"
Sep 15 13:40:07.484689 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:07.484661    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c5fdc7d8d-lhcsm_7532f9b4-39b6-44d8-ab5f-b30931cddb20/manager/0.log"
Sep 15 13:40:07.507231 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:07.507198    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5fjrt_09638324-98e3-4a71-b97c-38004a2d3ac6/openshift-lws-operator/0.log"
Sep 15 13:40:07.974289 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:07.974259    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-nnz8j_72313d42-b2b9-4024-a745-0b84fba93f1c/kube-auth-proxy/0.log"
Sep 15 13:40:08.014840 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:08.014808    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zsbgn_c6234b8f-9049-4f77-a297-a359d40ba616/payload-pre-processing/0.log"
Sep 15 13:40:08.028651 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:08.028616    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm_5d98bcc8-73e3-4663-80c3-1f0c78154f9b/payload-pre-processing/0.log"
Sep 15 13:40:08.068342 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:08.068308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp_b9243bf1-65f7-48e4-88ea-581ac2539cdc/payload-pre-processing/0.log"
Sep 15 13:40:08.099715 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:08.099681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr_1208ec3b-9e64-474e-8215-b4abfedad817/payload-processing/0.log"
Sep 15 13:40:08.113002 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:08.112947    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg_2f173d2d-91dc-4268-8485-0b542e6d82f1/payload-processing/0.log"
Sep 15 13:40:08.132575 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:08.132545    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5_7be8861f-ae2b-49b8-9b0f-02d0ab7a631a/payload-processing/0.log"
Sep 15 13:40:08.146566 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:08.146533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4_80158ddc-cd5f-4cc2-be1d-3710aa7d8380/payload-processing/0.log"
Sep 15 13:40:10.100622 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.100590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-nnz8j_72313d42-b2b9-4024-a745-0b84fba93f1c/kube-auth-proxy/0.log"
Sep 15 13:40:10.150661 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.150626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zsbgn_c6234b8f-9049-4f77-a297-a359d40ba616/payload-pre-processing/0.log"
Sep 15 13:40:10.165417 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.165390    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-528f6b-79fdcd9958-dp2fm_5d98bcc8-73e3-4663-80c3-1f0c78154f9b/payload-pre-processing/0.log"
Sep 15 13:40:10.214725 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.214693    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-2af9a3-76dcb678bb-rt6hp_b9243bf1-65f7-48e4-88ea-581ac2539cdc/payload-pre-processing/0.log"
Sep 15 13:40:10.246426 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.246396    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-a-528f6b-945bcbc5f-rvkxr_1208ec3b-9e64-474e-8215-b4abfedad817/payload-processing/0.log"
Sep 15 13:40:10.259838 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.259808    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-1c35dd-7cbcdfd7cf-n7jxg_2f173d2d-91dc-4268-8485-0b542e6d82f1/payload-processing/0.log"
Sep 15 13:40:10.278239 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.278204    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-6c9f0b-68d6978567-dqpw5_7be8861f-ae2b-49b8-9b0f-02d0ab7a631a/payload-processing/0.log"
Sep 15 13:40:10.298467 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:10.298436    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-2af9a3-6c98b44879-z8xs4_80158ddc-cd5f-4cc2-be1d-3710aa7d8380/payload-processing/0.log"
Sep 15 13:40:12.987232 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:12.987199    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-4rxsq_0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c/migrator/0.log"
Sep 15 13:40:13.003912 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:13.003883    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-4rxsq_0c2ff715-5c37-4681-a2b3-4d03d9f9ef8c/graceful-termination/0.log"
Sep 15 13:40:14.425163 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:14.425133    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcqmb_c75e3fc2-378d-4bfd-80f2-bbdf01206c71/kube-multus-additional-cni-plugins/0.log"
Sep 15 13:40:14.443069 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:14.443030    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcqmb_c75e3fc2-378d-4bfd-80f2-bbdf01206c71/egress-router-binary-copy/0.log"
Sep 15 13:40:14.461666 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:14.461626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcqmb_c75e3fc2-378d-4bfd-80f2-bbdf01206c71/cni-plugins/0.log"
Sep 15 13:40:14.479558 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:14.479529    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcqmb_c75e3fc2-378d-4bfd-80f2-bbdf01206c71/bond-cni-plugin/0.log"
Sep 15 13:40:14.496074 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:14.496046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcqmb_c75e3fc2-378d-4bfd-80f2-bbdf01206c71/routeoverride-cni/0.log"
Sep 15 13:40:14.512372 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:14.512348    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcqmb_c75e3fc2-378d-4bfd-80f2-bbdf01206c71/whereabouts-cni-bincopy/0.log"
Sep 15 13:40:14.528923 ip-10-0-143-85 kubenswrapper[2562]: I0915 13:40:14.528894    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcqmb_c75e3fc2-378d-4bfd-80f2-bbdf01206c71/whereabouts-cni/0.log"