Sep 11 17:44:54.468442 ip-10-0-140-186 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 17:44:54.899248 ip-10-0-140-186 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:44:54.899248 ip-10-0-140-186 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 17:44:54.899248 ip-10-0-140-186 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:44:54.899248 ip-10-0-140-186 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 17:44:54.899248 ip-10-0-140-186 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:44:54.899980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.899333    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 17:44:54.904596 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904573    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904601    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904605    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904609    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904612    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904615    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904618    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904621    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904625    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904628    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904631    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904634    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904639    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904643    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904646    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904649    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904652    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904656    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:44:54.904650 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904659    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904662    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904665    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904669    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904672    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904675    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904679    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904681    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904684    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904687    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904689    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904692    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904694    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904697    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904700    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904703    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904706    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904708    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904711    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904713    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:44:54.905076 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904716    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904719    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904723    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904726    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904730    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904733    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904735    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904738    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904740    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904743    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904745    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904748    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904751    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904754    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904758    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904761    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904763    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904766    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904769    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904771    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:44:54.905601 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904774    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904777    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904780    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904782    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904785    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904787    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904790    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904794    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904797    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904799    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904802    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904805    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904807    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904810    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904813    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904815    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904817    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904820    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904823    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904825    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:44:54.906087 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904828    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904830    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904833    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904836    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904838    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904841    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904845    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904847    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904850    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904853    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904855    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904857    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904860    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904862    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904865    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904868    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904870    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904873    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904875    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:44:54.906589 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904878    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.904880    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906430    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906439    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906443    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906446    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906449    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906452    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906455    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906457    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906460    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906463    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906465    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906468    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906472    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906476    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906479    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906482    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906484    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:44:54.907049 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906488    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906491    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906494    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906496    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906499    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906501    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906504    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906507    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906510    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906512    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906515    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906517    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906520    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906522    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906525    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906527    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906530    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906533    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906537    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:44:54.907542 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906540    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906543    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906546    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906549    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906551    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906554    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906557    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906559    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906561    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906564    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906567    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906570    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906572    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906576    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906582    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906586    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906589    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906592    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906595    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906597    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:44:54.908025 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906600    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906603    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906605    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906608    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906611    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906614    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906617    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906619    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906622    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906626    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906629    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906632    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906635    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906637    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906640    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906642    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906645    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906648    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906650    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:44:54.908537 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906653    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906655    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906658    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906660    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906663    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906665    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906669    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906672    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906674    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906677    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906680    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906682    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906685    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906688    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906690    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906693    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906695    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906697    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906700    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906703    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906705    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:44:54.909089 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906707    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906710    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.906712    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907091    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907096    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907099    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907102    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907105    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907125    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907129    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907132    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907135    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907138    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907141    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907145    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907148    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907151    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907155    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907158    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:44:54.909643 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907160    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907163    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907166    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907168    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907171    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907174    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907176    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907179    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907182    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907184    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907187    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907190    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907192    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907195    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907197    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907200    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907203    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907205    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907208    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907210    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:44:54.910107 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907213    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907215    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907218    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907221    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907224    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907227    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907230    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907232    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907235    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907237    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907240    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907243    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907245    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907248    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907251    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907253    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907256    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907258    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907261    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907264    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:44:54.910637 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907266    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907269    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907271    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907274    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907276    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907279    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907281    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907284    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907286    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907289    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907291    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907294    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907296    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907299    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907302    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907305    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907307    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907310    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907313    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907316    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:44:54.911143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907319    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907323    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907327    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907330    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907333    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907337    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907339    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907342    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907345    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907348    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907351    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907354    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907356    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907359    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907361    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907364    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907366    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907369    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907371    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:44:54.911651 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907374    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907376    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907379    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.907382    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907460    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907505    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907512    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907519    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907523    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907526    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907530    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907535    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907538    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907541    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907545    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907549    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907553    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907557    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907560    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907563    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907567    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907570    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907574    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907578    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 17:44:54.912157 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907581    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907584    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907587    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907591    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907594    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907597    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907601    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907604    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907607    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907610    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907613    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907617    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907621    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907624    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907627    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907632    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907635    2576 flags.go:64] FLAG: --enable-server="true"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907638    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907644    2576 flags.go:64] FLAG: --event-burst="100"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907648    2576 flags.go:64] FLAG: --event-qps="50"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907651    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907654    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907657    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907661    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 17:44:54.912728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907664    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907667    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907670    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907673    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907676    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907679    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907682    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907685    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907688    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907691    2576 flags.go:64] FLAG: --feature-gates=""
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907694    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907698    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907701    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907704    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907707    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907710    2576 flags.go:64] FLAG: --help="false"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907713    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-186.ec2.internal"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907716    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907719    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907722    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907726    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907729    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907732    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 17:44:54.913375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907736    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907739    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907743    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907747    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907750    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907753    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907756    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907759    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907762    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907765    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907767    2576 flags.go:64] FLAG: --lock-file=""
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907770    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907773    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907776    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907782    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907785    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907788    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907791    2576 flags.go:64] FLAG: --logging-format="text"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907794    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907797    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907800    2576 flags.go:64] FLAG: --manifest-url=""
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907803    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907808    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907811    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907815    2576 flags.go:64] FLAG: --max-pods="110"
Sep 11 17:44:54.913964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907818    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907821    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907824    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907827    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907830    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907833    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907845    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907855    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907858    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907862    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907866    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907869    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907875    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907878    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907881    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907884    2576 flags.go:64] FLAG: --port="10250"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907887    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907890    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef378ef2941aea6e"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907893    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907896    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907899    2576 flags.go:64] FLAG: --register-node="true"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907902    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907906    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907909    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 11 17:44:54.914588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907912    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907915    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907918    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907922    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907925    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907927    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907930    2576 flags.go:64] FLAG: --runonce="false"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907933    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907937    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907940    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907943    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907946    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907949    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907952    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907956    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907960    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907964    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907966    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907969    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907974    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907977    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907980    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907985    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907988    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907991    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 17:44:54.915210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907995    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.907998    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908001    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908004    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908007    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908010    2576 flags.go:64] FLAG: --v="2"
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908014    2576 flags.go:64] FLAG: --version="false"
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908018    2576 flags.go:64] FLAG: --vmodule=""
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908022    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.908025    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908155    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908160    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908163    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908166    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908169    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908173    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908177    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908180    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908183    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908186    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908189    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:44:54.915859 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908192    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908196    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908199    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908203    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908206    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908210    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908213    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908216    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908219    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908222    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908225    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908227    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908230    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908233    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908235    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908238    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908240    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908243    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908246    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908249    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:44:54.916407 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908251    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908254    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908256    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908259    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908261    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908264    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908267    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908269    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908272    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908274    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908277    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908280    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908282    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908285    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908288    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908291    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908293    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908297    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908300    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908302    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:44:54.916935 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908305    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908310    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908312    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908315    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908318    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908321    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908323    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908326    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908329    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908331    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908334    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908337    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908339    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908343    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908347    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908350    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908353    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908355    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908358    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:44:54.917805 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908361    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908363    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908366    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908369    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908371    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908374    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908377    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908380    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908383    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908385    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908390    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908392    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908395    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908398    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908400    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908403    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908406    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908408    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908411    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908413    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:44:54.918473 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908416    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908418    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908421    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908423    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908426    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908429    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908431    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908434    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.908437    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:44:54.918969 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.909202    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:44:54.919218 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.919058    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 17:44:54.919218 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.919078    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 17:44:54.920084 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.920071    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 17:44:54.920134 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.920083    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 17:44:54.920165 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920161    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920167    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920170    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920174    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920178    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920181    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920184    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920187    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920189    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920193    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920195    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920198    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920200    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:44:54.920198 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920203    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920206    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920209    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920212    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920214    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920217    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920220    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920222    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920225    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920228    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920231    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920233    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920236    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920239    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920243    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920248    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920251    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920254    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920256    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920259    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:44:54.920505 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920262    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920265    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920267    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920270    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920272    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920275    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920278    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920280    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920283    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920286    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920288    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920292    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920294    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920297    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920301    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920304    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920307    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920310    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920313    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:44:54.921009 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920315    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920318    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920321    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920324    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920326    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920329    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920332    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920334    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920337    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920339    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920342    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920346    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920349    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920352    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920355    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920358    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920362    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920365    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920368    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:44:54.921679 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920371    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920373    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920376    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920379    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920381    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920384    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920387    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920389    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920394    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920397    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920401    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920403    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920406    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920409    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920411    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920414    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920417    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920419    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920422    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920425    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:44:54.922157 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920427    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920430    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920433    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920435    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920438    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920440    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920443    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920445    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.920451    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920602    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920608    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920611    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920615    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920618    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920620    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:44:54.922654 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920624    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920627    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920630    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920633    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920636    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920639    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920643    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920646    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920649    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920651    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920654    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920657    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920660    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920663    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920665    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920670    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920674    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920677    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920680    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:44:54.923031 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920683    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920687    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920690    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920693    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920696    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920699    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920701    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920704    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920707    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920709    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920712    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920714    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920717    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920719    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920722    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920724    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920727    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920730    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920733    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920735    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:44:54.923510 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920739    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920741    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920744    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920747    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920749    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920752    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920754    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920757    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920760    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920763    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920765    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920768    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920771    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920773    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920776    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920778    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920781    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920783    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920786    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:44:54.924002 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920788    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920791    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920793    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920796    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920799    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920801    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920804    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920806    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920809    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920811    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920814    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920816    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920819    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920822    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920825    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920828    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920831    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920833    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920836    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920838    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:44:54.924489 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920842    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920845    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920848    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920851    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920853    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920856    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920859    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920861    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920864    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920866    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920869    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920871    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920874    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920877    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:54.920879    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:44:54.924985 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.920885    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:44:54.925378 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.921023    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 17:44:54.925378 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.923592    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 17:44:54.925378 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.924622    2576 server.go:1019] "Starting client certificate rotation"
Sep 11 17:44:54.925378 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.924728    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 17:44:54.925378 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.924765    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 17:44:54.927584 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.927566    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 17:44:54.928759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.928740    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 17:44:54.942581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.942555    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 11 17:44:54.946797 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.946777    2576 log.go:25] "Validated CRI v1 image API"
Sep 11 17:44:54.947781 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.947763    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 17:44:54.951287 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.951264    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d5be185d-3be0-4479-8579-6fe592f71dd2:/dev/nvme0n1p4 ef06511c-9091-48b5-ad0d-0666fbba4ec5:/dev/nvme0n1p3]
Sep 11 17:44:54.951370 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.951284    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 17:44:54.955954 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.955927    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 17:44:54.957321 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.957182    2576 manager.go:216] Machine: {Timestamp:2026-09-11 17:44:54.955603468 +0000 UTC m=+0.374701371 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2500006 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec261ad39b9509764b32492d041cb64d SystemUUID:ec261ad3-9b95-0976-4b32-492d041cb64d BootID:a31e54fa-8216-45bf-9170-f580bec172e6 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:82:c2:b2:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:82:c2:b2:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:24:fb:58:8d:17 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 17:44:54.957321 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.957317    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 17:44:54.957439 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.957405    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 17:44:54.962052 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.962021    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 17:44:54.962219 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.962051    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 17:44:54.962953 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.962941    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 17:44:54.962985 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.962955    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 17:44:54.962985 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.962963    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 17:44:54.963642 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.963632    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 17:44:54.964870 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.964857    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 17:44:54.969557 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.969540    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 17:44:54.969693 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.969683    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 17:44:54.969734 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.969716    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 17:44:54.969734 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.969733    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 17:44:54.969791 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.969751    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 17:44:54.969791 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.969760    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 11 17:44:54.969791 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.969771    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 17:44:54.970182 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.970168    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 17:44:54.970243 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.970189    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 17:44:54.972627 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.972610    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 17:44:54.975714 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.975699    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 17:44:54.975760 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.975740    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 17:44:54.977807 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977796    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 17:44:54.977858 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977814    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 17:44:54.977858 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977819    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 17:44:54.977858 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977825    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 17:44:54.977858 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977834    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 17:44:54.977858 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977840    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 17:44:54.977858 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977857    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 17:44:54.978005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977864    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 17:44:54.978005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977870    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 17:44:54.978005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977876    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 17:44:54.978005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977885    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 17:44:54.978005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.977891    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 17:44:54.979587 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.979576    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 17:44:54.979587 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.979587    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 17:44:54.980554 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.980536    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g96wv"
Sep 11 17:44:54.981842 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:54.981820    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 17:44:54.981915 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:54.981821    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 17:44:54.983719 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.983705    2576 server.go:1268] "Started kubelet"
Sep 11 17:44:54.983905 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.983825    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 17:44:54.984082 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.984018    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 17:44:54.984162 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.984151    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 17:44:54.984629 ip-10-0-140-186 systemd[1]: Started Kubernetes Kubelet.
Sep 11 17:44:54.986058 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.985864    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 17:44:54.986267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.986219    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 17:44:54.988166 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:54.988146    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 17:44:54.989708 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.989693    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g96wv"
Sep 11 17:44:54.991505 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.991487    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 17:44:54.992707 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:54.991573    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-186.ec2.internal.18d455423edafb78  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-186.ec2.internal,UID:ip-10-0-140-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-186.ec2.internal,},FirstTimestamp:2026-09-11 17:44:54.983670648 +0000 UTC m=+0.402768552,LastTimestamp:2026-09-11 17:44:54.983670648 +0000 UTC m=+0.402768552,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-186.ec2.internal,}"
Sep 11 17:44:54.994148 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.994129    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 17:44:54.994822 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.994805    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 17:44:54.994957 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:54.994936    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:54.995634 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995614    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 17:44:54.995634 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995622    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 17:44:54.995780 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995642    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 17:44:54.995780 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995641    2576 factory.go:55] Registering systemd factory
Sep 11 17:44:54.995780 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995660    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 11 17:44:54.995884 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995798    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 17:44:54.995884 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995806    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 17:44:54.995998 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995981    2576 factory.go:153] Registering CRI-O factory
Sep 11 17:44:54.995998 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.995997    2576 factory.go:223] Registration of the crio container factory successfully
Sep 11 17:44:54.996096 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.996076    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 17:44:54.996336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.996128    2576 factory.go:103] Registering Raw factory
Sep 11 17:44:54.996406 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.996350    2576 manager.go:1196] Started watching for new ooms in manager
Sep 11 17:44:54.996879 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:54.996860    2576 manager.go:349] Starting recovery of all containers
Sep 11 17:44:54.998070 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:54.998009    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 17:44:54.998070 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:54.998031    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 17:44:55.008291 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.008261    2576 manager.go:354] Recovery completed
Sep 11 17:44:55.008827 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.008795    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 17:44:55.009738 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.009714    2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 17:44:55.012960 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.012946    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:44:55.014993 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.014974    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:44:55.015048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.015011    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:44:55.015048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.015029    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:44:55.015656 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.015641    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 17:44:55.015656 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.015654    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 17:44:55.015749 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.015670    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 17:44:55.015749 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.015646    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:44:55.016407 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.016393    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:44:55.016468 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.016420    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:44:55.016468 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.016430    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:44:55.017789 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.017777    2576 policy_none.go:49] "None policy: Start"
Sep 11 17:44:55.017829 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.017794    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 17:44:55.017829 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.017804    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 17:44:55.019823 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.019813    2576 policy_none.go:47] "Start"
Sep 11 17:44:55.060803 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.060775    2576 manager.go:337] "Starting Device Plugin manager"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.060824    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.060838    2576 server.go:87] "Starting device plugin registration server"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.061241    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.061255    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.061347    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.061426    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.061433    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.061962    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 17:44:55.086449 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.062011    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.101258 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.101231    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 17:44:55.101396 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.101285    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 17:44:55.101396 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.101312    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 17:44:55.101396 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.101368    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 17:44:55.103380 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.103361    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:44:55.161651 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.161608    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:44:55.162648 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.162632    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:44:55.162746 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.162676    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:44:55.162746 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.162688    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:44:55.162746 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.162712    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.171319 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.171300    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.171444 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.171332    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-186.ec2.internal\": node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.190895 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.190863    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.202346 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.202305    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"]
Sep 11 17:44:55.202425 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.202401    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:44:55.204029 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.204013    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:44:55.204097 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.204046    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:44:55.204097 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.204058    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:44:55.206408 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.206396    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:44:55.206525 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.206512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.206560 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.206540    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:44:55.207250 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.207235    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:44:55.207326 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.207262    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:44:55.207326 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.207272    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:44:55.207326 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.207242    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:44:55.207409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.207332    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:44:55.207409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.207343    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:44:55.209501 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.209486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.209549 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.209511    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:44:55.210237 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.210223    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:44:55.210306 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.210243    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:44:55.210306 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.210252    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:44:55.241995 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.241969    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-186.ec2.internal\" not found" node="ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.246669 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.246647    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-186.ec2.internal\" not found" node="ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.291402 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.291366    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.297745 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.297721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b68d30b92775388d02c8d83f819b9cd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"b68d30b92775388d02c8d83f819b9cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.297881 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.297751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b68d30b92775388d02c8d83f819b9cd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"b68d30b92775388d02c8d83f819b9cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.297881 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.297774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7d2b684ad7d44a72bc24378b6f38ea2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-186.ec2.internal\" (UID: \"f7d2b684ad7d44a72bc24378b6f38ea2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.391958 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.391876    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.398884 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.398852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b68d30b92775388d02c8d83f819b9cd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"b68d30b92775388d02c8d83f819b9cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.398995 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.398888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7d2b684ad7d44a72bc24378b6f38ea2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-186.ec2.internal\" (UID: \"f7d2b684ad7d44a72bc24378b6f38ea2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.398995 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.398908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b68d30b92775388d02c8d83f819b9cd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"b68d30b92775388d02c8d83f819b9cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.398995 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.398947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7d2b684ad7d44a72bc24378b6f38ea2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-186.ec2.internal\" (UID: \"f7d2b684ad7d44a72bc24378b6f38ea2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.398995 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.398947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b68d30b92775388d02c8d83f819b9cd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"b68d30b92775388d02c8d83f819b9cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.398995 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.398968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b68d30b92775388d02c8d83f819b9cd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"b68d30b92775388d02c8d83f819b9cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.492361 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.492321    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.544908 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.544875    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.549965 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.549934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.593467 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.593437    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.694061 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.693964    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.794533 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.794498    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.894617 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.894584    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:44:55.894617 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:55.894599    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found"
Sep 11 17:44:55.895891 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.895875    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.906390 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.906366    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 17:44:55.907980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.907964    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"
Sep 11 17:44:55.917294 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.917279    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 17:44:55.924407 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.924388    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 17:44:55.924550 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.924530    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 17:44:55.924588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.924570    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 17:44:55.970712 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.970650    2576 apiserver.go:52] "Watching apiserver"
Sep 11 17:44:55.987283 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.987253    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 17:44:55.988458 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.988422    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xh94l","openshift-network-diagnostics/network-check-target-lgqdb","openshift-network-operator/iptables-alerter-r8c67","openshift-ovn-kubernetes/ovnkube-node-4mlbg","kube-system/global-pull-secret-syncer-zjmng","kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh","openshift-cluster-node-tuning-operator/tuned-srgls","openshift-dns/node-resolver-nvqd8","openshift-image-registry/node-ca-xz5xc","kube-system/konnectivity-agent-kfn8z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-8w7wb","openshift-multus/multus-cqfn8"]
Sep 11 17:44:55.991169 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.991147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:55.993403 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.993384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:55.993670 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.993646    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 17:44:55.993776 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.993699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 17:44:55.993776 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.993761    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jdmvx\""
Sep 11 17:44:55.993881 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.993815    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 17:44:55.994215 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.994199    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 17:44:55.995593 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.995573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:55.995691 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.995594    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 17:44:55.996079 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.996062    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 17:44:55.996170 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.996085    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 17:44:55.996269 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.996254    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 17:44:55.996717 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.996699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 17:44:55.996813 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.996732    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8bgjb\""
Sep 11 17:44:55.997782 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.997766    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 17:44:55.997872 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.997786    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:44:55.998030 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.998010    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:55.998030 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.998024    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 17:44:55.998195 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.998024    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s2bzh\""
Sep 11 17:44:55.998743 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.998707    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 17:39:56 +0000 UTC" deadline="2028-05-11 08:18:34.2925779 +0000 UTC"
Sep 11 17:44:55.998792 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:55.998743    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14582h33m38.293836539s"
Sep 11 17:44:56.000316 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.000296    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:56.000406 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.000363    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 17:44:56.000406 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:56.000367    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:44:56.000505 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.000364    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 17:44:56.000649 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.000633    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 17:44:56.000731 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.000635    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8xgtg\""
Sep 11 17:44:56.001648 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-cni-netd\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.001759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.001759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.001759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-etc-selinux\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.001759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-system-cni-dir\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001769    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-var-lib-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgv67\" (UniqueName: \"kubernetes.io/projected/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-kube-api-access-rgv67\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-sys-fs\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60e0f9df-50df-4cf3-b3af-e8240edf2e21-host-slash\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-kubelet\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-systemd\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.001980 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-cni-bin\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.001993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovn-node-metrics-cert\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-ovn\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-log-socket\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-env-overrides\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dxb6\" (UniqueName: \"kubernetes.io/projected/922f186b-ae36-4073-947a-7015e1eaa33c-kube-api-access-6dxb6\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kldwp\" (UniqueName: \"kubernetes.io/projected/60e0f9df-50df-4cf3-b3af-e8240edf2e21-kube-api-access-kldwp\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovnkube-config\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovnkube-script-lib\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-registration-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60e0f9df-50df-4cf3-b3af-e8240edf2e21-iptables-alerter-script\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-systemd-units\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-run-netns\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.002409 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002400    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-cnibin\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-socket-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-device-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs95n\" (UniqueName: \"kubernetes.io/projected/c39933b4-3577-4c17-8527-cf4679aefa06-kube-api-access-qs95n\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-slash\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-etc-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-node-log\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.003101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.002880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.004952 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.004936    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 17:44:56.005053 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.005039    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jj85b\""
Sep 11 17:44:56.005619 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.005602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:56.007606 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.007588    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 17:44:56.007928 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.007902    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 17:44:56.007928 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.007924    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 17:44:56.008066 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.007904    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f6kk2\""
Sep 11 17:44:56.008319 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.008307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:56.008378 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:56.008362    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:44:56.011329 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.011313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:44:56.011418 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:56.011379    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:44:56.013959 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.013941    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:56.016587 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.016563    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 17:44:56.016702 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.016600    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:56.016702 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.016659    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 17:44:56.016702 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.016667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 17:44:56.016848 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.016735    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jtlwp\""
Sep 11 17:44:56.019180 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.019159    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k8r4w\""
Sep 11 17:44:56.019363 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.019342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.019520 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.019471    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 17:44:56.019774 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.019757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 17:44:56.021652 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.021595    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:44:56.021652 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.021635    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6q9p6\""
Sep 11 17:44:56.021855 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.021841    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 17:44:56.030474 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.030452    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-spvcf"
Sep 11 17:44:56.040641 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.040623    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-spvcf"
Sep 11 17:44:56.096717 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.096694    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 17:44:56.102970 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.102946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovnkube-script-lib\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103094 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.102984    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:56.103094 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15daa995-2638-4b45-bca3-5d2518542c0b-cni-binary-copy\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.103094 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-sys\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.103285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-var-lib-kubelet\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.103285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-registration-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.103285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/671a78d2-e9aa-4b00-aca4-f25e8f4699df-dbus\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:56.103285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-registration-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.103285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-systemd-units\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-run-netns\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-run-netns\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-systemd-units\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-cni-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-cni-bin\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15daa995-2638-4b45-bca3-5d2518542c0b-multus-daemon-config\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fnc9\" (UniqueName: \"kubernetes.io/projected/15daa995-2638-4b45-bca3-5d2518542c0b-kube-api-access-9fnc9\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-cnibin\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-socket-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-slash\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-etc-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-cnibin\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.103572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-etc-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-slash\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7xm9\" (UniqueName: \"kubernetes.io/projected/2cae0089-7c28-4f35-a755-ab5573cdf3e4-kube-api-access-x7xm9\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovnkube-script-lib\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103632    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-socket-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/345198cd-000c-4f72-9fd7-b8035c183481-serviceca\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-modprobe-d\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-cni-netd\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-netns\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysconfig\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-system-cni-dir\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgv67\" (UniqueName: \"kubernetes.io/projected/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-kube-api-access-rgv67\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-multus-certs\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-system-cni-dir\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-cni-netd\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-kubernetes\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.104128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-systemd\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-host\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-sys-fs\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.103986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-systemd\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovn-node-metrics-cert\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-system-cni-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-cnibin\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-systemd\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-sys-fs\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-tuned\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-log-socket\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-env-overrides\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-conf-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-log-socket\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb59c355-59a2-4cdc-a5d2-081a54a1bc4d-konnectivity-ca\") pod \"konnectivity-agent-kfn8z\" (UID: \"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d\") " pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-lib-modules\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dxb6\" (UniqueName: \"kubernetes.io/projected/922f186b-ae36-4073-947a-7015e1eaa33c-kube-api-access-6dxb6\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.104896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kldwp\" (UniqueName: \"kubernetes.io/projected/60e0f9df-50df-4cf3-b3af-e8240edf2e21-kube-api-access-kldwp\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cae0089-7c28-4f35-a755-ab5573cdf3e4-hosts-file\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysctl-d\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60e0f9df-50df-4cf3-b3af-e8240edf2e21-iptables-alerter-script\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104476    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-k8s-cni-cncf-io\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-kubelet\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cae0089-7c28-4f35-a755-ab5573cdf3e4-tmp-dir\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-env-overrides\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/922f186b-ae36-4073-947a-7015e1eaa33c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-socket-dir-parent\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkxr4\" (UniqueName: \"kubernetes.io/projected/345198cd-000c-4f72-9fd7-b8035c183481-kube-api-access-dkxr4\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-run\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.105601 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-device-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs95n\" (UniqueName: \"kubernetes.io/projected/c39933b4-3577-4c17-8527-cf4679aefa06-kube-api-access-qs95n\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v86fd\" (UniqueName: \"kubernetes.io/projected/f52317b8-854a-4c32-bd2d-89ad104a732a-kube-api-access-v86fd\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-device-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-node-log\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-cni-multus\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6759\" (UniqueName: \"kubernetes.io/projected/38af65b6-7677-4b7d-a606-162a530e3713-kube-api-access-r6759\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-node-log\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.104990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-etc-selinux\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-var-lib-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-etc-kubernetes\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.106076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/345198cd-000c-4f72-9fd7-b8035c183481-host\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-etc-selinux\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60e0f9df-50df-4cf3-b3af-e8240edf2e21-iptables-alerter-script\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60e0f9df-50df-4cf3-b3af-e8240edf2e21-host-slash\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60e0f9df-50df-4cf3-b3af-e8240edf2e21-host-slash\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c39933b4-3577-4c17-8527-cf4679aefa06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-kubelet\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-var-lib-openvswitch\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-cni-bin\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f52317b8-854a-4c32-bd2d-89ad104a732a-tmp\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-kubelet\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-ovn\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-host-cni-bin\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/671a78d2-e9aa-4b00-aca4-f25e8f4699df-kubelet-config\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-run-ovn\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-hostroot\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:56.106581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.107062 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb59c355-59a2-4cdc-a5d2-081a54a1bc4d-agent-certs\") pod \"konnectivity-agent-kfn8z\" (UID: \"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d\") " pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:56.107062 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysctl-conf\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:56.107062 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.107062 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105412    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/922f186b-ae36-4073-947a-7015e1eaa33c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.107062 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovnkube-config\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.107062 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.105733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovnkube-config\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.108000 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.107984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-ovn-node-metrics-cert\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:56.112792 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.112767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dxb6\" (UniqueName: \"kubernetes.io/projected/922f186b-ae36-4073-947a-7015e1eaa33c-kube-api-access-6dxb6\") pod \"multus-additional-cni-plugins-8w7wb\" (UID: \"922f186b-ae36-4073-947a-7015e1eaa33c\") " pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:56.113099 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.113080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs95n\" (UniqueName: \"kubernetes.io/projected/c39933b4-3577-4c17-8527-cf4679aefa06-kube-api-access-qs95n\") pod \"aws-ebs-csi-driver-node-dddhh\" (UID: \"c39933b4-3577-4c17-8527-cf4679aefa06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:56.113209 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.113082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kldwp\" (UniqueName: \"kubernetes.io/projected/60e0f9df-50df-4cf3-b3af-e8240edf2e21-kube-api-access-kldwp\") pod \"iptables-alerter-r8c67\" (UID: \"60e0f9df-50df-4cf3-b3af-e8240edf2e21\") " pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:56.113250 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:56.113231    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgv67\" (UniqueName: \"kubernetes.io/projected/60b4bfe4-fb9e-4323-b6cc-67da3cd484de-kube-api-access-rgv67\") pod \"ovnkube-node-4mlbg\" (UID: \"60b4bfe4-fb9e-4323-b6cc-67da3cd484de\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:57.319529 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.319484    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d2b684ad7d44a72bc24378b6f38ea2.slice/crio-cb1c69e2fb796b5e4ba317947f46ebc231622f54def380a3da80f7860dfb3a6d WatchSource:0}: Error finding container cb1c69e2fb796b5e4ba317947f46ebc231622f54def380a3da80f7860dfb3a6d: Status 404 returned error can't find the container with id cb1c69e2fb796b5e4ba317947f46ebc231622f54def380a3da80f7860dfb3a6d
Sep 11 17:44:57.319786 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.319757    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68d30b92775388d02c8d83f819b9cd3.slice/crio-759dde93cae8f60a524d0578bc844f6d8ee1121d3823b19ef484ca9aa948982a WatchSource:0}: Error finding container 759dde93cae8f60a524d0578bc844f6d8ee1121d3823b19ef484ca9aa948982a: Status 404 returned error can't find the container with id 759dde93cae8f60a524d0578bc844f6d8ee1121d3823b19ef484ca9aa948982a
Sep 11 17:44:57.325002 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.324986    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:44:57.338118 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-host\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.338276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-system-cni-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-cnibin\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-cnibin\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-tuned\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.338276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-conf-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-system-cni-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb59c355-59a2-4cdc-a5d2-081a54a1bc4d-konnectivity-ca\") pod \"konnectivity-agent-kfn8z\" (UID: \"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d\") " pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-conf-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-host\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-lib-modules\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cae0089-7c28-4f35-a755-ab5573cdf3e4-hosts-file\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysctl-d\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-k8s-cni-cncf-io\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-kubelet\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.338607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cae0089-7c28-4f35-a755-ab5573cdf3e4-tmp-dir\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-socket-dir-parent\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxr4\" (UniqueName: \"kubernetes.io/projected/345198cd-000c-4f72-9fd7-b8035c183481-kube-api-access-dkxr4\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-run\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v86fd\" (UniqueName: \"kubernetes.io/projected/f52317b8-854a-4c32-bd2d-89ad104a732a-kube-api-access-v86fd\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-cni-multus\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6759\" (UniqueName: \"kubernetes.io/projected/38af65b6-7677-4b7d-a606-162a530e3713-kube-api-access-r6759\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-etc-kubernetes\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cae0089-7c28-4f35-a755-ab5573cdf3e4-tmp-dir\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/345198cd-000c-4f72-9fd7-b8035c183481-host\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/345198cd-000c-4f72-9fd7-b8035c183481-host\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-kubelet\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338962    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f52317b8-854a-4c32-bd2d-89ad104a732a-tmp\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-lib-modules\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/671a78d2-e9aa-4b00-aca4-f25e8f4699df-kubelet-config\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysctl-d\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-hostroot\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.339048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338560    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-k8s-cni-cncf-io\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.338472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cae0089-7c28-4f35-a755-ab5573cdf3e4-hosts-file\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-run\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb59c355-59a2-4cdc-a5d2-081a54a1bc4d-agent-certs\") pod \"konnectivity-agent-kfn8z\" (UID: \"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d\") " pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb59c355-59a2-4cdc-a5d2-081a54a1bc4d-konnectivity-ca\") pod \"konnectivity-agent-kfn8z\" (UID: \"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d\") " pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysctl-conf\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.338655    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-hostroot\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-etc-kubernetes\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-cni-multus\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15daa995-2638-4b45-bca3-5d2518542c0b-cni-binary-copy\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-sys\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/671a78d2-e9aa-4b00-aca4-f25e8f4699df-kubelet-config\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysctl-conf\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-socket-dir-parent\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.339348    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-sys\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-var-lib-kubelet\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.340023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/671a78d2-e9aa-4b00-aca4-f25e8f4699df-dbus\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-cni-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.339646    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret podName:671a78d2-e9aa-4b00-aca4-f25e8f4699df nodeName:}" failed. No retries permitted until 2026-09-11 17:44:57.839620339 +0000 UTC m=+2.127154645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret") pod "global-pull-secret-syncer-zjmng" (UID: "671a78d2-e9aa-4b00-aca4-f25e8f4699df") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-cni-bin\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15daa995-2638-4b45-bca3-5d2518542c0b-multus-daemon-config\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnc9\" (UniqueName: \"kubernetes.io/projected/15daa995-2638-4b45-bca3-5d2518542c0b-kube-api-access-9fnc9\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-multus-cni-dir\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-var-lib-cni-bin\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.339870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xm9\" (UniqueName: \"kubernetes.io/projected/2cae0089-7c28-4f35-a755-ab5573cdf3e4-kube-api-access-x7xm9\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/671a78d2-e9aa-4b00-aca4-f25e8f4699df-dbus\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.340128    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:44:57.840113182 +0000 UTC m=+2.127647467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15daa995-2638-4b45-bca3-5d2518542c0b-cni-binary-copy\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-var-lib-kubelet\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/345198cd-000c-4f72-9fd7-b8035c183481-serviceca\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15daa995-2638-4b45-bca3-5d2518542c0b-multus-daemon-config\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.340958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-modprobe-d\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-netns\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysconfig\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-modprobe-d\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340492    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-netns\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-sysconfig\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-multus-certs\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15daa995-2638-4b45-bca3-5d2518542c0b-host-run-multus-certs\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/345198cd-000c-4f72-9fd7-b8035c183481-serviceca\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-kubernetes\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-kubernetes\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-systemd\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.341566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.340883    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-systemd\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.342046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.341573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f52317b8-854a-4c32-bd2d-89ad104a732a-etc-tuned\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.342046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.341783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f52317b8-854a-4c32-bd2d-89ad104a732a-tmp\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.342046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.341853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb59c355-59a2-4cdc-a5d2-081a54a1bc4d-agent-certs\") pod \"konnectivity-agent-kfn8z\" (UID: \"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d\") " pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:57.342512 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.342496    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:44:57.347188 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.347163    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v86fd\" (UniqueName: \"kubernetes.io/projected/f52317b8-854a-4c32-bd2d-89ad104a732a-kube-api-access-v86fd\") pod \"tuned-srgls\" (UID: \"f52317b8-854a-4c32-bd2d-89ad104a732a\") " pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.347188 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.347186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkxr4\" (UniqueName: \"kubernetes.io/projected/345198cd-000c-4f72-9fd7-b8035c183481-kube-api-access-dkxr4\") pod \"node-ca-xz5xc\" (UID: \"345198cd-000c-4f72-9fd7-b8035c183481\") " pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:57.347316 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.347228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6759\" (UniqueName: \"kubernetes.io/projected/38af65b6-7677-4b7d-a606-162a530e3713-kube-api-access-r6759\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:57.348482 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.348465    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:44:57.348555 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.348487    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:44:57.348555 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.348501    2576 projected.go:196] Error preparing data for projected volume kube-api-access-nww6r for pod openshift-network-diagnostics/network-check-target-lgqdb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:44:57.348635 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.348565    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r podName:d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6 nodeName:}" failed. No retries permitted until 2026-09-11 17:44:57.848547829 +0000 UTC m=+2.136082128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nww6r" (UniqueName: "kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r") pod "network-check-target-lgqdb" (UID: "d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:44:57.350496 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.350477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fnc9\" (UniqueName: \"kubernetes.io/projected/15daa995-2638-4b45-bca3-5d2518542c0b-kube-api-access-9fnc9\") pod \"multus-cqfn8\" (UID: \"15daa995-2638-4b45-bca3-5d2518542c0b\") " pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.350575 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.350534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7xm9\" (UniqueName: \"kubernetes.io/projected/2cae0089-7c28-4f35-a755-ab5573cdf3e4-kube-api-access-x7xm9\") pod \"node-resolver-nvqd8\" (UID: \"2cae0089-7c28-4f35-a755-ab5573cdf3e4\") " pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:57.447219 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.447115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh"
Sep 11 17:44:57.458315 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.458284    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39933b4_3577_4c17_8527_cf4679aefa06.slice/crio-2f6f514ad0aa169672d2267ca4bd1d66025792cb47f8f730a5ed5c3351641d04 WatchSource:0}: Error finding container 2f6f514ad0aa169672d2267ca4bd1d66025792cb47f8f730a5ed5c3351641d04: Status 404 returned error can't find the container with id 2f6f514ad0aa169672d2267ca4bd1d66025792cb47f8f730a5ed5c3351641d04
Sep 11 17:44:57.467488 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.467462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8w7wb"
Sep 11 17:44:57.476499 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.476476    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922f186b_ae36_4073_947a_7015e1eaa33c.slice/crio-6cdfb3eced3345313effb03a61686e26795abcb20e64d5861c86e9466102c479 WatchSource:0}: Error finding container 6cdfb3eced3345313effb03a61686e26795abcb20e64d5861c86e9466102c479: Status 404 returned error can't find the container with id 6cdfb3eced3345313effb03a61686e26795abcb20e64d5861c86e9466102c479
Sep 11 17:44:57.492261 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.492232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8c67"
Sep 11 17:44:57.493591 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.493572    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:44:57.500922 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.500897    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e0f9df_50df_4cf3_b3af_e8240edf2e21.slice/crio-68c4487c2d83283ae5b03bdf3c65d9417092c4dda3eb1e9bd32bf8d402e5cfb5 WatchSource:0}: Error finding container 68c4487c2d83283ae5b03bdf3c65d9417092c4dda3eb1e9bd32bf8d402e5cfb5: Status 404 returned error can't find the container with id 68c4487c2d83283ae5b03bdf3c65d9417092c4dda3eb1e9bd32bf8d402e5cfb5
Sep 11 17:44:57.509128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.509103    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:44:57.517416 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.517386    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b4bfe4_fb9e_4323_b6cc_67da3cd484de.slice/crio-7a05d06f1026b39410f7c100553bc16fd99a4d04ff6eff796ccf763eeefa1e39 WatchSource:0}: Error finding container 7a05d06f1026b39410f7c100553bc16fd99a4d04ff6eff796ccf763eeefa1e39: Status 404 returned error can't find the container with id 7a05d06f1026b39410f7c100553bc16fd99a4d04ff6eff796ccf763eeefa1e39
Sep 11 17:44:57.523721 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.523699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqfn8"
Sep 11 17:44:57.531324 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.531295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nvqd8"
Sep 11 17:44:57.531733 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.531711    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15daa995_2638_4b45_bca3_5d2518542c0b.slice/crio-351d865b88389ca13bb3e00e1cd5ba5a56f2744e7c347b61100b8ca12a883413 WatchSource:0}: Error finding container 351d865b88389ca13bb3e00e1cd5ba5a56f2744e7c347b61100b8ca12a883413: Status 404 returned error can't find the container with id 351d865b88389ca13bb3e00e1cd5ba5a56f2744e7c347b61100b8ca12a883413
Sep 11 17:44:57.539732 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.539658    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cae0089_7c28_4f35_a755_ab5573cdf3e4.slice/crio-11c77fed13d5b03adc57de1778b224fddf26bac9e1c31e01c3527ccbdc5e26d8 WatchSource:0}: Error finding container 11c77fed13d5b03adc57de1778b224fddf26bac9e1c31e01c3527ccbdc5e26d8: Status 404 returned error can't find the container with id 11c77fed13d5b03adc57de1778b224fddf26bac9e1c31e01c3527ccbdc5e26d8
Sep 11 17:44:57.552761 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.552730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xz5xc"
Sep 11 17:44:57.561626 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.561595    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345198cd_000c_4f72_9fd7_b8035c183481.slice/crio-e3431e3ed6c54736564affb57f3a11a3ad61ebddabac5e560d63bd8d9c30ae03 WatchSource:0}: Error finding container e3431e3ed6c54736564affb57f3a11a3ad61ebddabac5e560d63bd8d9c30ae03: Status 404 returned error can't find the container with id e3431e3ed6c54736564affb57f3a11a3ad61ebddabac5e560d63bd8d9c30ae03
Sep 11 17:44:57.572185 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.572162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:44:57.576903 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.576878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-srgls"
Sep 11 17:44:57.581818 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.581791    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb59c355_59a2_4cdc_a5d2_081a54a1bc4d.slice/crio-ad724d3b2db1e36ea205377d1ff52473c3b8c3ceee83231131b6b69bf42a338f WatchSource:0}: Error finding container ad724d3b2db1e36ea205377d1ff52473c3b8c3ceee83231131b6b69bf42a338f: Status 404 returned error can't find the container with id ad724d3b2db1e36ea205377d1ff52473c3b8c3ceee83231131b6b69bf42a338f
Sep 11 17:44:57.586143 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:44:57.586116    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52317b8_854a_4c32_bd2d_89ad104a732a.slice/crio-3aec27a94f07e995eae161b7621af8f61dda4a6f620727b21042c0d1a8414b0f WatchSource:0}: Error finding container 3aec27a94f07e995eae161b7621af8f61dda4a6f620727b21042c0d1a8414b0f: Status 404 returned error can't find the container with id 3aec27a94f07e995eae161b7621af8f61dda4a6f620727b21042c0d1a8414b0f
Sep 11 17:44:57.843060 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.842972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:57.843060 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.843037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:57.843287 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.843097    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:44:57.843287 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.843116    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:44:57.843287 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.843165    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret podName:671a78d2-e9aa-4b00-aca4-f25e8f4699df nodeName:}" failed. No retries permitted until 2026-09-11 17:44:58.843147108 +0000 UTC m=+3.130681407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret") pod "global-pull-secret-syncer-zjmng" (UID: "671a78d2-e9aa-4b00-aca4-f25e8f4699df") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:44:57.843287 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.843180    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:44:58.843172112 +0000 UTC m=+3.130706397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:44:57.944297 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.944262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:44:57.944486 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.944423    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:44:57.944486 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.944448    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:44:57.944486 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.944459    2576 projected.go:196] Error preparing data for projected volume kube-api-access-nww6r for pod openshift-network-diagnostics/network-check-target-lgqdb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:44:57.944644 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:57.944539    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r podName:d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6 nodeName:}" failed. No retries permitted until 2026-09-11 17:44:58.944520478 +0000 UTC m=+3.232054767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nww6r" (UniqueName: "kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r") pod "network-check-target-lgqdb" (UID: "d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:44:57.975759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:57.975580    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:44:58.175318 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.175220    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 17:39:57 +0000 UTC" deadline="2028-05-11 20:08:28.455321648 +0000 UTC"
Sep 11 17:44:58.175318 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.175264    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14594h23m30.280062718s"
Sep 11 17:44:58.262465 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.261949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:58.262465 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.262081    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:44:58.267848 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.267747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8c67" event={"ID":"60e0f9df-50df-4cf3-b3af-e8240edf2e21","Type":"ContainerStarted","Data":"68c4487c2d83283ae5b03bdf3c65d9417092c4dda3eb1e9bd32bf8d402e5cfb5"}
Sep 11 17:44:58.273581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.273504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerStarted","Data":"6cdfb3eced3345313effb03a61686e26795abcb20e64d5861c86e9466102c479"}
Sep 11 17:44:58.289526 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.289423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh" event={"ID":"c39933b4-3577-4c17-8527-cf4679aefa06","Type":"ContainerStarted","Data":"2f6f514ad0aa169672d2267ca4bd1d66025792cb47f8f730a5ed5c3351641d04"}
Sep 11 17:44:58.295655 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.295620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" event={"ID":"f7d2b684ad7d44a72bc24378b6f38ea2","Type":"ContainerStarted","Data":"cb1c69e2fb796b5e4ba317947f46ebc231622f54def380a3da80f7860dfb3a6d"}
Sep 11 17:44:58.319550 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.319506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xz5xc" event={"ID":"345198cd-000c-4f72-9fd7-b8035c183481","Type":"ContainerStarted","Data":"e3431e3ed6c54736564affb57f3a11a3ad61ebddabac5e560d63bd8d9c30ae03"}
Sep 11 17:44:58.322256 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.322218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nvqd8" event={"ID":"2cae0089-7c28-4f35-a755-ab5573cdf3e4","Type":"ContainerStarted","Data":"11c77fed13d5b03adc57de1778b224fddf26bac9e1c31e01c3527ccbdc5e26d8"}
Sep 11 17:44:58.328441 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.328395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" event={"ID":"b68d30b92775388d02c8d83f819b9cd3","Type":"ContainerStarted","Data":"759dde93cae8f60a524d0578bc844f6d8ee1121d3823b19ef484ca9aa948982a"}
Sep 11 17:44:58.331748 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.331639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-srgls" event={"ID":"f52317b8-854a-4c32-bd2d-89ad104a732a","Type":"ContainerStarted","Data":"3aec27a94f07e995eae161b7621af8f61dda4a6f620727b21042c0d1a8414b0f"}
Sep 11 17:44:58.333808 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.333778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfn8z" event={"ID":"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d","Type":"ContainerStarted","Data":"ad724d3b2db1e36ea205377d1ff52473c3b8c3ceee83231131b6b69bf42a338f"}
Sep 11 17:44:58.340395 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.340365    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqfn8" event={"ID":"15daa995-2638-4b45-bca3-5d2518542c0b","Type":"ContainerStarted","Data":"351d865b88389ca13bb3e00e1cd5ba5a56f2744e7c347b61100b8ca12a883413"}
Sep 11 17:44:58.348561 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.348443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"7a05d06f1026b39410f7c100553bc16fd99a4d04ff6eff796ccf763eeefa1e39"}
Sep 11 17:44:58.862953 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.862182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:44:58.862953 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.862266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:58.862953 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.862405    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:44:58.862953 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.862467    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:00.862447237 +0000 UTC m=+5.149981522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:44:58.862953 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.862868    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:44:58.862953 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.862918    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret podName:671a78d2-e9aa-4b00-aca4-f25e8f4699df nodeName:}" failed. No retries permitted until 2026-09-11 17:45:00.862903653 +0000 UTC m=+5.150437943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret") pod "global-pull-secret-syncer-zjmng" (UID: "671a78d2-e9aa-4b00-aca4-f25e8f4699df") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:44:58.963887 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:58.963195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:44:58.963887 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.963425    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:44:58.963887 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.963448    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:44:58.963887 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.963461    2576 projected.go:196] Error preparing data for projected volume kube-api-access-nww6r for pod openshift-network-diagnostics/network-check-target-lgqdb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:44:58.963887 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:58.963520    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r podName:d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:00.963503027 +0000 UTC m=+5.251037317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nww6r" (UniqueName: "kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r") pod "network-check-target-lgqdb" (UID: "d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:44:59.019846 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:59.019812    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:44:59.175607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:59.175493    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 17:39:57 +0000 UTC" deadline="2028-04-02 15:18:36.912647183 +0000 UTC"
Sep 11 17:44:59.175607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:59.175562    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13653h33m37.73708948s"
Sep 11 17:44:59.234193 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:59.234160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:44:59.234397 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:59.234295    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:44:59.234757 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:44:59.234736    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:44:59.234863 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:44:59.234843    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:00.235622 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:00.234901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:00.235622 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.235037    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:00.883342 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:00.883305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:00.883582 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:00.883361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:00.883582 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.883479    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:00.883582 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.883540    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret podName:671a78d2-e9aa-4b00-aca4-f25e8f4699df nodeName:}" failed. No retries permitted until 2026-09-11 17:45:04.883526731 +0000 UTC m=+9.171061016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret") pod "global-pull-secret-syncer-zjmng" (UID: "671a78d2-e9aa-4b00-aca4-f25e8f4699df") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:00.883817 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.883799    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:00.883870 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.883859    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:04.883844623 +0000 UTC m=+9.171378922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:00.984039 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:00.983985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:00.984202 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.984173    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:00.984202 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.984199    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:00.984333 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.984214    2576 projected.go:196] Error preparing data for projected volume kube-api-access-nww6r for pod openshift-network-diagnostics/network-check-target-lgqdb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:00.984333 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:00.984274    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r podName:d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:04.984256303 +0000 UTC m=+9.271790594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nww6r" (UniqueName: "kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r") pod "network-check-target-lgqdb" (UID: "d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:01.234007 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:01.233928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:01.234147 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:01.234070    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:01.234484 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:01.234462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:01.234619 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:01.234573    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:02.237234 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:02.237178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:02.237708 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:02.237310    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:03.233178 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:03.233141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:03.233369 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:03.233254    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:03.233369 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:03.233321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:03.233490 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:03.233453    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:04.237078 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:04.237048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:04.237478 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:04.237144    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:04.915669 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:04.915582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:04.915669 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:04.915662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:04.915913 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:04.915760    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:04.915913 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:04.915825    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:04.915913 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:04.915842    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:12.915822283 +0000 UTC m=+17.203356585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:04.915913 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:04.915888    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret podName:671a78d2-e9aa-4b00-aca4-f25e8f4699df nodeName:}" failed. No retries permitted until 2026-09-11 17:45:12.915870713 +0000 UTC m=+17.203405004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret") pod "global-pull-secret-syncer-zjmng" (UID: "671a78d2-e9aa-4b00-aca4-f25e8f4699df") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:05.016963 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:05.016924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:05.017149 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:05.017130    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:05.017222 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:05.017159    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:05.017222 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:05.017174    2576 projected.go:196] Error preparing data for projected volume kube-api-access-nww6r for pod openshift-network-diagnostics/network-check-target-lgqdb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:05.017326 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:05.017235    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r podName:d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:13.017217584 +0000 UTC m=+17.304751883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nww6r" (UniqueName: "kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r") pod "network-check-target-lgqdb" (UID: "d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:05.233951 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:05.233868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:05.234255 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:05.233999    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:05.234464 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:05.234435    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:05.234578 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:05.234545    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:06.234469 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:06.234419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:06.235164 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:06.234594    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:07.233594 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:07.233560    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:07.233594 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:07.233590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:07.233865 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:07.233711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:07.233929 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:07.233901    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:08.233666 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:08.233622    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:08.234174 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:08.233765    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:09.233501 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:09.233469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:09.233722 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:09.233508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:09.233722 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:09.233592    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:09.234108 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:09.233763    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:10.233405 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:10.233366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:10.233572 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:10.233494    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:11.233931 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:11.233895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:11.233931 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:11.233912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:11.234437 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:11.234041    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:11.234518 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:11.234492    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:12.233508 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:12.233469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:12.233776 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:12.233627    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:12.977772 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:12.977734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:12.978271 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:12.977801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:12.978271 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:12.977943    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:12.978271 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:12.977947    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:12.978271 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:12.978016    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret podName:671a78d2-e9aa-4b00-aca4-f25e8f4699df nodeName:}" failed. No retries permitted until 2026-09-11 17:45:28.977997924 +0000 UTC m=+33.265532214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret") pod "global-pull-secret-syncer-zjmng" (UID: "671a78d2-e9aa-4b00-aca4-f25e8f4699df") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:12.978271 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:12.978038    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:28.978028233 +0000 UTC m=+33.265562524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:13.078912 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:13.078869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:13.079080 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:13.079025    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:13.079080 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:13.079044    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:13.079080 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:13.079054    2576 projected.go:196] Error preparing data for projected volume kube-api-access-nww6r for pod openshift-network-diagnostics/network-check-target-lgqdb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:13.079203 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:13.079127    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r podName:d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:29.079105484 +0000 UTC m=+33.366639777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nww6r" (UniqueName: "kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r") pod "network-check-target-lgqdb" (UID: "d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:13.233507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:13.233415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:13.233700 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:13.233552    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:13.233700 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:13.233629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:13.233815 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:13.233767    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:14.233239 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:14.233196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:14.233706 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:14.233338    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:15.233459 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:15.233418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:15.233960 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:15.233423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:15.233960 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:15.233589    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:15.233960 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:15.233701    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:16.234692 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:16.234641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:16.235054 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:16.234792    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:17.234443 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.234144    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:17.234588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.234207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:17.234588 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:17.234516    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:17.234713 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:17.234606    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:17.392651 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.392569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-srgls" event={"ID":"f52317b8-854a-4c32-bd2d-89ad104a732a","Type":"ContainerStarted","Data":"801ec4614552c082983bdbc7ac1e6f2186d7532408d47b4966a0f4790748f0a3"}
Sep 11 17:45:17.394480 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.394452    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfn8z" event={"ID":"fb59c355-59a2-4cdc-a5d2-081a54a1bc4d","Type":"ContainerStarted","Data":"22987d89ceff3a511349551f1cb054d5cd01767d3a9be916e4e5ef0d105e6e3d"}
Sep 11 17:45:17.396285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.396259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqfn8" event={"ID":"15daa995-2638-4b45-bca3-5d2518542c0b","Type":"ContainerStarted","Data":"bca5a46f5418af7569324ad35cc2c678420461aa9a0eed474c68543c69fae658"}
Sep 11 17:45:17.399646 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.399619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"1135d8930f6734c2126eafde367f92cb161e2abcc6468590272acc4df906faef"}
Sep 11 17:45:17.399799 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.399735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"e0b4ebd4ee75220c5eb6223c2df0238a3b3a553c879c013ba9ab05f0f9e4cd67"}
Sep 11 17:45:17.399799 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.399787    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"9886d7196691773cd76113a5cb899afbc42edc554cd03bbac3009a5a18fffbe5"}
Sep 11 17:45:17.399914 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.399833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"a5a3e91d9c91d3130717f17d098e7dd5a167e3a64db92e89812ce6c67f89a32b"}
Sep 11 17:45:17.399914 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.399880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"834379dea4d6d71333abc9ef2e70343b9db013868f95ab1511eceade2f4f4931"}
Sep 11 17:45:17.400007 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.399928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"2de42da29ea2d4680b2a57930bcabf28edd5a4191dc16645a146ffe3c98b3ad4"}
Sep 11 17:45:17.401384 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.401357    2576 generic.go:356] "Generic (PLEG): container finished" podID="922f186b-ae36-4073-947a-7015e1eaa33c" containerID="e59d5326dea5bf3c3332797f3a9bdfe14e52bad7ff669c7c981fbbc0156e2324" exitCode=0
Sep 11 17:45:17.401492 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.401444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerDied","Data":"e59d5326dea5bf3c3332797f3a9bdfe14e52bad7ff669c7c981fbbc0156e2324"}
Sep 11 17:45:17.403372 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.403337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh" event={"ID":"c39933b4-3577-4c17-8527-cf4679aefa06","Type":"ContainerStarted","Data":"bbc27b634fd150cb5fd860f7e7fb5052900e12378e71457a899b4325eb15752e"}
Sep 11 17:45:17.405032 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.405006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" event={"ID":"f7d2b684ad7d44a72bc24378b6f38ea2","Type":"ContainerStarted","Data":"83ab5f7579e83091cee1cf75203f24f3567700df4f5034d2adefb38296886085"}
Sep 11 17:45:17.406570 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.406539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xz5xc" event={"ID":"345198cd-000c-4f72-9fd7-b8035c183481","Type":"ContainerStarted","Data":"90ecaab5e74d6cffb112a51596c0ba8c3277359871b434f3a3f8d7ce243afeb5"}
Sep 11 17:45:17.408176 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.408152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nvqd8" event={"ID":"2cae0089-7c28-4f35-a755-ab5573cdf3e4","Type":"ContainerStarted","Data":"474784555cdb8bfc46f18e910b2745626a2bda47f0fef9805854171683e4bbff"}
Sep 11 17:45:17.409881 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.409855    2576 generic.go:356] "Generic (PLEG): container finished" podID="b68d30b92775388d02c8d83f819b9cd3" containerID="6c9301fa5e8c513de9e759dd2ee8ed7f2c829dceb5aa272dcf454bead744b56e" exitCode=0
Sep 11 17:45:17.409976 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.409885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" event={"ID":"b68d30b92775388d02c8d83f819b9cd3","Type":"ContainerDied","Data":"6c9301fa5e8c513de9e759dd2ee8ed7f2c829dceb5aa272dcf454bead744b56e"}
Sep 11 17:45:17.428473 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.428418    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-srgls" podStartSLOduration=2.551536634 podStartE2EDuration="21.428403377s" totalImagesPullingTime="18.876866743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:17.428288716 +0000 UTC m=+21.715823023" watchObservedRunningTime="2026-09-11 17:45:17.428403377 +0000 UTC m=+21.715937683"
Sep 11 17:45:17.461605 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.461553    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nvqd8" podStartSLOduration=2.533835781 podStartE2EDuration="21.461533184s" totalImagesPullingTime="18.927697403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:17.461205197 +0000 UTC m=+21.748739504" watchObservedRunningTime="2026-09-11 17:45:17.461533184 +0000 UTC m=+21.749067492"
Sep 11 17:45:17.482199 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.482149    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xz5xc" podStartSLOduration=2.768528894 podStartE2EDuration="21.482132673s" totalImagesPullingTime="18.713603779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:17.481808066 +0000 UTC m=+21.769342367" watchObservedRunningTime="2026-09-11 17:45:17.482132673 +0000 UTC m=+21.769666979"
Sep 11 17:45:17.506179 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.506110    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kfn8z" podStartSLOduration=2.812812089 podStartE2EDuration="21.506091077s" totalImagesPullingTime="18.693278988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:17.505790731 +0000 UTC m=+21.793325042" watchObservedRunningTime="2026-09-11 17:45:17.506091077 +0000 UTC m=+21.793625384"
Sep 11 17:45:17.548158 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.548101    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" podStartSLOduration=20.548079451 podStartE2EDuration="20.548079451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:17.547523199 +0000 UTC m=+21.835057553" watchObservedRunningTime="2026-09-11 17:45:17.548079451 +0000 UTC m=+21.835613761"
Sep 11 17:45:17.584722 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.584643    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cqfn8" podStartSLOduration=2.6441672 podStartE2EDuration="21.584627844s" totalImagesPullingTime="18.940460644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:17.582859946 +0000 UTC m=+21.870394264" watchObservedRunningTime="2026-09-11 17:45:17.584627844 +0000 UTC m=+21.872162150"
Sep 11 17:45:17.874946 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:17.874925    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 17:45:18.203387 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.203188    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T17:45:17.874942569Z","UUID":"73e84e82-58ec-4177-94fe-97384f171f04","Handler":null,"Name":"","Endpoint":""}
Sep 11 17:45:18.204639 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.204620    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 17:45:18.204768 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.204652    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 17:45:18.233219 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.233188    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:18.233472 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:18.233438    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:18.414164 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.414121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8c67" event={"ID":"60e0f9df-50df-4cf3-b3af-e8240edf2e21","Type":"ContainerStarted","Data":"364e21b530adac5108b3bf213468ea617b5224e379338317d733f1ba3f772dc5"}
Sep 11 17:45:18.416837 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.416482    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh" event={"ID":"c39933b4-3577-4c17-8527-cf4679aefa06","Type":"ContainerStarted","Data":"c8c6db4dc751109582a471efa8c2a42aa0fcaa928b6d4dab183469a0ac271517"}
Sep 11 17:45:18.418507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.418476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" event={"ID":"b68d30b92775388d02c8d83f819b9cd3","Type":"ContainerStarted","Data":"708f33263cb976b6464bd7c8ade9981fb7939aa18016824a2164524bb380d643"}
Sep 11 17:45:18.430876 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:18.430817    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r8c67" podStartSLOduration=3.656599394 podStartE2EDuration="22.4308028s" totalImagesPullingTime="18.774203406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:18.430483516 +0000 UTC m=+22.718017822" watchObservedRunningTime="2026-09-11 17:45:18.4308028 +0000 UTC m=+22.718337108"
Sep 11 17:45:19.233384 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:19.233347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:19.233567 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:19.233469    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:19.233947 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:19.233929    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:19.234033 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:19.234009    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:19.426106 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:19.425272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"8118aaae59ed2147d5037cd842ef84ae566270cc9dfa0b4ca14595e80709e601"}
Sep 11 17:45:19.611921 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:19.611876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:45:19.612604 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:19.612581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:45:19.629784 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:19.629738    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" podStartSLOduration=22.629722512 podStartE2EDuration="22.629722512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:18.44687469 +0000 UTC m=+22.734408999" watchObservedRunningTime="2026-09-11 17:45:19.629722512 +0000 UTC m=+23.917256818"
Sep 11 17:45:20.233789 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:20.233756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:20.234015 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:20.233891    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:20.429942 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:20.429897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh" event={"ID":"c39933b4-3577-4c17-8527-cf4679aefa06","Type":"ContainerStarted","Data":"7d58d9f105a8d68dd395295cc0cada164d575f8b151add302e8c517cc26ea28b"}
Sep 11 17:45:20.451545 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:20.451487    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dddhh" podStartSLOduration=3.245683368 podStartE2EDuration="24.451471272s" totalImagesPullingTime="21.205787904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:20.450984163 +0000 UTC m=+24.738518473" watchObservedRunningTime="2026-09-11 17:45:20.451471272 +0000 UTC m=+24.739005579"
Sep 11 17:45:21.233325 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:21.233287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:21.233507 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:21.233416    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:21.233507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:21.233473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:21.233638 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:21.233606    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:21.979927 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:21.979714    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:45:21.980258 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:21.980047    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 17:45:21.980979 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:21.980957    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kfn8z"
Sep 11 17:45:22.233609 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:22.233573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:22.233779 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:22.233738    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:22.438514 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:22.438419    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" event={"ID":"60b4bfe4-fb9e-4323-b6cc-67da3cd484de","Type":"ContainerStarted","Data":"2d3f132958f4ce0f8861c273b016dba9e30d1c2aa74dbe5a6e03571fccc2f6e2"}
Sep 11 17:45:22.438733 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:22.438711    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:45:22.440505 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:22.440480    2576 generic.go:356] "Generic (PLEG): container finished" podID="922f186b-ae36-4073-947a-7015e1eaa33c" containerID="1b3d479c4dd56e87c4da17667d3754c99cdfe08783ddfcb96910890c473dabe3" exitCode=0
Sep 11 17:45:22.440626 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:22.440565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerDied","Data":"1b3d479c4dd56e87c4da17667d3754c99cdfe08783ddfcb96910890c473dabe3"}
Sep 11 17:45:22.454840 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:22.454815    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:45:22.605919 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:22.603787    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg" podStartSLOduration=7.597122902 podStartE2EDuration="26.603764524s" totalImagesPullingTime="19.006641622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:22.602442495 +0000 UTC m=+26.889976801" watchObservedRunningTime="2026-09-11 17:45:22.603764524 +0000 UTC m=+26.891298833"
Sep 11 17:45:23.233733 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:23.233691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:23.234263 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:23.233695    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:23.234263 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:23.233856    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:23.234263 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:23.233923    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:23.443002 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:23.442974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:45:23.443151 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:23.443055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:45:23.458256 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:23.458234    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:45:24.061077 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.061044    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjmng"]
Sep 11 17:45:24.061229 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.061167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:24.061277 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:24.061259    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:24.063480 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.063455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xh94l"]
Sep 11 17:45:24.063630 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.063547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:24.063706 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:24.063644    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:24.081252 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.081180    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lgqdb"]
Sep 11 17:45:24.081357 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.081276    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:24.081405 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:24.081362    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:24.447143 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.447059    2576 generic.go:356] "Generic (PLEG): container finished" podID="922f186b-ae36-4073-947a-7015e1eaa33c" containerID="d53cb9d822f21d0378704c794bacab0013a6956bfe73be59cc3c948a16894395" exitCode=0
Sep 11 17:45:24.447143 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:24.447130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerDied","Data":"d53cb9d822f21d0378704c794bacab0013a6956bfe73be59cc3c948a16894395"}
Sep 11 17:45:25.233719 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:25.233662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:25.233884 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:25.233812    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:25.451917 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:25.451821    2576 generic.go:356] "Generic (PLEG): container finished" podID="922f186b-ae36-4073-947a-7015e1eaa33c" containerID="96d0b4d21cac2ce5af9c7e96dc76c4b33f8f2767358324899070f006db7f38c5" exitCode=0
Sep 11 17:45:25.451917 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:25.451894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerDied","Data":"96d0b4d21cac2ce5af9c7e96dc76c4b33f8f2767358324899070f006db7f38c5"}
Sep 11 17:45:26.234317 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:26.234031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:26.234489 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:26.234056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:26.234489 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:26.234384    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:26.234489 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:26.234454    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:27.233341 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:27.233304    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:27.233818 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:27.233436    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:28.233855 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:28.233768    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:28.233855 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:28.233818    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:28.234404 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:28.233913    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xh94l" podUID="38af65b6-7677-4b7d-a606-162a530e3713"
Sep 11 17:45:28.234404 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:28.234053    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgqdb" podUID="d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6"
Sep 11 17:45:28.994517 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:28.994477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:28.994706 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:28.994547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:28.994706 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:28.994649    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:28.994706 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:28.994698    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:28.994849 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:28.994739    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:00.994722573 +0000 UTC m=+65.282256868 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:45:28.994849 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:28.994755    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret podName:671a78d2-e9aa-4b00-aca4-f25e8f4699df nodeName:}" failed. No retries permitted until 2026-09-11 17:46:00.994748222 +0000 UTC m=+65.282282517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret") pod "global-pull-secret-syncer-zjmng" (UID: "671a78d2-e9aa-4b00-aca4-f25e8f4699df") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:45:29.095500 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.095456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:29.095705 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.095660    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:45:29.095705 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.095703    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:45:29.095822 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.095718    2576 projected.go:196] Error preparing data for projected volume kube-api-access-nww6r for pod openshift-network-diagnostics/network-check-target-lgqdb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:29.095822 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.095780    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r podName:d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:01.095766025 +0000 UTC m=+65.383300310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nww6r" (UniqueName: "kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r") pod "network-check-target-lgqdb" (UID: "d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:45:29.233959 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.233915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:29.234414 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.234057    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjmng" podUID="671a78d2-e9aa-4b00-aca4-f25e8f4699df"
Sep 11 17:45:29.521452 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.521423    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeReady"
Sep 11 17:45:29.521624 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.521562    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 17:45:29.609133 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.609103    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59bb997f4b-95qss"]
Sep 11 17:45:29.622090 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.622063    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"]
Sep 11 17:45:29.622239 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.622189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.630332 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.630311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 17:45:29.630449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.630315    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 17:45:29.630449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.630339    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 17:45:29.631061 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.631045    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h7qvz\""
Sep 11 17:45:29.639207 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.638835    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"]
Sep 11 17:45:29.639469 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.639229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.641203 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.641183    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 17:45:29.645058 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.644998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 17:45:29.648875 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.648851    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 17:45:29.648989 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.648875    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 17:45:29.648989 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.648854    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 17:45:29.649231 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.649214    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 17:45:29.649316 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.649222    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 17:45:29.649316 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.649268    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 17:45:29.653215 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.653194    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"]
Sep 11 17:45:29.653359 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.653342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.659518 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.659495    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 17:45:29.671432 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.671407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"]
Sep 11 17:45:29.671432 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.671439    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5r5nc"]
Sep 11 17:45:29.671584 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.671543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:29.677531 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.677514    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rjb87\""
Sep 11 17:45:29.677817 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.677802    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 17:45:29.688570 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.688547    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"]
Sep 11 17:45:29.688654 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.688579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bb997f4b-95qss"]
Sep 11 17:45:29.688654 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.688597    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w8rlb"]
Sep 11 17:45:29.688751 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.688656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.698809 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.698787    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tc7ww\""
Sep 11 17:45:29.698932 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.698788    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 17:45:29.698932 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.698788    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 17:45:29.700009 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.699988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-certificates\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700085 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.700085 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-image-registry-private-configuration\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700169 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxq5\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-kube-api-access-9sxq5\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700169 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-bound-sa-token\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700169 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.700169 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-installation-pull-secrets\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-trusted-ca\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-hub\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.700304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjsv\" (UniqueName: \"kubernetes.io/projected/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-kube-api-access-vhjsv\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.700304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-ca-trust-extracted\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-ca\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.700467 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.700467 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.700326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.707618 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.707419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"]
Sep 11 17:45:29.707618 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.707520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:29.721624 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.721596    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5xw8q\""
Sep 11 17:45:29.722348 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.722325    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 17:45:29.722712 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.722659    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 17:45:29.723025 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.723005    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5r5nc"]
Sep 11 17:45:29.723588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.723570    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8rlb"]
Sep 11 17:45:29.727401 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.727383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 17:45:29.800765 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.800734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-image-registry-private-configuration\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.800943 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.800772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxq5\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-kube-api-access-9sxq5\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.800943 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.800801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-tmp-dir\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.800943 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.800832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-bound-sa-token\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.800943 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.800877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.801149 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-installation-pull-secrets\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.801149 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eed8d103-440b-4ad5-a004-f36cb96b7a60-cert\") pod \"ingress-canary-w8rlb\" (UID: \"eed8d103-440b-4ad5-a004-f36cb96b7a60\") " pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:29.801149 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvnpl\" (UniqueName: \"kubernetes.io/projected/9fec3a65-21c9-449e-9c55-f6240ff8a9d3-kube-api-access-hvnpl\") pod \"managed-serviceaccount-addon-agent-5487799bbb-gcznx\" (UID: \"9fec3a65-21c9-449e-9c55-f6240ff8a9d3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:29.801149 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4sn\" (UniqueName: \"kubernetes.io/projected/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-kube-api-access-sk4sn\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.801344 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-trusted-ca\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.801344 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-hub\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.801344 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjsv\" (UniqueName: \"kubernetes.io/projected/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-kube-api-access-vhjsv\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.801344 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-ca-trust-extracted\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.801344 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-ca\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.801344 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-config-volume\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.801344 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9fec3a65-21c9-449e-9c55-f6240ff8a9d3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5487799bbb-gcznx\" (UID: \"9fec3a65-21c9-449e-9c55-f6240ff8a9d3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-certificates\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e87e11-c799-40ac-9c3e-4f934cf748a1-tmp\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4e87e11-c799-40ac-9c3e-4f934cf748a1-klusterlet-config\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.801562    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h4xz\" (UniqueName: \"kubernetes.io/projected/f4e87e11-c799-40ac-9c3e-4f934cf748a1-kube-api-access-5h4xz\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.801581    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb997f4b-95qss: secret "image-registry-tls" not found
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9766\" (UniqueName: \"kubernetes.io/projected/eed8d103-440b-4ad5-a004-f36cb96b7a60-kube-api-access-s9766\") pod \"ingress-canary-w8rlb\" (UID: \"eed8d103-440b-4ad5-a004-f36cb96b7a60\") " pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.801633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.801698 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.801661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls podName:8baa67fa-6989-4b97-8ddd-c20e7a43dd7e nodeName:}" failed. No retries permitted until 2026-09-11 17:45:30.301641877 +0000 UTC m=+34.589176163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls") pod "image-registry-59bb997f4b-95qss" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e") : secret "image-registry-tls" not found
Sep 11 17:45:29.802368 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.802054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-ca-trust-extracted\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.802368 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.802148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-trusted-ca\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.802807 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.802780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-certificates\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.805395 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.805371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-ca\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.805496 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.805403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-image-registry-private-configuration\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.805496 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.805438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-installation-pull-secrets\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.805578 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.805524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.805578 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.805533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.805645 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.805597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-hub\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.816276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.816253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-bound-sa-token\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.824661 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.824630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxq5\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-kube-api-access-9sxq5\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:29.825339 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.825321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjsv\" (UniqueName: \"kubernetes.io/projected/c8fdd70d-3220-4b42-a2cc-873b9fe9160a-kube-api-access-vhjsv\") pod \"cluster-proxy-proxy-agent-6d78856f7-jxtlh\" (UID: \"c8fdd70d-3220-4b42-a2cc-873b9fe9160a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.902059 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-tmp-dir\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.902242 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eed8d103-440b-4ad5-a004-f36cb96b7a60-cert\") pod \"ingress-canary-w8rlb\" (UID: \"eed8d103-440b-4ad5-a004-f36cb96b7a60\") " pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:29.902242 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnpl\" (UniqueName: \"kubernetes.io/projected/9fec3a65-21c9-449e-9c55-f6240ff8a9d3-kube-api-access-hvnpl\") pod \"managed-serviceaccount-addon-agent-5487799bbb-gcznx\" (UID: \"9fec3a65-21c9-449e-9c55-f6240ff8a9d3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:29.902242 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4sn\" (UniqueName: \"kubernetes.io/projected/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-kube-api-access-sk4sn\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.902242 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-config-volume\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.902242 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9fec3a65-21c9-449e-9c55-f6240ff8a9d3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5487799bbb-gcznx\" (UID: \"9fec3a65-21c9-449e-9c55-f6240ff8a9d3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:29.902507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.902507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e87e11-c799-40ac-9c3e-4f934cf748a1-tmp\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.902507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4e87e11-c799-40ac-9c3e-4f934cf748a1-klusterlet-config\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.902507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h4xz\" (UniqueName: \"kubernetes.io/projected/f4e87e11-c799-40ac-9c3e-4f934cf748a1-kube-api-access-5h4xz\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.902507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9766\" (UniqueName: \"kubernetes.io/projected/eed8d103-440b-4ad5-a004-f36cb96b7a60-kube-api-access-s9766\") pod \"ingress-canary-w8rlb\" (UID: \"eed8d103-440b-4ad5-a004-f36cb96b7a60\") " pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:29.902507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.902387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-tmp-dir\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.902835 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.902747    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:29.902835 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:29.902820    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls podName:42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:30.402800191 +0000 UTC m=+34.690334494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls") pod "dns-default-5r5nc" (UID: "42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:29.903421 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.903332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e87e11-c799-40ac-9c3e-4f934cf748a1-tmp\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.903728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.903704    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-config-volume\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.905420 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.905397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9fec3a65-21c9-449e-9c55-f6240ff8a9d3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5487799bbb-gcznx\" (UID: \"9fec3a65-21c9-449e-9c55-f6240ff8a9d3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:29.906117 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.906053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eed8d103-440b-4ad5-a004-f36cb96b7a60-cert\") pod \"ingress-canary-w8rlb\" (UID: \"eed8d103-440b-4ad5-a004-f36cb96b7a60\") " pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:29.906117 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.906054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4e87e11-c799-40ac-9c3e-4f934cf748a1-klusterlet-config\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.938477 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.938450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4sn\" (UniqueName: \"kubernetes.io/projected/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-kube-api-access-sk4sn\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:29.938620 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.938554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9766\" (UniqueName: \"kubernetes.io/projected/eed8d103-440b-4ad5-a004-f36cb96b7a60-kube-api-access-s9766\") pod \"ingress-canary-w8rlb\" (UID: \"eed8d103-440b-4ad5-a004-f36cb96b7a60\") " pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:29.939919 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.939896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h4xz\" (UniqueName: \"kubernetes.io/projected/f4e87e11-c799-40ac-9c3e-4f934cf748a1-kube-api-access-5h4xz\") pod \"klusterlet-addon-workmgr-659fcc7cd9-gkvml\" (UID: \"f4e87e11-c799-40ac-9c3e-4f934cf748a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.940308 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.940290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvnpl\" (UniqueName: \"kubernetes.io/projected/9fec3a65-21c9-449e-9c55-f6240ff8a9d3-kube-api-access-hvnpl\") pod \"managed-serviceaccount-addon-agent-5487799bbb-gcznx\" (UID: \"9fec3a65-21c9-449e-9c55-f6240ff8a9d3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:29.963766 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.963736    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:45:29.970885 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.970866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:29.979039 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:29.979008    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"
Sep 11 17:45:30.016528 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.016285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8rlb"
Sep 11 17:45:30.054300 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.054064    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:30.234060 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.234023    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:45:30.234444 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.234066    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:45:30.237463 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.237439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 17:45:30.241477 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.241446    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 17:45:30.241477 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.241444    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jfwbq\""
Sep 11 17:45:30.242792 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.242773    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 17:45:30.248945 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.248928    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7dtkl\""
Sep 11 17:45:30.304379 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.304293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:30.304525 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:30.304458    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:45:30.304525 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:30.304477    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb997f4b-95qss: secret "image-registry-tls" not found
Sep 11 17:45:30.304588 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:30.304538    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls podName:8baa67fa-6989-4b97-8ddd-c20e7a43dd7e nodeName:}" failed. No retries permitted until 2026-09-11 17:45:31.304520808 +0000 UTC m=+35.592055093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls") pod "image-registry-59bb997f4b-95qss" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e") : secret "image-registry-tls" not found
Sep 11 17:45:30.329411 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.328950    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"]
Sep 11 17:45:30.333024 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.332996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"]
Sep 11 17:45:30.338111 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:45:30.338056    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8fdd70d_3220_4b42_a2cc_873b9fe9160a.slice/crio-4a6b71623c37abe819caa34c3a4e4b1764a08854410244d9ef84e9bb7dbd7be6 WatchSource:0}: Error finding container 4a6b71623c37abe819caa34c3a4e4b1764a08854410244d9ef84e9bb7dbd7be6: Status 404 returned error can't find the container with id 4a6b71623c37abe819caa34c3a4e4b1764a08854410244d9ef84e9bb7dbd7be6
Sep 11 17:45:30.339471 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:45:30.339424    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e87e11_c799_40ac_9c3e_4f934cf748a1.slice/crio-4cd236768a82a7489ea983d06f015bf9d809104caedf9f0b6f73dfeef9076555 WatchSource:0}: Error finding container 4cd236768a82a7489ea983d06f015bf9d809104caedf9f0b6f73dfeef9076555: Status 404 returned error can't find the container with id 4cd236768a82a7489ea983d06f015bf9d809104caedf9f0b6f73dfeef9076555
Sep 11 17:45:30.405092 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.405065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:30.405262 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:30.405225    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:30.405334 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:30.405293    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls podName:42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:31.40527851 +0000 UTC m=+35.692812794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls") pod "dns-default-5r5nc" (UID: "42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:30.423317 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.423269    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:30.466624 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.466592    2576 generic.go:356] "Generic (PLEG): container finished" podID="922f186b-ae36-4073-947a-7015e1eaa33c" containerID="392317d2726dd2f63abf4d9e417b4b92cfab80cdef9ae666ebd74b4d57ba8fe1" exitCode=0
Sep 11 17:45:30.466840 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.466667    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerDied","Data":"392317d2726dd2f63abf4d9e417b4b92cfab80cdef9ae666ebd74b4d57ba8fe1"}
Sep 11 17:45:30.467854 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.467834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml" event={"ID":"f4e87e11-c799-40ac-9c3e-4f934cf748a1","Type":"ContainerStarted","Data":"4cd236768a82a7489ea983d06f015bf9d809104caedf9f0b6f73dfeef9076555"}
Sep 11 17:45:30.468970 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.468949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" event={"ID":"c8fdd70d-3220-4b42-a2cc-873b9fe9160a","Type":"ContainerStarted","Data":"4a6b71623c37abe819caa34c3a4e4b1764a08854410244d9ef84e9bb7dbd7be6"}
Sep 11 17:45:30.632272 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.632240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:30.667546 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.667513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx"]
Sep 11 17:45:30.668145 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:30.668126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8rlb"]
Sep 11 17:45:30.671193 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:45:30.671164    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed8d103_440b_4ad5_a004_f36cb96b7a60.slice/crio-a03c03d7425240b2183ab315f8516dabb364924d2382f200f2152960c5c4d20b WatchSource:0}: Error finding container a03c03d7425240b2183ab315f8516dabb364924d2382f200f2152960c5c4d20b: Status 404 returned error can't find the container with id a03c03d7425240b2183ab315f8516dabb364924d2382f200f2152960c5c4d20b
Sep 11 17:45:30.671762 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:45:30.671732    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fec3a65_21c9_449e_9c55_f6240ff8a9d3.slice/crio-c5fa3ecd2dbad0816678b1ad041434f3540ee96f0fe9eaf9223e829dacc406a8 WatchSource:0}: Error finding container c5fa3ecd2dbad0816678b1ad041434f3540ee96f0fe9eaf9223e829dacc406a8: Status 404 returned error can't find the container with id c5fa3ecd2dbad0816678b1ad041434f3540ee96f0fe9eaf9223e829dacc406a8
Sep 11 17:45:31.233413 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.233378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:45:31.237156 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.236955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 17:45:31.313986 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.313952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:31.314155 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:31.314126    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:45:31.314155 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:31.314148    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb997f4b-95qss: secret "image-registry-tls" not found
Sep 11 17:45:31.314252 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:31.314230    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls podName:8baa67fa-6989-4b97-8ddd-c20e7a43dd7e nodeName:}" failed. No retries permitted until 2026-09-11 17:45:33.314207996 +0000 UTC m=+37.601742282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls") pod "image-registry-59bb997f4b-95qss" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e") : secret "image-registry-tls" not found
Sep 11 17:45:31.415107 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.415070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:31.415291 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:31.415247    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:31.415342 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:31.415326    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls podName:42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:33.41530447 +0000 UTC m=+37.702838763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls") pod "dns-default-5r5nc" (UID: "42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:31.473650 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.473612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8rlb" event={"ID":"eed8d103-440b-4ad5-a004-f36cb96b7a60","Type":"ContainerStarted","Data":"a03c03d7425240b2183ab315f8516dabb364924d2382f200f2152960c5c4d20b"}
Sep 11 17:45:31.475025 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.474995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx" event={"ID":"9fec3a65-21c9-449e-9c55-f6240ff8a9d3","Type":"ContainerStarted","Data":"c5fa3ecd2dbad0816678b1ad041434f3540ee96f0fe9eaf9223e829dacc406a8"}
Sep 11 17:45:31.480073 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.480040    2576 generic.go:356] "Generic (PLEG): container finished" podID="922f186b-ae36-4073-947a-7015e1eaa33c" containerID="95af41423fdc22cd7540fd9a4ca47dccad685e66469912e112f3583f8624b481" exitCode=0
Sep 11 17:45:31.480210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:31.480085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerDied","Data":"95af41423fdc22cd7540fd9a4ca47dccad685e66469912e112f3583f8624b481"}
Sep 11 17:45:32.493327 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:32.493289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" event={"ID":"922f186b-ae36-4073-947a-7015e1eaa33c","Type":"ContainerStarted","Data":"1224e5167d4a4d296e045ffdba4b5cf36e971d053a629b5a004400526b4cb1b1"}
Sep 11 17:45:32.540924 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:32.540882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:32.554072 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:32.553375    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8w7wb" podStartSLOduration=7.057770532 podStartE2EDuration="36.553351922s" totalImagesPullingTime="29.49558139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:32.552876258 +0000 UTC m=+36.840410589" watchObservedRunningTime="2026-09-11 17:45:32.553351922 +0000 UTC m=+36.840886235"
Sep 11 17:45:32.722720 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:32.722632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:32.884221 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:32.884180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:33.049690 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:33.049626    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:33.337585 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:33.337536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:33.337897 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:33.337836    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:45:33.337897 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:33.337863    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb997f4b-95qss: secret "image-registry-tls" not found
Sep 11 17:45:33.338199 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:33.337935    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls podName:8baa67fa-6989-4b97-8ddd-c20e7a43dd7e nodeName:}" failed. No retries permitted until 2026-09-11 17:45:37.337915209 +0000 UTC m=+41.625449512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls") pod "image-registry-59bb997f4b-95qss" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e") : secret "image-registry-tls" not found
Sep 11 17:45:33.438079 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:33.438044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:33.438255 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:33.438240    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:33.438312 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:33.438304    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls podName:42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:37.438285369 +0000 UTC m=+41.725819657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls") pod "dns-default-5r5nc" (UID: "42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:34.766815 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:34.766754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:34.915358 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:34.915328    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:35.024846 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:35.024776    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:37.370310 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:37.370262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:37.370795 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:37.370428    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:45:37.370795 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:37.370448    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb997f4b-95qss: secret "image-registry-tls" not found
Sep 11 17:45:37.370795 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:37.370507    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls podName:8baa67fa-6989-4b97-8ddd-c20e7a43dd7e nodeName:}" failed. No retries permitted until 2026-09-11 17:45:45.370490406 +0000 UTC m=+49.658024691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls") pod "image-registry-59bb997f4b-95qss" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e") : secret "image-registry-tls" not found
Sep 11 17:45:37.471582 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:37.471539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:37.471805 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:37.471717    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:37.471805 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:37.471795    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls podName:42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3 nodeName:}" failed. No retries permitted until 2026-09-11 17:45:45.471772316 +0000 UTC m=+49.759306602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls") pod "dns-default-5r5nc" (UID: "42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:40.522194 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.522092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8rlb" event={"ID":"eed8d103-440b-4ad5-a004-f36cb96b7a60","Type":"ContainerStarted","Data":"3f13e7f87d3634680504b9b08c192bf74430787d706c9799776eb5178902d71a"}
Sep 11 17:45:40.523629 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.523593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml" event={"ID":"f4e87e11-c799-40ac-9c3e-4f934cf748a1","Type":"ContainerStarted","Data":"f57bfa0c73303aaab7bb0ceeb13dc3635086da5d1f00ee60aafb4f61742510c3"}
Sep 11 17:45:40.523781 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.523704    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:40.525235 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.525198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx" event={"ID":"9fec3a65-21c9-449e-9c55-f6240ff8a9d3","Type":"ContainerStarted","Data":"70e18c029744347ea3572dd69d2444953f56fb72a8e02ee0f1abaeb78f20fa32"}
Sep 11 17:45:40.525696 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.525664    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml"
Sep 11 17:45:40.527267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.527247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" event={"ID":"c8fdd70d-3220-4b42-a2cc-873b9fe9160a","Type":"ContainerStarted","Data":"ff3d486817731f30b4a890271e619bce2d25164c206567c66d81b0467d5ad654"}
Sep 11 17:45:40.527346 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.527279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" event={"ID":"c8fdd70d-3220-4b42-a2cc-873b9fe9160a","Type":"ContainerStarted","Data":"3cd6bcd857f4f494abe81d3ad8b6bd7dfb589fa8802356e23bfb95b1d7cabd24"}
Sep 11 17:45:40.527346 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.527296    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" event={"ID":"c8fdd70d-3220-4b42-a2cc-873b9fe9160a","Type":"ContainerStarted","Data":"bd3a04d0a55aef047b8e6fa33f83ec38c38f2dcafa1cdd6e3934890615a9b6e7"}
Sep 11 17:45:40.538776 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.538727    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w8rlb" podStartSLOduration=2.3618861669999998 podStartE2EDuration="11.538711735s" totalImagesPullingTime="9.176825568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:40.538001694 +0000 UTC m=+44.825536000" watchObservedRunningTime="2026-09-11 17:45:40.538711735 +0000 UTC m=+44.826246041"
Sep 11 17:45:40.556073 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.556006    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659fcc7cd9-gkvml" podStartSLOduration=21.047803556 podStartE2EDuration="30.555982471s" totalImagesPullingTime="9.508178915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:40.554862098 +0000 UTC m=+44.842396404" watchObservedRunningTime="2026-09-11 17:45:40.555982471 +0000 UTC m=+44.843516776"
Sep 11 17:45:40.579257 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.579191    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" podStartSLOduration=21.055577351 podStartE2EDuration="30.579169594s" totalImagesPullingTime="9.523592243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:40.578337559 +0000 UTC m=+44.865871867" watchObservedRunningTime="2026-09-11 17:45:40.579169594 +0000 UTC m=+44.866703903"
Sep 11 17:45:40.595915 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:40.595859    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5487799bbb-gcznx" podStartSLOduration=21.419045506 podStartE2EDuration="30.595840147s" totalImagesPullingTime="9.176794641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:40.594971153 +0000 UTC m=+44.882505461" watchObservedRunningTime="2026-09-11 17:45:40.595840147 +0000 UTC m=+44.883374454"
Sep 11 17:45:43.955751 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:43.955720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:45.436128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:45.436083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:45:45.436490 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:45.436226    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:45:45.436490 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:45.436244    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb997f4b-95qss: secret "image-registry-tls" not found
Sep 11 17:45:45.436490 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:45.436310    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls podName:8baa67fa-6989-4b97-8ddd-c20e7a43dd7e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:01.436295882 +0000 UTC m=+65.723830167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls") pod "image-registry-59bb997f4b-95qss" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e") : secret "image-registry-tls" not found
Sep 11 17:45:45.537382 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:45.537330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:45:45.537583 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:45.537471    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:45:45.537583 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:45:45.537551    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls podName:42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:01.537533388 +0000 UTC m=+65.825067687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls") pod "dns-default-5r5nc" (UID: "42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3") : secret "dns-default-metrics-tls" not found
Sep 11 17:45:45.563586 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:45.563550    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:46.767462 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:46.767416    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:46.832319 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:46.832279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:55.441499 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:55.441438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:55.463411 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:55.463383    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mlbg"
Sep 11 17:45:55.552325 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:55.552290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:56.343261 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:56.343233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:45:56.442571 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:45:56.442533    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:01.043415 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.043366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:46:01.043897 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.043448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:46:01.046432 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.046412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 17:46:01.046531 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.046512    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 17:46:01.053693 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:01.053657    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 17:46:01.053785 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:01.053748    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs podName:38af65b6-7677-4b7d-a606-162a530e3713 nodeName:}" failed. No retries permitted until 2026-09-11 17:47:05.053730612 +0000 UTC m=+129.341264897 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs") pod "network-metrics-daemon-xh94l" (UID: "38af65b6-7677-4b7d-a606-162a530e3713") : secret "metrics-daemon-secret" not found
Sep 11 17:46:01.056825 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.056803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/671a78d2-e9aa-4b00-aca4-f25e8f4699df-original-pull-secret\") pod \"global-pull-secret-syncer-zjmng\" (UID: \"671a78d2-e9aa-4b00-aca4-f25e8f4699df\") " pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:46:01.144418 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.144374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:46:01.147513 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.147486    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 17:46:01.157623 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.157597    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 17:46:01.168108 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.168078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nww6r\" (UniqueName: \"kubernetes.io/projected/d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6-kube-api-access-nww6r\") pod \"network-check-target-lgqdb\" (UID: \"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6\") " pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:46:01.244295 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.244253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjmng"
Sep 11 17:46:01.446920 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.446881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:46:01.447097 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:01.447036    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:46:01.447097 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:01.447059    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb997f4b-95qss: secret "image-registry-tls" not found
Sep 11 17:46:01.447187 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:01.447118    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls podName:8baa67fa-6989-4b97-8ddd-c20e7a43dd7e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:33.447101361 +0000 UTC m=+97.734635646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls") pod "image-registry-59bb997f4b-95qss" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e") : secret "image-registry-tls" not found
Sep 11 17:46:01.452379 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.452355    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7dtkl\""
Sep 11 17:46:01.460554 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.460525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:46:01.536793 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.536759    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjmng"]
Sep 11 17:46:01.540207 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:46:01.540167    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671a78d2_e9aa_4b00_aca4_f25e8f4699df.slice/crio-6662a90812e150191a44733dcb09a2c7e5b18dff6b55626465f965ac7a213f50 WatchSource:0}: Error finding container 6662a90812e150191a44733dcb09a2c7e5b18dff6b55626465f965ac7a213f50: Status 404 returned error can't find the container with id 6662a90812e150191a44733dcb09a2c7e5b18dff6b55626465f965ac7a213f50
Sep 11 17:46:01.547952 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.547925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:46:01.548110 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:01.548088    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:46:01.548173 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:01.548161    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls podName:42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3 nodeName:}" failed. No retries permitted until 2026-09-11 17:46:33.548146687 +0000 UTC m=+97.835680991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls") pod "dns-default-5r5nc" (UID: "42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3") : secret "dns-default-metrics-tls" not found
Sep 11 17:46:01.586388 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.586301    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjmng" event={"ID":"671a78d2-e9aa-4b00-aca4-f25e8f4699df","Type":"ContainerStarted","Data":"6662a90812e150191a44733dcb09a2c7e5b18dff6b55626465f965ac7a213f50"}
Sep 11 17:46:01.753467 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:01.753375    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lgqdb"]
Sep 11 17:46:01.755894 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:46:01.755865    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a2a1e1_bc89_4e1e_86ed_1c1c2126cba6.slice/crio-64b15b75113938f840201364f543ee566ad543f2bd6797698e07ec58768ee525 WatchSource:0}: Error finding container 64b15b75113938f840201364f543ee566ad543f2bd6797698e07ec58768ee525: Status 404 returned error can't find the container with id 64b15b75113938f840201364f543ee566ad543f2bd6797698e07ec58768ee525
Sep 11 17:46:02.591094 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:02.591031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lgqdb" event={"ID":"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6","Type":"ContainerStarted","Data":"64b15b75113938f840201364f543ee566ad543f2bd6797698e07ec58768ee525"}
Sep 11 17:46:06.604729 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:06.604668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lgqdb" event={"ID":"d8a2a1e1-bc89-4e1e-86ed-1c1c2126cba6","Type":"ContainerStarted","Data":"96ee42888312fe22510bc2dac3792ea0eecf1ad12d54f61f39125c40e27c5fc8"}
Sep 11 17:46:06.605244 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:06.604795    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:46:06.606258 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:06.606234    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjmng" event={"ID":"671a78d2-e9aa-4b00-aca4-f25e8f4699df","Type":"ContainerStarted","Data":"5385eda12d9a7368606da3f81ec80dc53612663e00aca0fc0bd27e7b3c615848"}
Sep 11 17:46:06.624410 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:06.624353    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lgqdb" podStartSLOduration=66.305802326 podStartE2EDuration="1m10.624337939s" totalImagesPullingTime="4.318535613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:06.624009181 +0000 UTC m=+70.911543487" watchObservedRunningTime="2026-09-11 17:46:06.624337939 +0000 UTC m=+70.911872285"
Sep 11 17:46:06.642215 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:06.642155    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zjmng" podStartSLOduration=66.102711938 podStartE2EDuration="1m10.642138056s" totalImagesPullingTime="4.539426118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:06.641858472 +0000 UTC m=+70.929392780" watchObservedRunningTime="2026-09-11 17:46:06.642138056 +0000 UTC m=+70.929672342"
Sep 11 17:46:08.961324 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:08.961293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:09.054765 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:09.054726    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:10.003929 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:10.003894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:15.254996 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:15.254963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:15.331246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:15.331204    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:20.094652 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.094531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:20.195954 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.195921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:20.276259 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.276223    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:20.439143 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.439052    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-djzfb"]
Sep 11 17:46:20.443443 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.443418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.447145 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.447121    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 17:46:20.448492 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.448469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2rwzx\""
Sep 11 17:46:20.448734 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.448712    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 17:46:20.449158 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.449135    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 17:46:20.450045 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.449990    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 17:46:20.453129 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.453106    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:20.459781 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.459760    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-djzfb"]
Sep 11 17:46:20.484075 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.484031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.484075 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.484077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21785f2f-0f08-4504-8e36-ed49628ac46e-crio-socket\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.484329 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.484098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.484329 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.484262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21785f2f-0f08-4504-8e36-ed49628ac46e-data-volume\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.484329 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.484297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9pwf\" (UniqueName: \"kubernetes.io/projected/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-api-access-b9pwf\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.585626 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.585587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.585626 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.585627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21785f2f-0f08-4504-8e36-ed49628ac46e-crio-socket\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.585651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:20.585736    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.585752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21785f2f-0f08-4504-8e36-ed49628ac46e-crio-socket\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:20.585762    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:20.585815    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:21.085793206 +0000 UTC m=+85.373327512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:20.585841    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:21.085826811 +0000 UTC m=+85.373361096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.585884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21785f2f-0f08-4504-8e36-ed49628ac46e-data-volume\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.585896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.585903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9pwf\" (UniqueName: \"kubernetes.io/projected/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-api-access-b9pwf\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.586195 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.586114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21785f2f-0f08-4504-8e36-ed49628ac46e-data-volume\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.610375 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.610343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:20.626556 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.626523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9pwf\" (UniqueName: \"kubernetes.io/projected/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-api-access-b9pwf\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:20.734002 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:20.733909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:21.048351 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:21.048320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:21.090956 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:21.090922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:21.091128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:21.090972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:21.091128 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:21.091071    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:21.091128 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:21.091103    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:21.091286 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:21.091142    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:22.091121017 +0000 UTC m=+86.378655317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:21.091286 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:21.091161    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:22.091149575 +0000 UTC m=+86.378683859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:21.660714 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:21.660659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:22.099315 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:22.099280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:22.099511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:22.099334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:22.099511 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:22.099414    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:22.099511 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:22.099430    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:22.099511 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:22.099491    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:24.099476255 +0000 UTC m=+88.387010543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:22.099709 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:22.099563    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:24.099543525 +0000 UTC m=+88.387077814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:22.576907 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:22.576878    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nvqd8_2cae0089-7c28-4f35-a755-ab5573cdf3e4/dns-node-resolver/0.log"
Sep 11 17:46:22.641854 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:22.641824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:22.748548 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:22.748516    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:23.145985 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:23.145953    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:23.343163 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:23.343117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:23.580191 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:23.580170    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xz5xc_345198cd-000c-4f72-9fd7-b8035c183481/node-ca/0.log"
Sep 11 17:46:24.115111 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:24.115077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:24.115518 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:24.115123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:24.115518 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:24.115206    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:24.115518 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:24.115218    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:24.115518 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:24.115273    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:28.115259961 +0000 UTC m=+92.402794249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:24.115518 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:24.115285    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:28.115279455 +0000 UTC m=+92.402813739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:24.405882 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:24.405800    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8rlb_eed8d103-440b-4ad5-a004-f36cb96b7a60/serve-healthcheck-canary/0.log"
Sep 11 17:46:24.544202 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:24.544166    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:24.952700 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:24.952647    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:25.357175 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:25.357146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:26.169417 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:26.169386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:26.543263 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:26.543168    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:26.823140 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:26.823108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:27.107108 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:27.107020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:27.266919 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:27.266889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:28.060624 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:28.060591    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:28.146175 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:28.146144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:28.146327 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:28.146188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:28.146327 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:28.146261    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:46:28.146327 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:28.146276    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:28.146327 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:28.146321    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:36.146307286 +0000 UTC m=+100.433841575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:46:28.146475 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:46:28.146333    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm podName:21785f2f-0f08-4504-8e36-ed49628ac46e nodeName:}" failed. No retries permitted until 2026-09-11 17:46:36.146326251 +0000 UTC m=+100.433860535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djzfb" (UID: "21785f2f-0f08-4504-8e36-ed49628ac46e") : configmap "kube-rbac-proxy" not found
Sep 11 17:46:28.311075 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:28.310999    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:28.423928 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:28.423898    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:28.610089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:28.610004    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:28.864423 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:28.864342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:29.115181 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:29.115104    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:29.267748 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:29.267717    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:30.371924 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:30.371891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:30.600101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:30.600067    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:30.948479 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:30.948448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:31.192921 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:31.192887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:31.338033 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:31.338002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:31.863798 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:31.863762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:31.987434 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:31.987398    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:32.338653 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:32.338619    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:32.706403 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:32.706319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:32.909491 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:32.909458    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:33.494086 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.494040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:46:33.496605 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.496584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"image-registry-59bb997f4b-95qss\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") " pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:46:33.508764 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.508735    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:33.535058 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.535029    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h7qvz\""
Sep 11 17:46:33.542207 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.542187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:46:33.602897 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.596327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:46:33.622136 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.622050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3-metrics-tls\") pod \"dns-default-5r5nc\" (UID: \"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3\") " pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:46:33.727889 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.727854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:33.842951 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.842921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bb997f4b-95qss"]
Sep 11 17:46:33.846085 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:46:33.846053    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8baa67fa_6989_4b97_8ddd_c20e7a43dd7e.slice/crio-17602b6aa626df327ef580dae261386a3db81f91cc489ea39d618d787ad7ca69 WatchSource:0}: Error finding container 17602b6aa626df327ef580dae261386a3db81f91cc489ea39d618d787ad7ca69: Status 404 returned error can't find the container with id 17602b6aa626df327ef580dae261386a3db81f91cc489ea39d618d787ad7ca69
Sep 11 17:46:33.912888 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.912862    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tc7ww\""
Sep 11 17:46:33.920445 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:33.920426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:46:34.139793 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.139703    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:34.212139 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.212065    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5r5nc"]
Sep 11 17:46:34.215923 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:46:34.215885    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cb7fd1_8a1e_4c14_9b39_b1a1d7cddcc3.slice/crio-3775683c228da39c5b50175bd84798fa7a4d65bd630f52012c9571066311c7c6 WatchSource:0}: Error finding container 3775683c228da39c5b50175bd84798fa7a4d65bd630f52012c9571066311c7c6: Status 404 returned error can't find the container with id 3775683c228da39c5b50175bd84798fa7a4d65bd630f52012c9571066311c7c6
Sep 11 17:46:34.330936 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.330902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:34.553405 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.553371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:34.691051 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.691016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5r5nc" event={"ID":"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3","Type":"ContainerStarted","Data":"3775683c228da39c5b50175bd84798fa7a4d65bd630f52012c9571066311c7c6"}
Sep 11 17:46:34.692446 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.692421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb997f4b-95qss" event={"ID":"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e","Type":"ContainerStarted","Data":"a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a"}
Sep 11 17:46:34.692598 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.692459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb997f4b-95qss" event={"ID":"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e","Type":"ContainerStarted","Data":"17602b6aa626df327ef580dae261386a3db81f91cc489ea39d618d787ad7ca69"}
Sep 11 17:46:34.692598 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.692554    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:46:34.725002 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:34.724947    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59bb997f4b-95qss" podStartSLOduration=98.724930419 podStartE2EDuration="1m38.724930419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:34.724491753 +0000 UTC m=+99.012026059" watchObservedRunningTime="2026-09-11 17:46:34.724930419 +0000 UTC m=+99.012464734"
Sep 11 17:46:35.015626 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:35.015543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:35.166815 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:35.166784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:36.219870 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:36.219833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:36.220326 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:36.219921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:36.220531 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:36.220501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21785f2f-0f08-4504-8e36-ed49628ac46e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:36.223897 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:36.223866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21785f2f-0f08-4504-8e36-ed49628ac46e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djzfb\" (UID: \"21785f2f-0f08-4504-8e36-ed49628ac46e\") " pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:36.352354 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:36.352316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-djzfb"
Sep 11 17:46:36.663393 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:36.663359    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-djzfb"]
Sep 11 17:46:37.122928 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.122900    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:37.151982 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:46:37.151944    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21785f2f_0f08_4504_8e36_ed49628ac46e.slice/crio-763b179547b38e62daebca31858bb9870b64c6bf9c4e21d96944bdcca14fbd35 WatchSource:0}: Error finding container 763b179547b38e62daebca31858bb9870b64c6bf9c4e21d96944bdcca14fbd35: Status 404 returned error can't find the container with id 763b179547b38e62daebca31858bb9870b64c6bf9c4e21d96944bdcca14fbd35
Sep 11 17:46:37.277995 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.277960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:37.612743 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.612666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lgqdb"
Sep 11 17:46:37.666509 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.666475    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:37.704302 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.704262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5r5nc" event={"ID":"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3","Type":"ContainerStarted","Data":"067bdbe596b6dfa31cb0a4dbd342e5f0294714a7010980d1b189ec46c530231d"}
Sep 11 17:46:37.706125 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.706100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djzfb" event={"ID":"21785f2f-0f08-4504-8e36-ed49628ac46e","Type":"ContainerStarted","Data":"bf283e67d9986f7943d910e200c2ec7ce79be93bedbebcd93a469a04dc740a0e"}
Sep 11 17:46:37.706240 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.706157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djzfb" event={"ID":"21785f2f-0f08-4504-8e36-ed49628ac46e","Type":"ContainerStarted","Data":"763b179547b38e62daebca31858bb9870b64c6bf9c4e21d96944bdcca14fbd35"}
Sep 11 17:46:37.806300 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.806254    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:37.957349 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:37.957320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:38.711837 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:38.711792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djzfb" event={"ID":"21785f2f-0f08-4504-8e36-ed49628ac46e","Type":"ContainerStarted","Data":"d051760efd5628dfc0f25bdb21dfb1fa158bde4b325ff3d91d6c36d6d0695252"}
Sep 11 17:46:38.713895 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:38.713863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5r5nc" event={"ID":"42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3","Type":"ContainerStarted","Data":"4cb9c44c60ea7840e6fdec8ed39ffa300bd7dbe48284d311cacbdac9f645d9b1"}
Sep 11 17:46:38.714051 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:38.713996    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:46:38.748177 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:38.748112    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5r5nc" podStartSLOduration=66.457616572 podStartE2EDuration="1m9.748094977s" totalImagesPullingTime="3.290478405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:38.747506308 +0000 UTC m=+103.035040615" watchObservedRunningTime="2026-09-11 17:46:38.748094977 +0000 UTC m=+103.035629284"
Sep 11 17:46:38.780687 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:38.780637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:38.912416 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:38.912379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:39.135982 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:39.135942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:39.563923 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:39.563890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:40.722387 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:40.722349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djzfb" event={"ID":"21785f2f-0f08-4504-8e36-ed49628ac46e","Type":"ContainerStarted","Data":"64d716b3d384cb4aeb74d002fa6c1f617ef0f2662d8ad569ed7fecb8225bc378"}
Sep 11 17:46:40.756693 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:40.756629    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-djzfb" podStartSLOduration=18.310378807 podStartE2EDuration="20.756612862s" totalImagesPullingTime="2.446234055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:46:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:40.756169449 +0000 UTC m=+105.043703766" watchObservedRunningTime="2026-09-11 17:46:40.756612862 +0000 UTC m=+105.044147183"
Sep 11 17:46:41.804518 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:41.804488    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:43.070538 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:43.070510    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:43.237649 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:43.237604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:44.345303 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:44.345270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:44.564855 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:44.564809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:46.830566 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:46.830532    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:46.961730 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:46.961698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:47.731413 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:47.731367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:47.998096 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:47.998019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:48.720055 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:48.720026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5r5nc"
Sep 11 17:46:49.303909 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:49.303876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:49.506748 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:49.506714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:49.647615 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:49.647520    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:49.804917 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:49.804886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:49.965079 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:49.964981    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" podUID="c8fdd70d-3220-4b42-a2cc-873b9fe9160a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 17:46:51.333161 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:51.333128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:51.456558 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:51.456512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:52.417622 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:52.417584    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:52.606123 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:52.606086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:53.546715 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:53.546661    2576 patch_prober.go:28] interesting pod/image-registry-59bb997f4b-95qss container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 17:46:53.547100 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:53.546741    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59bb997f4b-95qss" podUID="8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:46:54.644901 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:54.644870    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:54.745899 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:54.745864    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:55.008002 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:55.007922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:55.701430 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:55.701403    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:46:56.311397 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:56.311348    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:56.396434 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:56.396395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:56.535830 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:56.535798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:56.606910 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:56.606838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:57.133898 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:57.133871    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:57.198695 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:57.198648    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:58.058597 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:58.058556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:59.149534 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:59.149499    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:59.249981 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:59.249950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:46:59.966143 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:46:59.966104    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" podUID="c8fdd70d-3220-4b42-a2cc-873b9fe9160a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 17:47:01.000052 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.000019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:01.168958 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.168921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:01.375920 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.375886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:01.540178 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.540150    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n2jq7"]
Sep 11 17:47:01.540338 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.540301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:01.543481 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.543462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.548320 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.548287    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 17:47:01.548320 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.548286    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 17:47:01.548511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.548333    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 17:47:01.548511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.548286    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 17:47:01.548511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.548293    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hxrkn\""
Sep 11 17:47:01.548511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.548375    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 17:47:01.561646 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.561622    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 17:47:01.697854 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.697767    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:01.719867 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.719829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.719867 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.719875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-sys\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.720089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.719890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-root\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.720089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.719951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-wtmp\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.720089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.720011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.720089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.720036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75lb6\" (UniqueName: \"kubernetes.io/projected/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-kube-api-access-75lb6\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.720089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.720074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-tls\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.720315 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.720183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-textfile\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.720315 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.720216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-metrics-client-ca\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.802515 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.802476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:01.821582 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-textfile\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821582 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-metrics-client-ca\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-sys\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-root\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-wtmp\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-sys\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75lb6\" (UniqueName: \"kubernetes.io/projected/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-kube-api-access-75lb6\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.821842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-root\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.822230 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-wtmp\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.822230 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.821896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-tls\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.822230 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.822032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-textfile\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.822230 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.822210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-metrics-client-ca\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.822420 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.822321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.824173 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.824148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.824291 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.824278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-node-exporter-tls\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.841668 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.841639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75lb6\" (UniqueName: \"kubernetes.io/projected/9f75b502-4e6c-4cae-a88a-e41d3f32e12c-kube-api-access-75lb6\") pod \"node-exporter-n2jq7\" (UID: \"9f75b502-4e6c-4cae-a88a-e41d3f32e12c\") " pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.852722 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.852694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2jq7"
Sep 11 17:47:01.865823 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:47:01.865790    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f75b502_4e6c_4cae_a88a_e41d3f32e12c.slice/crio-c5f3459f528a3fe9bb0749e95d0d310d2aa6e9ce5b51648bca9e423cbd7d9e47 WatchSource:0}: Error finding container c5f3459f528a3fe9bb0749e95d0d310d2aa6e9ce5b51648bca9e423cbd7d9e47: Status 404 returned error can't find the container with id c5f3459f528a3fe9bb0749e95d0d310d2aa6e9ce5b51648bca9e423cbd7d9e47
Sep 11 17:47:01.915804 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:01.915771    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:02.021546 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:02.021464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:02.315418 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:02.315390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:02.450783 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:02.450750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:02.552537 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:02.552494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:02.728796 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:02.728697    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:02.795258 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:02.795220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2jq7" event={"ID":"9f75b502-4e6c-4cae-a88a-e41d3f32e12c","Type":"ContainerStarted","Data":"c5f3459f528a3fe9bb0749e95d0d310d2aa6e9ce5b51648bca9e423cbd7d9e47"}
Sep 11 17:47:02.873195 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:02.873170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:03.800667 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:03.800634    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f75b502-4e6c-4cae-a88a-e41d3f32e12c" containerID="223421e993bf460a4df66387a12479a6f0857f349ba6a38a0d1e0158954e1f92" exitCode=0
Sep 11 17:47:03.801075 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:03.800702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2jq7" event={"ID":"9f75b502-4e6c-4cae-a88a-e41d3f32e12c","Type":"ContainerDied","Data":"223421e993bf460a4df66387a12479a6f0857f349ba6a38a0d1e0158954e1f92"}
Sep 11 17:47:04.446408 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:04.446368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:04.557526 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:04.557493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:04.780202 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:04.780124    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:04.806296 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:04.806265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2jq7" event={"ID":"9f75b502-4e6c-4cae-a88a-e41d3f32e12c","Type":"ContainerStarted","Data":"304077814c60e36b04dbe2c650857f43cd0ab41b62d2ca506cc72e9c1ba7da78"}
Sep 11 17:47:04.806666 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:04.806316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2jq7" event={"ID":"9f75b502-4e6c-4cae-a88a-e41d3f32e12c","Type":"ContainerStarted","Data":"3d35ef89a5ba4efa762268b0b5e831ed578fcebf256d51ba937c7d06fe0d0eb4"}
Sep 11 17:47:04.868303 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:04.868247    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n2jq7" podStartSLOduration=2.8037133340000002 podStartE2EDuration="3.868232252s" totalImagesPullingTime="993.540677ms" totalInitContainerRuntime="70.978241ms" isStatefulPod=true podCreationTimestamp="2026-09-11 17:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:04.867517471 +0000 UTC m=+129.155051774" watchObservedRunningTime="2026-09-11 17:47:04.868232252 +0000 UTC m=+129.155766573"
Sep 11 17:47:04.984045 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:04.984013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:05.146151 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:05.146114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:47:05.148592 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:05.148571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38af65b6-7677-4b7d-a606-162a530e3713-metrics-certs\") pod \"network-metrics-daemon-xh94l\" (UID: \"38af65b6-7677-4b7d-a606-162a530e3713\") " pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:47:05.348365 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:05.348336    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jfwbq\""
Sep 11 17:47:05.355666 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:05.355624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xh94l"
Sep 11 17:47:05.645695 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:05.645644    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xh94l"]
Sep 11 17:47:05.653755 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:47:05.653654    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38af65b6_7677_4b7d_a606_162a530e3713.slice/crio-30ff061182abfdcf45ca4da423e2b8cf930dc7744bcfeb62f9d19a9787682755 WatchSource:0}: Error finding container 30ff061182abfdcf45ca4da423e2b8cf930dc7744bcfeb62f9d19a9787682755: Status 404 returned error can't find the container with id 30ff061182abfdcf45ca4da423e2b8cf930dc7744bcfeb62f9d19a9787682755
Sep 11 17:47:05.810964 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:05.810919    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xh94l" event={"ID":"38af65b6-7677-4b7d-a606-162a530e3713","Type":"ContainerStarted","Data":"30ff061182abfdcf45ca4da423e2b8cf930dc7744bcfeb62f9d19a9787682755"}
Sep 11 17:47:05.914211 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:05.914110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:06.059056 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:06.059026    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:06.818266 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:06.818220    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:07.703576 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:07.703541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:07.820627 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:07.820591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xh94l" event={"ID":"38af65b6-7677-4b7d-a606-162a530e3713","Type":"ContainerStarted","Data":"ec67e9500e43b33dc094f70c58611eb348ae998755be22e21ab4ae5e119a03df"}
Sep 11 17:47:07.821000 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:07.820644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xh94l" event={"ID":"38af65b6-7677-4b7d-a606-162a530e3713","Type":"ContainerStarted","Data":"d476dbe8cdb93d11fead85480b253ae0772126ad8f479bef054294090aa841f4"}
Sep 11 17:47:07.841165 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:07.841109    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xh94l" podStartSLOduration=130.714419263 podStartE2EDuration="2m11.841093133s" totalImagesPullingTime="1.12667387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:07.840557075 +0000 UTC m=+132.128091385" watchObservedRunningTime="2026-09-11 17:47:07.841093133 +0000 UTC m=+132.128627439"
Sep 11 17:47:08.117877 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:08.117842    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:08.215422 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:08.215374    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:09.162454 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:09.162414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:09.287382 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:09.287289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:09.965441 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:09.965399    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" podUID="c8fdd70d-3220-4b42-a2cc-873b9fe9160a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 17:47:09.965622 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:09.965471    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh"
Sep 11 17:47:09.965985 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:09.965956    2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ff3d486817731f30b4a890271e619bce2d25164c206567c66d81b0467d5ad654"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 11 17:47:09.966029 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:09.966011    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" podUID="c8fdd70d-3220-4b42-a2cc-873b9fe9160a" containerName="service-proxy" containerID="cri-o://ff3d486817731f30b4a890271e619bce2d25164c206567c66d81b0467d5ad654" gracePeriod=30
Sep 11 17:47:10.832455 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:10.832423    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8fdd70d-3220-4b42-a2cc-873b9fe9160a" containerID="ff3d486817731f30b4a890271e619bce2d25164c206567c66d81b0467d5ad654" exitCode=2
Sep 11 17:47:10.832843 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:10.832494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" event={"ID":"c8fdd70d-3220-4b42-a2cc-873b9fe9160a","Type":"ContainerDied","Data":"ff3d486817731f30b4a890271e619bce2d25164c206567c66d81b0467d5ad654"}
Sep 11 17:47:10.832843 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:10.832545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78856f7-jxtlh" event={"ID":"c8fdd70d-3220-4b42-a2cc-873b9fe9160a","Type":"ContainerStarted","Data":"3957b4e320ced2bc78cf90a0ba9b4dc4ac74a70c483b807549539f3c65322268"}
Sep 11 17:47:11.031859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:11.031820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:11.145309 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:11.145209    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:12.375229 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:12.375119    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:12.477512 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:12.477477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:12.975903 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:12.975870    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:13.108697 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:13.108651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:13.667533 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:13.667441    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59bb997f4b-95qss"]
Sep 11 17:47:13.862167 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:13.862127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:13.965430 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:13.965346    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:16.280021 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:16.279988    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:17.522885 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:17.522854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:17.614650 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:17.614616    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:19.337219 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:19.337182    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:19.445508 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:19.445478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:21.420735 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:21.420698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:21.722333 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:21.722250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:21.861858 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:21.861827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:30.468831 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:30.468792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:30.594827 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:30.594790    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:30.673155 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:30.673120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:32.456238 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:32.456207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:32.538168 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:32.538138    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:47:38.686283 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.686242    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59bb997f4b-95qss" podUID="8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" containerName="registry" containerID="cri-o://a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a" gracePeriod=30
Sep 11 17:47:38.925362 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.925338    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:47:38.927142 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.927115    2576 generic.go:356] "Generic (PLEG): container finished" podID="8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" containerID="a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a" exitCode=0
Sep 11 17:47:38.927248 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.927155    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb997f4b-95qss"
Sep 11 17:47:38.927248 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.927158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb997f4b-95qss" event={"ID":"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e","Type":"ContainerDied","Data":"a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a"}
Sep 11 17:47:38.927321 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.927281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb997f4b-95qss" event={"ID":"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e","Type":"ContainerDied","Data":"17602b6aa626df327ef580dae261386a3db81f91cc489ea39d618d787ad7ca69"}
Sep 11 17:47:38.927321 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.927307    2576 scope.go:117] "RemoveContainer" containerID="a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a"
Sep 11 17:47:38.935789 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.935769    2576 scope.go:117] "RemoveContainer" containerID="a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a"
Sep 11 17:47:38.936115 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:47:38.936091    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a\": container with ID starting with a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a not found: ID does not exist" containerID="a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a"
Sep 11 17:47:38.936210 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.936124    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a"} err="failed to get container status \"a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a\": rpc error: code = NotFound desc = could not find container \"a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a\": container with ID starting with a51a51d2be506ccf41bffd14529143a27f2284c97f19198e45cb04df9ee7fd6a not found: ID does not exist"
Sep 11 17:47:38.981464 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981372    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-ca-trust-extracted\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.981464 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-certificates\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.981464 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981458    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-installation-pull-secrets\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.981762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981489    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sxq5\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-kube-api-access-9sxq5\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.981762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981511    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-bound-sa-token\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.981762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981546    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-image-registry-private-configuration\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.981762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.981762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981617    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-trusted-ca\") pod \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\" (UID: \"8baa67fa-6989-4b97-8ddd-c20e7a43dd7e\") "
Sep 11 17:47:38.982006 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.981890    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:47:38.982464 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.982412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:47:38.984220 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.984193    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:47:38.984565 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.984542    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:47:38.984666 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.984563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:47:38.984666 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.984638    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:47:38.984812 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.984665    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-kube-api-access-9sxq5" (OuterVolumeSpecName: "kube-api-access-9sxq5") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "kube-api-access-9sxq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:47:38.989894 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:38.989862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" (UID: "8baa67fa-6989-4b97-8ddd-c20e7a43dd7e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:47:39.082124 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082071    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sxq5\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-kube-api-access-9sxq5\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.082124 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082118    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-bound-sa-token\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.082124 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082129    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-image-registry-private-configuration\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.082124 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082140    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.082369 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082148    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-trusted-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.082369 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082155    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-ca-trust-extracted\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.082369 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082163    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-registry-certificates\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.082369 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.082172    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e-installation-pull-secrets\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:47:39.249205 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.249175    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59bb997f4b-95qss"]
Sep 11 17:47:39.255320 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:39.255294    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59bb997f4b-95qss"]
Sep 11 17:47:40.237520 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:47:40.237483    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" path="/var/lib/kubelet/pods/8baa67fa-6989-4b97-8ddd-c20e7a43dd7e/volumes"
Sep 11 17:48:12.989263 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:12.989226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:20.785562 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:20.785523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:21.116429 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:21.116392    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:24.436432 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:24.436389    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:24.654136 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:24.654103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:29.219717 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:29.219664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:29.314393 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:29.314357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:36.072752 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:36.072710    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:36.145807 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:36.145752    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:47.892219 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:47.892181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:47.950050 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:47.950022    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:48.259094 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:48.259010    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:48.360226 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:48.360193    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:48:48.434176 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:48:48.434149    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:49:02.526054 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:49:02.526020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:49:02.614873 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:49:02.614842    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:49:22.904279 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:49:22.904202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:49:32.290743 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:49:32.290700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:49:32.390811 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:49:32.390783    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:49:56.142897 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:49:56.142868    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 17:50:28.018406 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:28.018369    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:29.303850 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:29.303816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:30.424742 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.424709    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"]
Sep 11 17:50:30.425188 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.425012    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" containerName="registry"
Sep 11 17:50:30.425188 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.425028    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" containerName="registry"
Sep 11 17:50:30.425188 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.425101    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8baa67fa-6989-4b97-8ddd-c20e7a43dd7e" containerName="registry"
Sep 11 17:50:30.427893 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.427873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:30.431723 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.431706    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:50:30.431917 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.431903    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g8d6l\""
Sep 11 17:50:30.431967 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.431943    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 17:50:30.440350 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.440328    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"]
Sep 11 17:50:30.486899 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.486873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc469735-f7fb-42f0-9f4b-a9a72aa71943-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkbff\" (UID: \"bc469735-f7fb-42f0-9f4b-a9a72aa71943\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:30.487004 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.486912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkz4r\" (UniqueName: \"kubernetes.io/projected/bc469735-f7fb-42f0-9f4b-a9a72aa71943-kube-api-access-vkz4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkbff\" (UID: \"bc469735-f7fb-42f0-9f4b-a9a72aa71943\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:30.587785 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.587745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc469735-f7fb-42f0-9f4b-a9a72aa71943-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkbff\" (UID: \"bc469735-f7fb-42f0-9f4b-a9a72aa71943\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:30.587945 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.587795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkz4r\" (UniqueName: \"kubernetes.io/projected/bc469735-f7fb-42f0-9f4b-a9a72aa71943-kube-api-access-vkz4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkbff\" (UID: \"bc469735-f7fb-42f0-9f4b-a9a72aa71943\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:30.588132 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.588110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc469735-f7fb-42f0-9f4b-a9a72aa71943-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkbff\" (UID: \"bc469735-f7fb-42f0-9f4b-a9a72aa71943\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:30.600535 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.600504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkz4r\" (UniqueName: \"kubernetes.io/projected/bc469735-f7fb-42f0-9f4b-a9a72aa71943-kube-api-access-vkz4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkbff\" (UID: \"bc469735-f7fb-42f0-9f4b-a9a72aa71943\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:30.736560 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:30.736471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"
Sep 11 17:50:31.012198 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:31.012149    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff"]
Sep 11 17:50:31.015151 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:50:31.015122    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc469735_f7fb_42f0_9f4b_a9a72aa71943.slice/crio-5c13391d8bb2991d4a109f4baa176ad38611daa9d1a565f8ffa73c5a9ca3110c WatchSource:0}: Error finding container 5c13391d8bb2991d4a109f4baa176ad38611daa9d1a565f8ffa73c5a9ca3110c: Status 404 returned error can't find the container with id 5c13391d8bb2991d4a109f4baa176ad38611daa9d1a565f8ffa73c5a9ca3110c
Sep 11 17:50:31.018325 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:31.018310    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:50:31.483873 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:31.483836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff" event={"ID":"bc469735-f7fb-42f0-9f4b-a9a72aa71943","Type":"ContainerStarted","Data":"5c13391d8bb2991d4a109f4baa176ad38611daa9d1a565f8ffa73c5a9ca3110c"}
Sep 11 17:50:32.027185 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:32.027114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:32.130888 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:32.130851    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:34.292288 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:34.292260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:34.390730 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:34.390693    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:34.496840 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:34.496807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff" event={"ID":"bc469735-f7fb-42f0-9f4b-a9a72aa71943","Type":"ContainerStarted","Data":"ddb7375653375a291d15e1a069e4ed70bfb59b65d2fab42956367646ecefc3db"}
Sep 11 17:50:34.519549 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:34.519486    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkbff" podStartSLOduration=2.059811849 podStartE2EDuration="4.51947236s" totalImagesPullingTime="2.459660511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:50:34.518156103 +0000 UTC m=+338.805690410" watchObservedRunningTime="2026-09-11 17:50:34.51947236 +0000 UTC m=+338.807006666"
Sep 11 17:50:34.930466 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:34.930434    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:35.064381 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:35.064347    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:36.711829 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:36.711797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:37.115979 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:37.115949    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:38.811874 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:38.811834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:38.889569 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:38.889536    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:44.093759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:44.093728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:45.652244 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.652210    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t6vk5"]
Sep 11 17:50:45.655481 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.655459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:45.658066 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.658043    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 17:50:45.658177 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.658084    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hsfg2\""
Sep 11 17:50:45.659088 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.659066    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 17:50:45.666384 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.666364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t6vk5"]
Sep 11 17:50:45.676708 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.676666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa0293db-be71-4f08-b04b-81159676e1a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-t6vk5\" (UID: \"fa0293db-be71-4f08-b04b-81159676e1a3\") " pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:45.676801 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.676752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd4n2\" (UniqueName: \"kubernetes.io/projected/fa0293db-be71-4f08-b04b-81159676e1a3-kube-api-access-xd4n2\") pod \"cert-manager-55b4d954d5-t6vk5\" (UID: \"fa0293db-be71-4f08-b04b-81159676e1a3\") " pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:45.777222 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.777183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd4n2\" (UniqueName: \"kubernetes.io/projected/fa0293db-be71-4f08-b04b-81159676e1a3-kube-api-access-xd4n2\") pod \"cert-manager-55b4d954d5-t6vk5\" (UID: \"fa0293db-be71-4f08-b04b-81159676e1a3\") " pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:45.777396 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.777262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa0293db-be71-4f08-b04b-81159676e1a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-t6vk5\" (UID: \"fa0293db-be71-4f08-b04b-81159676e1a3\") " pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:45.786104 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.786072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa0293db-be71-4f08-b04b-81159676e1a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-t6vk5\" (UID: \"fa0293db-be71-4f08-b04b-81159676e1a3\") " pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:45.786220 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.786124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd4n2\" (UniqueName: \"kubernetes.io/projected/fa0293db-be71-4f08-b04b-81159676e1a3-kube-api-access-xd4n2\") pod \"cert-manager-55b4d954d5-t6vk5\" (UID: \"fa0293db-be71-4f08-b04b-81159676e1a3\") " pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:45.964506 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:45.964415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-t6vk5"
Sep 11 17:50:46.154618 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:46.154582    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:46.238892 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:46.238813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t6vk5"]
Sep 11 17:50:46.241737 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:50:46.241710    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa0293db_be71_4f08_b04b_81159676e1a3.slice/crio-93c2c27db56279c0b74a37db7cfced0b634a5ca27b43faac6618a57da2acf59c WatchSource:0}: Error finding container 93c2c27db56279c0b74a37db7cfced0b634a5ca27b43faac6618a57da2acf59c: Status 404 returned error can't find the container with id 93c2c27db56279c0b74a37db7cfced0b634a5ca27b43faac6618a57da2acf59c
Sep 11 17:50:46.538507 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:46.538421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-t6vk5" event={"ID":"fa0293db-be71-4f08-b04b-81159676e1a3","Type":"ContainerStarted","Data":"93c2c27db56279c0b74a37db7cfced0b634a5ca27b43faac6618a57da2acf59c"}
Sep 11 17:50:47.695820 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:47.695782    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:48.427557 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:48.427487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:48.521333 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:48.521299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:49.552446 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:49.552415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-t6vk5" event={"ID":"fa0293db-be71-4f08-b04b-81159676e1a3","Type":"ContainerStarted","Data":"7b7524e8447bfb6ef7af5d5ada077e6afbd9817469061aedc3fbc966926557d0"}
Sep 11 17:50:49.587834 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:49.587785    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-t6vk5" podStartSLOduration=1.8334413760000001 podStartE2EDuration="4.58776919s" totalImagesPullingTime="2.754327814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:50:49.587368308 +0000 UTC m=+353.874902615" watchObservedRunningTime="2026-09-11 17:50:49.58776919 +0000 UTC m=+353.875303496"
Sep 11 17:50:50.514351 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:50.514314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:50.695238 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:50.695208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:53.944617 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:53.944576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:54.052719 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:54.052661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:50:55.790790 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:50:55.790760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:07.665267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:07.665228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:07.785572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:07.785535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:08.285689 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.285641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:08.617488 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.617457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:08.764382 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.764347    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:08.778373 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.778346    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"]
Sep 11 17:51:08.783782 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.783766    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.800837 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.800815    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 17:51:08.801165 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.801151    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lgb85\""
Sep 11 17:51:08.801381 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.801367    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 17:51:08.801458 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.801441    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 17:51:08.813485 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.813461    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 17:51:08.836817 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.836793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9f5h\" (UniqueName: \"kubernetes.io/projected/99c29099-af61-47d1-8e5b-e29e62f33dc7-kube-api-access-n9f5h\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.836910 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.836824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c29099-af61-47d1-8e5b-e29e62f33dc7-tmp\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.836910 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.836848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99c29099-af61-47d1-8e5b-e29e62f33dc7-manifests\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.836981 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.836908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99c29099-af61-47d1-8e5b-e29e62f33dc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.836981 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.836933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99c29099-af61-47d1-8e5b-e29e62f33dc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.911460 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.911401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"]
Sep 11 17:51:08.937721 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.937698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9f5h\" (UniqueName: \"kubernetes.io/projected/99c29099-af61-47d1-8e5b-e29e62f33dc7-kube-api-access-n9f5h\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.937812 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.937726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c29099-af61-47d1-8e5b-e29e62f33dc7-tmp\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.937812 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.937747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99c29099-af61-47d1-8e5b-e29e62f33dc7-manifests\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.937812 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.937771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99c29099-af61-47d1-8e5b-e29e62f33dc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.937812 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.937790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99c29099-af61-47d1-8e5b-e29e62f33dc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.938145 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.938126    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99c29099-af61-47d1-8e5b-e29e62f33dc7-manifests\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.940227 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.940202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c29099-af61-47d1-8e5b-e29e62f33dc7-tmp\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.940330 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.940314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99c29099-af61-47d1-8e5b-e29e62f33dc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.940330 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.940325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99c29099-af61-47d1-8e5b-e29e62f33dc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:08.954194 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:08.954167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9f5h\" (UniqueName: \"kubernetes.io/projected/99c29099-af61-47d1-8e5b-e29e62f33dc7-kube-api-access-n9f5h\") pod \"opendatahub-operator-controller-manager-6f44bff486-rk2qc\" (UID: \"99c29099-af61-47d1-8e5b-e29e62f33dc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:09.020660 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.020632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:09.093016 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.092996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:09.121695 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.121651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:09.222482 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.222410    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:09.323594 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.323570    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:09.384751 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.384731    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"]
Sep 11 17:51:09.389721 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:51:09.389695    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c29099_af61_47d1_8e5b_e29e62f33dc7.slice/crio-492c5dc4d716961a9237ed8961dd61f59d8c4830549049587ae6e283b63482cd WatchSource:0}: Error finding container 492c5dc4d716961a9237ed8961dd61f59d8c4830549049587ae6e283b63482cd: Status 404 returned error can't find the container with id 492c5dc4d716961a9237ed8961dd61f59d8c4830549049587ae6e283b63482cd
Sep 11 17:51:09.446110 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.446084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:09.547070 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.547043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:09.618121 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.618097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc" event={"ID":"99c29099-af61-47d1-8e5b-e29e62f33dc7","Type":"ContainerStarted","Data":"492c5dc4d716961a9237ed8961dd61f59d8c4830549049587ae6e283b63482cd"}
Sep 11 17:51:09.643059 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:09.643017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:12.632206 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:12.632171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc" event={"ID":"99c29099-af61-47d1-8e5b-e29e62f33dc7","Type":"ContainerStarted","Data":"c3a8e17a362eee7d85379cfe71896a0abd1a5407fff0f6fa9fea9003337df065"}
Sep 11 17:51:13.637183 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:13.637148    2576 generic.go:356] "Generic (PLEG): container finished" podID="99c29099-af61-47d1-8e5b-e29e62f33dc7" containerID="c3a8e17a362eee7d85379cfe71896a0abd1a5407fff0f6fa9fea9003337df065" exitCode=0
Sep 11 17:51:13.637550 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:13.637238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc" event={"ID":"99c29099-af61-47d1-8e5b-e29e62f33dc7","Type":"ContainerDied","Data":"c3a8e17a362eee7d85379cfe71896a0abd1a5407fff0f6fa9fea9003337df065"}
Sep 11 17:51:14.642966 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:14.642936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc" event={"ID":"99c29099-af61-47d1-8e5b-e29e62f33dc7","Type":"ContainerStarted","Data":"278828fb2a8803477286da818cd2dae974168895b800ca716268d5fc57a58d38"}
Sep 11 17:51:14.643329 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:14.643075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:14.669083 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:14.669025    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc" podStartSLOduration=2.276278939 podStartE2EDuration="6.669007189s" totalImagesPullingTime="3.381726674s" totalInitContainerRuntime="1.011001576s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:14.668474295 +0000 UTC m=+378.956008603" watchObservedRunningTime="2026-09-11 17:51:14.669007189 +0000 UTC m=+378.956541497"
Sep 11 17:51:25.648912 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:25.648880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f44bff486-rk2qc"
Sep 11 17:51:25.978024 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:25.977943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:26.211234 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:26.211199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:29.041370 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.041330    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:29.328930 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.328890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:29.746518 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.746429    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"]
Sep 11 17:51:29.746903 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.746878    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:29.751977 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.751957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.762719 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.762664    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 17:51:29.762829 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.762800    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 17:51:29.763015 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.762995    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 17:51:29.763786 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.763770    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 17:51:29.784931 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.784904    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"]
Sep 11 17:51:29.786016 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.785925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65prm\" (UniqueName: \"kubernetes.io/projected/7f51b439-46e7-45e2-bc92-c3adfb817d2d-kube-api-access-65prm\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.786263 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.786242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tmp\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.786440 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.786423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tls-certs\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.887756 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.887718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tmp\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.887923 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.887765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tls-certs\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.887923 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.887791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65prm\" (UniqueName: \"kubernetes.io/projected/7f51b439-46e7-45e2-bc92-c3adfb817d2d-kube-api-access-65prm\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.887923 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:51:29.887881    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 11 17:51:29.888029 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:51:29.887958    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tls-certs podName:7f51b439-46e7-45e2-bc92-c3adfb817d2d nodeName:}" failed. No retries permitted until 2026-09-11 17:51:30.387937032 +0000 UTC m=+394.675471324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tls-certs") pod "kube-auth-proxy-77c49cb9c9-mtb4x" (UID: "7f51b439-46e7-45e2-bc92-c3adfb817d2d") : secret "kube-auth-proxy-tls" not found
Sep 11 17:51:29.890099 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.890081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tmp\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:29.906778 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:29.906754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65prm\" (UniqueName: \"kubernetes.io/projected/7f51b439-46e7-45e2-bc92-c3adfb817d2d-kube-api-access-65prm\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:30.315327 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:30.315296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:30.392805 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:30.392770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tls-certs\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:30.395446 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:30.395417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f51b439-46e7-45e2-bc92-c3adfb817d2d-tls-certs\") pod \"kube-auth-proxy-77c49cb9c9-mtb4x\" (UID: \"7f51b439-46e7-45e2-bc92-c3adfb817d2d\") " pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:30.660877 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:30.660792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"
Sep 11 17:51:30.939044 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:30.938954    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x"]
Sep 11 17:51:30.941578 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:51:30.941546    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f51b439_46e7_45e2_bc92_c3adfb817d2d.slice/crio-50f12cf6646bd7b487a7da1be8734c2525911d174a33c1b50e92e01a9cc1937e WatchSource:0}: Error finding container 50f12cf6646bd7b487a7da1be8734c2525911d174a33c1b50e92e01a9cc1937e: Status 404 returned error can't find the container with id 50f12cf6646bd7b487a7da1be8734c2525911d174a33c1b50e92e01a9cc1937e
Sep 11 17:51:31.511602 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.511566    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:31.614854 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.614822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:31.712062 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.711991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x" event={"ID":"7f51b439-46e7-45e2-bc92-c3adfb817d2d","Type":"ContainerStarted","Data":"50f12cf6646bd7b487a7da1be8734c2525911d174a33c1b50e92e01a9cc1937e"}
Sep 11 17:51:31.945132 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.945090    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"]
Sep 11 17:51:31.948460 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.948422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:31.957363 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.957141    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 17:51:31.957363 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.957164    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 17:51:31.957363 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.957141    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 17:51:31.957618 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.957448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5jnhm\""
Sep 11 17:51:31.958904 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.958878    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 17:51:31.982656 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.982595    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:31.984279 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:31.984255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"]
Sep 11 17:51:32.005403 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.005372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.005560 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.005421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zlt5\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-kube-api-access-4zlt5\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.005560 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.005464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.005560 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.005495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.005767 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.005559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.005767 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.005603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c076c6fa-1320-4f80-963c-9da5185d415f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.005767 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.005655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106383 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106383 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c076c6fa-1320-4f80-963c-9da5185d415f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106383 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106383 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106383 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlt5\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-kube-api-access-4zlt5\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106383 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106383 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.106999 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.106858    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:32.107183 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.107135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.109593 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.109547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c076c6fa-1320-4f80-963c-9da5185d415f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.109783 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.109760    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.110119 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.110082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.110879 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.110835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.116924 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.116895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.119045 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.119022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zlt5\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-kube-api-access-4zlt5\") pod \"istiod-openshift-gateway-7b7995d5cd-k9bx7\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.261152 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.261068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:32.559087 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:32.558736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"]
Sep 11 17:51:33.182379 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:33.182342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:33.816938 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:51:33.816896    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc076c6fa_1320_4f80_963c_9da5185d415f.slice/crio-62ff24d62a92f6159ac279c6fbcf517b3436878533f646f40f0b7d02b937e6e1 WatchSource:0}: Error finding container 62ff24d62a92f6159ac279c6fbcf517b3436878533f646f40f0b7d02b937e6e1: Status 404 returned error can't find the container with id 62ff24d62a92f6159ac279c6fbcf517b3436878533f646f40f0b7d02b937e6e1
Sep 11 17:51:34.727574 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:34.727475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x" event={"ID":"7f51b439-46e7-45e2-bc92-c3adfb817d2d","Type":"ContainerStarted","Data":"9486509cd471d2d2654927c696ea6f83b5d3e87bc11fb955ed006b7f7905888a"}
Sep 11 17:51:34.729118 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:34.729084    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7" event={"ID":"c076c6fa-1320-4f80-963c-9da5185d415f","Type":"ContainerStarted","Data":"62ff24d62a92f6159ac279c6fbcf517b3436878533f646f40f0b7d02b937e6e1"}
Sep 11 17:51:34.745992 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:34.745932    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x" podStartSLOduration=2.821156828 podStartE2EDuration="5.745912463s" totalImagesPullingTime="2.924755635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:34.744654074 +0000 UTC m=+399.032188374" watchObservedRunningTime="2026-09-11 17:51:34.745912463 +0000 UTC m=+399.033446770"
Sep 11 17:51:36.334266 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:36.334230    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:51:36.334531 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:36.334297    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:51:36.739009 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:36.738916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7" event={"ID":"c076c6fa-1320-4f80-963c-9da5185d415f","Type":"ContainerStarted","Data":"6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e"}
Sep 11 17:51:36.739176 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:36.739044    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:36.761990 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:36.761936    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7" podStartSLOduration=3.246936708 podStartE2EDuration="5.761915678s" totalImagesPullingTime="2.51497897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:36.760930521 +0000 UTC m=+401.048464827" watchObservedRunningTime="2026-09-11 17:51:36.761915678 +0000 UTC m=+401.049449985"
Sep 11 17:51:36.863046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:36.863005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:36.964342 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:36.964313    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:37.563851 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:37.563777    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:37.748946 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:37.748902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:37.750602 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:37.750550    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:37.846618 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:37.846546    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:39.878774 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:39.878739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:39.976173 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:39.976143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:40.100198 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:40.100154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:40.381127 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:40.381094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:40.693802 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:40.693715    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:40.832036 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:40.832008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:46.404308 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:46.404270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:48.122556 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.122519    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"]
Sep 11 17:51:48.125522 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.125504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.154923 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.154894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"]
Sep 11 17:51:48.243134 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.243099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7556\" (UniqueName: \"kubernetes.io/projected/ecb8b23b-66df-4696-a2e7-96af6287f9df-kube-api-access-d7556\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.243336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.243140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.243336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.243162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb8b23b-66df-4696-a2e7-96af6287f9df-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.243336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.243213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.243336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.243247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.243336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.243311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.243336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.243338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.344481 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.344441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.344481 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.344487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.344759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.344512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7556\" (UniqueName: \"kubernetes.io/projected/ecb8b23b-66df-4696-a2e7-96af6287f9df-kube-api-access-d7556\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.344759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.344530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.344759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.344548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb8b23b-66df-4696-a2e7-96af6287f9df-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.344759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.344564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.344759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.344719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.345638 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.345609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.347111 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.347090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.347197 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.347180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.347310 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.347289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.347348 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.347319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecb8b23b-66df-4696-a2e7-96af6287f9df-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.355399 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.355382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7556\" (UniqueName: \"kubernetes.io/projected/ecb8b23b-66df-4696-a2e7-96af6287f9df-kube-api-access-d7556\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.355689 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.355663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecb8b23b-66df-4696-a2e7-96af6287f9df-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l9crn\" (UID: \"ecb8b23b-66df-4696-a2e7-96af6287f9df\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:48.434870 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:48.434797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:52.700730 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:52.700690    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"]
Sep 11 17:51:52.712292 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:51:52.712257    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb8b23b_66df_4696_a2e7_96af6287f9df.slice/crio-dc9272183ced580ba9f7a037a1c113a82f2cdb01754cfb46f66e4fbf717ae4d7 WatchSource:0}: Error finding container dc9272183ced580ba9f7a037a1c113a82f2cdb01754cfb46f66e4fbf717ae4d7: Status 404 returned error can't find the container with id dc9272183ced580ba9f7a037a1c113a82f2cdb01754cfb46f66e4fbf717ae4d7
Sep 11 17:51:52.715368 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:52.715333    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:51:52.715454 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:52.715395    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:51:52.809909 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:52.809876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn" event={"ID":"ecb8b23b-66df-4696-a2e7-96af6287f9df","Type":"ContainerStarted","Data":"6d37a24cd6f422f5bfdfc67751c887ae9e23b45c4cf7b7438abc87c5c44e8513"}
Sep 11 17:51:52.810072 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:52.809922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn" event={"ID":"ecb8b23b-66df-4696-a2e7-96af6287f9df","Type":"ContainerStarted","Data":"dc9272183ced580ba9f7a037a1c113a82f2cdb01754cfb46f66e4fbf717ae4d7"}
Sep 11 17:51:52.810072 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:52.810012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:53.408867 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:53.408807    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn" podStartSLOduration=5.408789278 podStartE2EDuration="5.408789278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:51:53.407660292 +0000 UTC m=+417.695194599" watchObservedRunningTime="2026-09-11 17:51:53.408789278 +0000 UTC m=+417.696323585"
Sep 11 17:51:53.815472 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:53.815441    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-l9crn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 17:51:53.815907 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:53.815512    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn" podUID="ecb8b23b-66df-4696-a2e7-96af6287f9df" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:51:54.611268 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:54.611214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:54.902756 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:54.902633    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:56.815273 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:56.815243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn"
Sep 11 17:51:56.982391 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:56.982358    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"]
Sep 11 17:51:56.982623 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:56.982593    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7" podUID="c076c6fa-1320-4f80-963c-9da5185d415f" containerName="discovery" containerID="cri-o://6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e" gracePeriod=30
Sep 11 17:51:57.226834 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.226811    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:57.311033 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.310997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-ca-configmap\") pod \"c076c6fa-1320-4f80-963c-9da5185d415f\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") "
Sep 11 17:51:57.311196 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311042    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c076c6fa-1320-4f80-963c-9da5185d415f-local-certs\") pod \"c076c6fa-1320-4f80-963c-9da5185d415f\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") "
Sep 11 17:51:57.311196 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-dns-cert\") pod \"c076c6fa-1320-4f80-963c-9da5185d415f\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") "
Sep 11 17:51:57.311196 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311172    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-kubeconfig\") pod \"c076c6fa-1320-4f80-963c-9da5185d415f\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") "
Sep 11 17:51:57.311377 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311242    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-istio-token\") pod \"c076c6fa-1320-4f80-963c-9da5185d415f\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") "
Sep 11 17:51:57.311377 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zlt5\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-kube-api-access-4zlt5\") pod \"c076c6fa-1320-4f80-963c-9da5185d415f\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") "
Sep 11 17:51:57.311377 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311320    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-cacerts\") pod \"c076c6fa-1320-4f80-963c-9da5185d415f\" (UID: \"c076c6fa-1320-4f80-963c-9da5185d415f\") "
Sep 11 17:51:57.311554 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311473    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c076c6fa-1320-4f80-963c-9da5185d415f" (UID: "c076c6fa-1320-4f80-963c-9da5185d415f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:51:57.311612 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.311553    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-ca-configmap\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:51:57.313788 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.313746    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c076c6fa-1320-4f80-963c-9da5185d415f-local-certs" (OuterVolumeSpecName: "local-certs") pod "c076c6fa-1320-4f80-963c-9da5185d415f" (UID: "c076c6fa-1320-4f80-963c-9da5185d415f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:51:57.313908 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.313821    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c076c6fa-1320-4f80-963c-9da5185d415f" (UID: "c076c6fa-1320-4f80-963c-9da5185d415f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:51:57.313968 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.313908    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c076c6fa-1320-4f80-963c-9da5185d415f" (UID: "c076c6fa-1320-4f80-963c-9da5185d415f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:51:57.314161 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.314130    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-cacerts" (OuterVolumeSpecName: "cacerts") pod "c076c6fa-1320-4f80-963c-9da5185d415f" (UID: "c076c6fa-1320-4f80-963c-9da5185d415f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:51:57.314238 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.314163    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c076c6fa-1320-4f80-963c-9da5185d415f" (UID: "c076c6fa-1320-4f80-963c-9da5185d415f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:51:57.314276 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.314247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-kube-api-access-4zlt5" (OuterVolumeSpecName: "kube-api-access-4zlt5") pod "c076c6fa-1320-4f80-963c-9da5185d415f" (UID: "c076c6fa-1320-4f80-963c-9da5185d415f"). InnerVolumeSpecName "kube-api-access-4zlt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:51:57.412534 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.412450    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-istio-token\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:51:57.412534 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.412479    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zlt5\" (UniqueName: \"kubernetes.io/projected/c076c6fa-1320-4f80-963c-9da5185d415f-kube-api-access-4zlt5\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:51:57.412534 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.412504    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-cacerts\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:51:57.412534 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.412517    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c076c6fa-1320-4f80-963c-9da5185d415f-local-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:51:57.412534 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.412526    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-csr-dns-cert\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:51:57.412534 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.412533    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c076c6fa-1320-4f80-963c-9da5185d415f-istio-kubeconfig\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:51:57.834379 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.834342    2576 generic.go:356] "Generic (PLEG): container finished" podID="c076c6fa-1320-4f80-963c-9da5185d415f" containerID="6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e" exitCode=0
Sep 11 17:51:57.834868 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.834395    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"
Sep 11 17:51:57.834868 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.834426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7" event={"ID":"c076c6fa-1320-4f80-963c-9da5185d415f","Type":"ContainerDied","Data":"6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e"}
Sep 11 17:51:57.834868 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.834480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7" event={"ID":"c076c6fa-1320-4f80-963c-9da5185d415f","Type":"ContainerDied","Data":"62ff24d62a92f6159ac279c6fbcf517b3436878533f646f40f0b7d02b937e6e1"}
Sep 11 17:51:57.834868 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.834500    2576 scope.go:117] "RemoveContainer" containerID="6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e"
Sep 11 17:51:57.843333 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.843318    2576 scope.go:117] "RemoveContainer" containerID="6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e"
Sep 11 17:51:57.843622 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:51:57.843598    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e\": container with ID starting with 6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e not found: ID does not exist" containerID="6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e"
Sep 11 17:51:57.843725 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.843634    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e"} err="failed to get container status \"6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e\": rpc error: code = NotFound desc = could not find container \"6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e\": container with ID starting with 6f175b753ebc6b41971d619c7e970d2824530eef06c46de7ff4cb7a2fcf2775e not found: ID does not exist"
Sep 11 17:51:57.861030 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.861006    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"]
Sep 11 17:51:57.879839 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:57.879807    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7"]
Sep 11 17:51:58.238364 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:58.238292    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c076c6fa-1320-4f80-963c-9da5185d415f" path="/var/lib/kubelet/pods/c076c6fa-1320-4f80-963c-9da5185d415f/volumes"
Sep 11 17:51:58.900617 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:58.900583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:59.025242 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:59.025194    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:51:59.120144 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:51:59.120115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:52:40.921166 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:52:40.921133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:52:41.041160 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:52:41.041133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:52:58.628361 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:52:58.628323    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:52:59.377650 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:52:59.377620    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:00.175073 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:00.175041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:02.179217 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:02.179187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:02.386071 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:02.386040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:03.862307 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.862272    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"]
Sep 11 17:53:03.862665 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.862531    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c076c6fa-1320-4f80-963c-9da5185d415f" containerName="discovery"
Sep 11 17:53:03.862665 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.862543    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c076c6fa-1320-4f80-963c-9da5185d415f" containerName="discovery"
Sep 11 17:53:03.862665 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.862592    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c076c6fa-1320-4f80-963c-9da5185d415f" containerName="discovery"
Sep 11 17:53:03.865796 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.865780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:03.869494 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.869472    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g9mpv\""
Sep 11 17:53:03.869559 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.869508    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 17:53:03.869796 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.869781    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 17:53:03.891529 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.891497    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"]
Sep 11 17:53:03.986667 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.986629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:03.986846 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:03.986712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csjx2\" (UniqueName: \"kubernetes.io/projected/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-kube-api-access-csjx2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:04.087650 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.087618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csjx2\" (UniqueName: \"kubernetes.io/projected/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-kube-api-access-csjx2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:04.087842 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.087698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:04.088100 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.088082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:04.105095 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.105065    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:04.108493 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.108470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csjx2\" (UniqueName: \"kubernetes.io/projected/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-kube-api-access-csjx2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:04.174833 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.174757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:04.481366 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.481343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"]
Sep 11 17:53:04.484356 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:53:04.484326    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b8403d_cd70_47c1_9ba2_f4f3a410aab9.slice/crio-903e6065141d8edcddd2401b1c63405b63da5a835436f013cde5923056803495 WatchSource:0}: Error finding container 903e6065141d8edcddd2401b1c63405b63da5a835436f013cde5923056803495: Status 404 returned error can't find the container with id 903e6065141d8edcddd2401b1c63405b63da5a835436f013cde5923056803495
Sep 11 17:53:04.488848 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:04.488826    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:05.088655 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:05.088620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf" event={"ID":"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9","Type":"ContainerStarted","Data":"903e6065141d8edcddd2401b1c63405b63da5a835436f013cde5923056803495"}
Sep 11 17:53:06.073951 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.073907    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"]
Sep 11 17:53:06.077751 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.077369    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"
Sep 11 17:53:06.082923 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.082788    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 17:53:06.083474 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.083293    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-888ll\""
Sep 11 17:53:06.114506 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.114434    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"]
Sep 11 17:53:06.206430 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.206390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7tr\" (UniqueName: \"kubernetes.io/projected/12250851-428d-436d-bfad-e4578f51a0bb-kube-api-access-tk7tr\") pod \"dns-operator-controller-manager-7b84cd7c9c-sx9fh\" (UID: \"12250851-428d-436d-bfad-e4578f51a0bb\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"
Sep 11 17:53:06.212492 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.212446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:06.307112 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.307074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7tr\" (UniqueName: \"kubernetes.io/projected/12250851-428d-436d-bfad-e4578f51a0bb-kube-api-access-tk7tr\") pod \"dns-operator-controller-manager-7b84cd7c9c-sx9fh\" (UID: \"12250851-428d-436d-bfad-e4578f51a0bb\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"
Sep 11 17:53:06.326524 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.326423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7tr\" (UniqueName: \"kubernetes.io/projected/12250851-428d-436d-bfad-e4578f51a0bb-kube-api-access-tk7tr\") pod \"dns-operator-controller-manager-7b84cd7c9c-sx9fh\" (UID: \"12250851-428d-436d-bfad-e4578f51a0bb\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"
Sep 11 17:53:06.392119 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.391886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"
Sep 11 17:53:06.658135 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.658062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:06.710267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:06.710234    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"]
Sep 11 17:53:07.009177 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:07.009090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:07.214844 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:07.214799    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:07.424315 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:53:07.424263    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12250851_428d_436d_bfad_e4578f51a0bb.slice/crio-626aea61ffee4668076688e351b084d08c0430cc3235cc6dc8a7e1684b7ca8a8 WatchSource:0}: Error finding container 626aea61ffee4668076688e351b084d08c0430cc3235cc6dc8a7e1684b7ca8a8: Status 404 returned error can't find the container with id 626aea61ffee4668076688e351b084d08c0430cc3235cc6dc8a7e1684b7ca8a8
Sep 11 17:53:08.104451 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:08.104413    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh" event={"ID":"12250851-428d-436d-bfad-e4578f51a0bb","Type":"ContainerStarted","Data":"626aea61ffee4668076688e351b084d08c0430cc3235cc6dc8a7e1684b7ca8a8"}
Sep 11 17:53:09.109704 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.109653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf" event={"ID":"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9","Type":"ContainerStarted","Data":"d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54"}
Sep 11 17:53:09.110055 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.109790    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:09.519293 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.519235    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf" podStartSLOduration=1.971580238 podStartE2EDuration="6.519217183s" totalImagesPullingTime="4.547636945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:53:09.177428007 +0000 UTC m=+493.464962329" watchObservedRunningTime="2026-09-11 17:53:09.519217183 +0000 UTC m=+493.806751488"
Sep 11 17:53:09.520064 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.520045    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-brlch"]
Sep 11 17:53:09.523527 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.523506    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-brlch"
Sep 11 17:53:09.527385 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.527351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jz4lr\""
Sep 11 17:53:09.563254 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.563225    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-brlch"]
Sep 11 17:53:09.637431 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.637401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p85kx\" (UniqueName: \"kubernetes.io/projected/043d03ae-0b74-437d-8c67-777c05ae9788-kube-api-access-p85kx\") pod \"authorino-operator-76b478bd78-brlch\" (UID: \"043d03ae-0b74-437d-8c67-777c05ae9788\") " pod="kuadrant-system/authorino-operator-76b478bd78-brlch"
Sep 11 17:53:09.738449 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.738414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p85kx\" (UniqueName: \"kubernetes.io/projected/043d03ae-0b74-437d-8c67-777c05ae9788-kube-api-access-p85kx\") pod \"authorino-operator-76b478bd78-brlch\" (UID: \"043d03ae-0b74-437d-8c67-777c05ae9788\") " pod="kuadrant-system/authorino-operator-76b478bd78-brlch"
Sep 11 17:53:09.781848 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.781772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p85kx\" (UniqueName: \"kubernetes.io/projected/043d03ae-0b74-437d-8c67-777c05ae9788-kube-api-access-p85kx\") pod \"authorino-operator-76b478bd78-brlch\" (UID: \"043d03ae-0b74-437d-8c67-777c05ae9788\") " pod="kuadrant-system/authorino-operator-76b478bd78-brlch"
Sep 11 17:53:09.835429 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.835390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-brlch"
Sep 11 17:53:09.942659 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:09.942605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:10.115334 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:10.115303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh" event={"ID":"12250851-428d-436d-bfad-e4578f51a0bb","Type":"ContainerStarted","Data":"127c5f74173d4c0aa3104af0bb8a129f4a0dd089ea7e57f10bad5ec86f6969f7"}
Sep 11 17:53:10.245859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:10.245807    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh" podStartSLOduration=1.6512196000000001 podStartE2EDuration="4.245790878s" totalImagesPullingTime="2.594571278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:53:10.158302597 +0000 UTC m=+494.445836902" watchObservedRunningTime="2026-09-11 17:53:10.245790878 +0000 UTC m=+494.533325183"
Sep 11 17:53:10.246514 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:10.246493    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-brlch"]
Sep 11 17:53:10.250266 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:53:10.250239    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043d03ae_0b74_437d_8c67_777c05ae9788.slice/crio-643bfe3f603b39fdfd0cc723ef518f29c97dcab98fbd0aeb79ef0398f8f46ef0 WatchSource:0}: Error finding container 643bfe3f603b39fdfd0cc723ef518f29c97dcab98fbd0aeb79ef0398f8f46ef0: Status 404 returned error can't find the container with id 643bfe3f603b39fdfd0cc723ef518f29c97dcab98fbd0aeb79ef0398f8f46ef0
Sep 11 17:53:10.605347 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:10.605311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:11.120734 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:11.120702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-brlch" event={"ID":"043d03ae-0b74-437d-8c67-777c05ae9788","Type":"ContainerStarted","Data":"643bfe3f603b39fdfd0cc723ef518f29c97dcab98fbd0aeb79ef0398f8f46ef0"}
Sep 11 17:53:11.121101 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:11.120812    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"
Sep 11 17:53:12.126163 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:12.126120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-brlch" event={"ID":"043d03ae-0b74-437d-8c67-777c05ae9788","Type":"ContainerStarted","Data":"2a2c854abf181210ce7068c719537647123dee8aefb7b4fdf12c4695d7c23dbf"}
Sep 11 17:53:12.126549 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:12.126356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-brlch"
Sep 11 17:53:12.276104 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:12.276005    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-brlch" podStartSLOduration=1.554240009 podStartE2EDuration="3.275985466s" totalImagesPullingTime="1.721745457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:53:12.254904691 +0000 UTC m=+496.542438995" watchObservedRunningTime="2026-09-11 17:53:12.275985466 +0000 UTC m=+496.563519772"
Sep 11 17:53:12.523481 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:12.523445    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:12.749145 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:12.749108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:14.524670 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:14.524637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:15.278222 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:15.278194    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:15.404323 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:15.404289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:15.644634 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:15.644603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:15.840828 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:15.840796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:16.120497 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:16.120438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:16.309174 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:16.309136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:20.118076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:20.118048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:22.128515 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:22.128488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sx9fh"
Sep 11 17:53:22.562379 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:22.562340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:22.726297 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:22.726266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:22.861136 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:22.861057    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"]
Sep 11 17:53:22.861294 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:22.861269    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" containerName="manager" containerID="cri-o://d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54" gracePeriod=2
Sep 11 17:53:22.877560 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:22.877534    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"]
Sep 11 17:53:22.883452 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:22.883413    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\": pods \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:23.036053 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.036022    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"]
Sep 11 17:53:23.036273 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.036262    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" containerName="manager"
Sep 11 17:53:23.036312 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.036275    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" containerName="manager"
Sep 11 17:53:23.036345 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.036331    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" containerName="manager"
Sep 11 17:53:23.039104 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.039085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.132043 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.132017    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-brlch"
Sep 11 17:53:23.137238 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.137219    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:23.144688 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.144655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22d93d5-953e-4fd8-b87c-c5ca130ef095-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2sksb\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.144779 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.144722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjlw\" (UniqueName: \"kubernetes.io/projected/c22d93d5-953e-4fd8-b87c-c5ca130ef095-kube-api-access-4gjlw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2sksb\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.167388 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:23.167350    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:23.169554 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.169533    2576 generic.go:356] "Generic (PLEG): container finished" podID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" containerID="d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54" exitCode=0
Sep 11 17:53:23.169644 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.169577    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:23.169644 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.169614    2576 scope.go:117] "RemoveContainer" containerID="d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54"
Sep 11 17:53:23.177176 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.177158    2576 scope.go:117] "RemoveContainer" containerID="d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54"
Sep 11 17:53:23.177451 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:23.177423    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54\": container with ID starting with d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54 not found: ID does not exist" containerID="d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54"
Sep 11 17:53:23.177511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.177452    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54"} err="failed to get container status \"d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54\": rpc error: code = NotFound desc = could not find container \"d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54\": container with ID starting with d495446c55c9a9a0b25b9627e8f5b396e63cece331b37a55bd11da9c8ec0dc54 not found: ID does not exist"
Sep 11 17:53:23.185130 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:23.185105    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:23.245665 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.245633    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csjx2\" (UniqueName: \"kubernetes.io/projected/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-kube-api-access-csjx2\") pod \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") "
Sep 11 17:53:23.245845 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.245700    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-extensions-socket-volume\") pod \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\" (UID: \"b6b8403d-cd70-47c1-9ba2-f4f3a410aab9\") "
Sep 11 17:53:23.245845 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.245842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22d93d5-953e-4fd8-b87c-c5ca130ef095-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2sksb\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.245954 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.245909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjlw\" (UniqueName: \"kubernetes.io/projected/c22d93d5-953e-4fd8-b87c-c5ca130ef095-kube-api-access-4gjlw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2sksb\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.246231 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.246207    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" (UID: "b6b8403d-cd70-47c1-9ba2-f4f3a410aab9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:53:23.246231 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.246229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22d93d5-953e-4fd8-b87c-c5ca130ef095-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2sksb\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.247973 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.247952    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-kube-api-access-csjx2" (OuterVolumeSpecName: "kube-api-access-csjx2") pod "b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" (UID: "b6b8403d-cd70-47c1-9ba2-f4f3a410aab9"). InnerVolumeSpecName "kube-api-access-csjx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:53:23.290292 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.290260    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjlw\" (UniqueName: \"kubernetes.io/projected/c22d93d5-953e-4fd8-b87c-c5ca130ef095-kube-api-access-4gjlw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2sksb\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.347187 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.347157    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csjx2\" (UniqueName: \"kubernetes.io/projected/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-kube-api-access-csjx2\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:53:23.347187 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.347187    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9-extensions-socket-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:53:23.348044 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.348019    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:23.403840 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.403750    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"]
Sep 11 17:53:23.414914 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:23.414882    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:23.517318 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:23.517285    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:23.662909 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:23.662833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"]
Sep 11 17:53:23.665656 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:53:23.665622    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22d93d5_953e_4fd8_b87c_c5ca130ef095.slice/crio-9df68c0b6306b91f146134a51f64c2cbaa49dc93a97b6dbeb55cae16d60e9fb5 WatchSource:0}: Error finding container 9df68c0b6306b91f146134a51f64c2cbaa49dc93a97b6dbeb55cae16d60e9fb5: Status 404 returned error can't find the container with id 9df68c0b6306b91f146134a51f64c2cbaa49dc93a97b6dbeb55cae16d60e9fb5
Sep 11 17:53:24.176238 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:24.176199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb" event={"ID":"c22d93d5-953e-4fd8-b87c-c5ca130ef095","Type":"ContainerStarted","Data":"bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57"}
Sep 11 17:53:24.176591 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:24.176250    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb" event={"ID":"c22d93d5-953e-4fd8-b87c-c5ca130ef095","Type":"ContainerStarted","Data":"9df68c0b6306b91f146134a51f64c2cbaa49dc93a97b6dbeb55cae16d60e9fb5"}
Sep 11 17:53:24.176591 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:24.176284    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:24.180242 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:24.180217    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xxfxf\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxfxf"
Sep 11 17:53:24.238762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:24.238728    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6b8403d-cd70-47c1-9ba2-f4f3a410aab9" path="/var/lib/kubelet/pods/b6b8403d-cd70-47c1-9ba2-f4f3a410aab9/volumes"
Sep 11 17:53:24.257957 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:24.257915    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb" podStartSLOduration=2.257897272 podStartE2EDuration="2.257897272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:53:24.257642784 +0000 UTC m=+508.545177090" watchObservedRunningTime="2026-09-11 17:53:24.257897272 +0000 UTC m=+508.545431577"
Sep 11 17:53:27.044712 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.044654    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"]
Sep 11 17:53:27.048076 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.048054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.075342 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.075311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"]
Sep 11 17:53:27.174773 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.174740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e55b01fe-7027-49bd-894a-b0bb80bd2005-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w5t9c\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.174930 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.174779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8bj\" (UniqueName: \"kubernetes.io/projected/e55b01fe-7027-49bd-894a-b0bb80bd2005-kube-api-access-gb8bj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w5t9c\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.275825 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.275786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e55b01fe-7027-49bd-894a-b0bb80bd2005-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w5t9c\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.275825 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.275823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8bj\" (UniqueName: \"kubernetes.io/projected/e55b01fe-7027-49bd-894a-b0bb80bd2005-kube-api-access-gb8bj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w5t9c\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.276204 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.276183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e55b01fe-7027-49bd-894a-b0bb80bd2005-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w5t9c\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.293025 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.292998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8bj\" (UniqueName: \"kubernetes.io/projected/e55b01fe-7027-49bd-894a-b0bb80bd2005-kube-api-access-gb8bj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w5t9c\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.357857 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.357818    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:27.663562 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:27.663527    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"]
Sep 11 17:53:27.665202 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:53:27.665180    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55b01fe_7027_49bd_894a_b0bb80bd2005.slice/crio-c58d5700c196f2aa3ab68260b09418a80432332743a3336f83d51f7463df23e7 WatchSource:0}: Error finding container c58d5700c196f2aa3ab68260b09418a80432332743a3336f83d51f7463df23e7: Status 404 returned error can't find the container with id c58d5700c196f2aa3ab68260b09418a80432332743a3336f83d51f7463df23e7
Sep 11 17:53:28.195345 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:28.195311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c" event={"ID":"e55b01fe-7027-49bd-894a-b0bb80bd2005","Type":"ContainerStarted","Data":"e926c9af33725fd6e3865f8a8fbf9eb0fa3295d7cb0c4d81e49e09c407b16acd"}
Sep 11 17:53:28.195764 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:28.195359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c" event={"ID":"e55b01fe-7027-49bd-894a-b0bb80bd2005","Type":"ContainerStarted","Data":"c58d5700c196f2aa3ab68260b09418a80432332743a3336f83d51f7463df23e7"}
Sep 11 17:53:28.195764 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:28.195447    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:28.236195 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:28.236137    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c" podStartSLOduration=2.236120793 podStartE2EDuration="2.236120793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:53:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:53:28.235016777 +0000 UTC m=+512.522551083" watchObservedRunningTime="2026-09-11 17:53:28.236120793 +0000 UTC m=+512.523655098"
Sep 11 17:53:28.844650 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:28.844618    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:28.958476 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:28.958445    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:31.820905 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:31.820867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:31.933382 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:31.933351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:33.277728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:33.277698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:33.407886 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:33.407857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:35.183046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:35.183019    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:37.197995 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:37.197965    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:37.472096 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:37.472017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:37.640064 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:37.640034    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:37.803833 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:37.803802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:39.202338 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.202302    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 17:53:39.325813 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.325784    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"]
Sep 11 17:53:39.326004 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.325972    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb" podUID="c22d93d5-953e-4fd8-b87c-c5ca130ef095" containerName="manager" containerID="cri-o://bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57" gracePeriod=10
Sep 11 17:53:39.565243 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.565223    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:39.570587 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.570567    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22d93d5-953e-4fd8-b87c-c5ca130ef095-extensions-socket-volume\") pod \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") "
Sep 11 17:53:39.570713 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.570655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gjlw\" (UniqueName: \"kubernetes.io/projected/c22d93d5-953e-4fd8-b87c-c5ca130ef095-kube-api-access-4gjlw\") pod \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\" (UID: \"c22d93d5-953e-4fd8-b87c-c5ca130ef095\") "
Sep 11 17:53:39.570891 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.570872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22d93d5-953e-4fd8-b87c-c5ca130ef095-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c22d93d5-953e-4fd8-b87c-c5ca130ef095" (UID: "c22d93d5-953e-4fd8-b87c-c5ca130ef095"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:53:39.572753 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.572734    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22d93d5-953e-4fd8-b87c-c5ca130ef095-kube-api-access-4gjlw" (OuterVolumeSpecName: "kube-api-access-4gjlw") pod "c22d93d5-953e-4fd8-b87c-c5ca130ef095" (UID: "c22d93d5-953e-4fd8-b87c-c5ca130ef095"). InnerVolumeSpecName "kube-api-access-4gjlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:53:39.671918 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.671887    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22d93d5-953e-4fd8-b87c-c5ca130ef095-extensions-socket-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:53:39.671918 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:39.671912    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gjlw\" (UniqueName: \"kubernetes.io/projected/c22d93d5-953e-4fd8-b87c-c5ca130ef095-kube-api-access-4gjlw\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:53:40.246852 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.246818    2576 generic.go:356] "Generic (PLEG): container finished" podID="c22d93d5-953e-4fd8-b87c-c5ca130ef095" containerID="bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57" exitCode=0
Sep 11 17:53:40.247246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.246871    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"
Sep 11 17:53:40.247246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.246918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb" event={"ID":"c22d93d5-953e-4fd8-b87c-c5ca130ef095","Type":"ContainerDied","Data":"bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57"}
Sep 11 17:53:40.247246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.246981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb" event={"ID":"c22d93d5-953e-4fd8-b87c-c5ca130ef095","Type":"ContainerDied","Data":"9df68c0b6306b91f146134a51f64c2cbaa49dc93a97b6dbeb55cae16d60e9fb5"}
Sep 11 17:53:40.247246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.247010    2576 scope.go:117] "RemoveContainer" containerID="bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57"
Sep 11 17:53:40.254884 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.254867    2576 scope.go:117] "RemoveContainer" containerID="bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57"
Sep 11 17:53:40.255134 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:53:40.255115    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57\": container with ID starting with bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57 not found: ID does not exist" containerID="bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57"
Sep 11 17:53:40.255199 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.255141    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57"} err="failed to get container status \"bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57\": rpc error: code = NotFound desc = could not find container \"bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57\": container with ID starting with bdc2f4fd2ec7811b5c3c4cd14e1edd7530db15a756dc9120f59c31d418157f57 not found: ID does not exist"
Sep 11 17:53:40.289762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.289739    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"]
Sep 11 17:53:40.309247 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:40.309226    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2sksb"]
Sep 11 17:53:42.239009 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:42.238979    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c22d93d5-953e-4fd8-b87c-c5ca130ef095" path="/var/lib/kubelet/pods/c22d93d5-953e-4fd8-b87c-c5ca130ef095/volumes"
Sep 11 17:53:42.757711 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:42.757652    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:42.856564 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:42.856516    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:43.932341 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:43.932311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:44.063735 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:44.063705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:50.411929 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:50.411838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:50.546923 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:50.546895    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:50.728711 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:50.728607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:53.443188 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:53.443141    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:53.692520 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:53.692483    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:58.317184 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:58.317152    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:53:58.964364 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:53:58.964324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:01.331008 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.330976    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5xzpw"]
Sep 11 17:54:01.331365 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.331306    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22d93d5-953e-4fd8-b87c-c5ca130ef095" containerName="manager"
Sep 11 17:54:01.331365 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.331319    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22d93d5-953e-4fd8-b87c-c5ca130ef095" containerName="manager"
Sep 11 17:54:01.331453 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.331418    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22d93d5-953e-4fd8-b87c-c5ca130ef095" containerName="manager"
Sep 11 17:54:01.335798 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.335777    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.336728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.336702    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:01.339254 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.339235    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 17:54:01.339403 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.339387    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-667qn\""
Sep 11 17:54:01.349318 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.349297    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5xzpw"]
Sep 11 17:54:01.427539 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.427505    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5xzpw"]
Sep 11 17:54:01.429646 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.429622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c4km\" (UniqueName: \"kubernetes.io/projected/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-kube-api-access-6c4km\") pod \"limitador-limitador-8588749977-5xzpw\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") " pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.429765 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.429663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-config-file\") pod \"limitador-limitador-8588749977-5xzpw\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") " pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.439312 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.439286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:01.530510 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.530475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c4km\" (UniqueName: \"kubernetes.io/projected/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-kube-api-access-6c4km\") pod \"limitador-limitador-8588749977-5xzpw\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") " pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.530726 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.530546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-config-file\") pod \"limitador-limitador-8588749977-5xzpw\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") " pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.531181 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.531163    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-config-file\") pod \"limitador-limitador-8588749977-5xzpw\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") " pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.545930 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.545904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:01.546982 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.546963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c4km\" (UniqueName: \"kubernetes.io/projected/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-kube-api-access-6c4km\") pod \"limitador-limitador-8588749977-5xzpw\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") " pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.645071 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.644990    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:01.935327 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:01.935250    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5xzpw"]
Sep 11 17:54:01.938074 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:54:01.938045    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d529b7_1b94_4d6d_91d2_e98ab01b58d3.slice/crio-5baf0754a63a67b6e1098d264f2cb2bd65226562a90716fa6443420cea342cce WatchSource:0}: Error finding container 5baf0754a63a67b6e1098d264f2cb2bd65226562a90716fa6443420cea342cce: Status 404 returned error can't find the container with id 5baf0754a63a67b6e1098d264f2cb2bd65226562a90716fa6443420cea342cce
Sep 11 17:54:02.334300 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:02.334270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw" event={"ID":"67d529b7-1b94-4d6d-91d2-e98ab01b58d3","Type":"ContainerStarted","Data":"5baf0754a63a67b6e1098d264f2cb2bd65226562a90716fa6443420cea342cce"}
Sep 11 17:54:02.401495 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:02.401462    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:02.497091 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:02.497057    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:04.343804 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:04.343769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw" event={"ID":"67d529b7-1b94-4d6d-91d2-e98ab01b58d3","Type":"ContainerStarted","Data":"75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293"}
Sep 11 17:54:04.344176 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:04.343896    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:06.799517 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:06.799484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:06.902844 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:06.902807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:15.348630 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:15.348599    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:15.376154 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:15.376111    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw" podStartSLOduration=12.541881835 podStartE2EDuration="14.376098907s" totalImagesPullingTime="1.834217072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:54:04.367282502 +0000 UTC m=+548.654816807" watchObservedRunningTime="2026-09-11 17:54:15.376098907 +0000 UTC m=+559.663633209"
Sep 11 17:54:17.710555 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:17.710519    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5xzpw"]
Sep 11 17:54:17.711002 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:17.710739    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw" podUID="67d529b7-1b94-4d6d-91d2-e98ab01b58d3" containerName="limitador" containerID="cri-o://75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293" gracePeriod=30
Sep 11 17:54:18.247983 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.247952    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:18.350577 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.350553    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-config-file\") pod \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") "
Sep 11 17:54:18.350728 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.350589    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c4km\" (UniqueName: \"kubernetes.io/projected/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-kube-api-access-6c4km\") pod \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\" (UID: \"67d529b7-1b94-4d6d-91d2-e98ab01b58d3\") "
Sep 11 17:54:18.351110 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.350943    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-config-file" (OuterVolumeSpecName: "config-file") pod "67d529b7-1b94-4d6d-91d2-e98ab01b58d3" (UID: "67d529b7-1b94-4d6d-91d2-e98ab01b58d3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:54:18.352712 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.352691    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-kube-api-access-6c4km" (OuterVolumeSpecName: "kube-api-access-6c4km") pod "67d529b7-1b94-4d6d-91d2-e98ab01b58d3" (UID: "67d529b7-1b94-4d6d-91d2-e98ab01b58d3"). InnerVolumeSpecName "kube-api-access-6c4km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:54:18.398120 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.398098    2576 generic.go:356] "Generic (PLEG): container finished" podID="67d529b7-1b94-4d6d-91d2-e98ab01b58d3" containerID="75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293" exitCode=0
Sep 11 17:54:18.398228 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.398128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw" event={"ID":"67d529b7-1b94-4d6d-91d2-e98ab01b58d3","Type":"ContainerDied","Data":"75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293"}
Sep 11 17:54:18.398228 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.398142    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw"
Sep 11 17:54:18.398228 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.398167    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5xzpw" event={"ID":"67d529b7-1b94-4d6d-91d2-e98ab01b58d3","Type":"ContainerDied","Data":"5baf0754a63a67b6e1098d264f2cb2bd65226562a90716fa6443420cea342cce"}
Sep 11 17:54:18.398228 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.398187    2576 scope.go:117] "RemoveContainer" containerID="75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293"
Sep 11 17:54:18.406450 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.406432    2576 scope.go:117] "RemoveContainer" containerID="75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293"
Sep 11 17:54:18.406735 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:54:18.406716    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293\": container with ID starting with 75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293 not found: ID does not exist" containerID="75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293"
Sep 11 17:54:18.406796 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.406741    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293"} err="failed to get container status \"75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293\": rpc error: code = NotFound desc = could not find container \"75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293\": container with ID starting with 75c5bdbcb6f5febbcb7fc8956f3034386b87d54c1d25ce97abef4eafce9cc293 not found: ID does not exist"
Sep 11 17:54:18.422080 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.422058    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5xzpw"]
Sep 11 17:54:18.424738 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.424720    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5xzpw"]
Sep 11 17:54:18.451806 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.451784    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-config-file\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:54:18.451806 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:18.451804    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c4km\" (UniqueName: \"kubernetes.io/projected/67d529b7-1b94-4d6d-91d2-e98ab01b58d3-kube-api-access-6c4km\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:54:20.238978 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:20.238943    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67d529b7-1b94-4d6d-91d2-e98ab01b58d3" path="/var/lib/kubelet/pods/67d529b7-1b94-4d6d-91d2-e98ab01b58d3/volumes"
Sep 11 17:54:22.538056 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:22.538019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:22.752548 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:22.752516    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:23.000113 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.000084    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"]
Sep 11 17:54:23.000358 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.000347    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d529b7-1b94-4d6d-91d2-e98ab01b58d3" containerName="limitador"
Sep 11 17:54:23.000402 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.000360    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d529b7-1b94-4d6d-91d2-e98ab01b58d3" containerName="limitador"
Sep 11 17:54:23.000439 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.000421    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d529b7-1b94-4d6d-91d2-e98ab01b58d3" containerName="limitador"
Sep 11 17:54:23.004619 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.004599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.013265 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.013244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:54:23.014822 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.014805    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-w5b5f\""
Sep 11 17:54:23.015569 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.015553    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 17:54:23.015644 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.015627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 17:54:23.018081 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.018060    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"]
Sep 11 17:54:23.050961 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.050924    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:23.085328 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.085288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddtkf\" (UniqueName: \"kubernetes.io/projected/f8eea5a4-0185-45d1-8375-28be7aa80281-kube-api-access-ddtkf\") pod \"postgres-69fb4594cf-x9fsp\" (UID: \"f8eea5a4-0185-45d1-8375-28be7aa80281\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.085496 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.085349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f8eea5a4-0185-45d1-8375-28be7aa80281-data\") pod \"postgres-69fb4594cf-x9fsp\" (UID: \"f8eea5a4-0185-45d1-8375-28be7aa80281\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.186787 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.186745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f8eea5a4-0185-45d1-8375-28be7aa80281-data\") pod \"postgres-69fb4594cf-x9fsp\" (UID: \"f8eea5a4-0185-45d1-8375-28be7aa80281\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.186957 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.186841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddtkf\" (UniqueName: \"kubernetes.io/projected/f8eea5a4-0185-45d1-8375-28be7aa80281-kube-api-access-ddtkf\") pod \"postgres-69fb4594cf-x9fsp\" (UID: \"f8eea5a4-0185-45d1-8375-28be7aa80281\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.187137 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.187105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f8eea5a4-0185-45d1-8375-28be7aa80281-data\") pod \"postgres-69fb4594cf-x9fsp\" (UID: \"f8eea5a4-0185-45d1-8375-28be7aa80281\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.198224 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.198189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddtkf\" (UniqueName: \"kubernetes.io/projected/f8eea5a4-0185-45d1-8375-28be7aa80281-kube-api-access-ddtkf\") pod \"postgres-69fb4594cf-x9fsp\" (UID: \"f8eea5a4-0185-45d1-8375-28be7aa80281\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.313362 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.313328    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:23.588005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:23.587908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"]
Sep 11 17:54:23.592612 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:54:23.592577    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8eea5a4_0185_45d1_8375_28be7aa80281.slice/crio-b2fffa4b85039891c8ca02138858c3d1c4157d04729804196c5097a6ec953f4d WatchSource:0}: Error finding container b2fffa4b85039891c8ca02138858c3d1c4157d04729804196c5097a6ec953f4d: Status 404 returned error can't find the container with id b2fffa4b85039891c8ca02138858c3d1c4157d04729804196c5097a6ec953f4d
Sep 11 17:54:24.425297 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:24.425263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp" event={"ID":"f8eea5a4-0185-45d1-8375-28be7aa80281","Type":"ContainerStarted","Data":"b2fffa4b85039891c8ca02138858c3d1c4157d04729804196c5097a6ec953f4d"}
Sep 11 17:54:29.449575 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:29.449531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp" event={"ID":"f8eea5a4-0185-45d1-8375-28be7aa80281","Type":"ContainerStarted","Data":"75ae0280ebad32179cba57ae049c9e00da322e8243e03635619fabd050379486"}
Sep 11 17:54:29.449990 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:29.449624    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:29.470264 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:29.470213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp" podStartSLOduration=2.616592712 podStartE2EDuration="7.470197417s" totalImagesPullingTime="4.853604705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:54:29.468167949 +0000 UTC m=+573.755702256" watchObservedRunningTime="2026-09-11 17:54:29.470197417 +0000 UTC m=+573.757731723"
Sep 11 17:54:35.481215 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:35.481186    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x9fsp"
Sep 11 17:54:35.865638 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:35.865608    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:35.992418 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:35.992388    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:43.169684 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.169653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:43.309352 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.309317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:43.414802 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.414764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:43.477082 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.477008    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-859c5cb57-fk9k8"]
Sep 11 17:54:43.482252 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.482232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.487143 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.487123    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 17:54:43.487245 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.487171    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xn9bs\""
Sep 11 17:54:43.487245 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.487198    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 17:54:43.487245 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.487218    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 17:54:43.495548 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.495527    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-859c5cb57-fk9k8"]
Sep 11 17:54:43.646879 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.646849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkbv\" (UniqueName: \"kubernetes.io/projected/4e352be0-3bab-4f02-b384-1b16251d667d-kube-api-access-rfkbv\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.647039 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.646885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-metrics-certs\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.647039 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.646904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-webhook-cert\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.748247 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.748169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkbv\" (UniqueName: \"kubernetes.io/projected/4e352be0-3bab-4f02-b384-1b16251d667d-kube-api-access-rfkbv\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.748247 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.748203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-metrics-certs\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.748247 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.748222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-webhook-cert\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.750793 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.750775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-webhook-cert\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.750856 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.750839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-metrics-certs\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.759169 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.759140    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkbv\" (UniqueName: \"kubernetes.io/projected/4e352be0-3bab-4f02-b384-1b16251d667d-kube-api-access-rfkbv\") pod \"maas-controller-859c5cb57-fk9k8\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") " pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:43.792619 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:43.792584    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:44.081662 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:44.081636    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-859c5cb57-fk9k8"]
Sep 11 17:54:44.083404 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:54:44.083381    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e352be0_3bab_4f02_b384_1b16251d667d.slice/crio-69b07cf7fae513757724a603253128bc41a35647a43b2288b86355a5c6c03909 WatchSource:0}: Error finding container 69b07cf7fae513757724a603253128bc41a35647a43b2288b86355a5c6c03909: Status 404 returned error can't find the container with id 69b07cf7fae513757724a603253128bc41a35647a43b2288b86355a5c6c03909
Sep 11 17:54:44.510778 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:44.510662    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-fk9k8" event={"ID":"4e352be0-3bab-4f02-b384-1b16251d667d","Type":"ContainerStarted","Data":"69b07cf7fae513757724a603253128bc41a35647a43b2288b86355a5c6c03909"}
Sep 11 17:54:46.688906 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:46.688876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:46.838095 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:46.838064    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:47.180009 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:47.179930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:47.381262 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:47.381233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:47.532194 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:47.532117    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-fk9k8" event={"ID":"4e352be0-3bab-4f02-b384-1b16251d667d","Type":"ContainerStarted","Data":"5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679"}
Sep 11 17:54:47.532328 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:47.532232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:54:47.582600 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:47.582553    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-859c5cb57-fk9k8" podStartSLOduration=2.195150938 podStartE2EDuration="4.582539527s" totalImagesPullingTime="2.387388589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:54:47.579095657 +0000 UTC m=+591.866629962" watchObservedRunningTime="2026-09-11 17:54:47.582539527 +0000 UTC m=+591.870073856"
Sep 11 17:54:53.311934 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:53.311901    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:54:58.539205 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:54:58.539170    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 17:55:19.420717 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:19.420621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:19.522923 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:19.522889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:20.816874 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:20.816834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:20.921739 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:20.921701    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:21.024794 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.024764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:21.073114 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.073038    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"]
Sep 11 17:55:21.076091 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.076076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.079844 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.079820    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cdcpv\""
Sep 11 17:55:21.079959 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.079823    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 17:55:21.080025 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.079821    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 17:55:21.090623 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.090601    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"]
Sep 11 17:55:21.103154 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.103133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsswx\" (UniqueName: \"kubernetes.io/projected/ae2a487f-9525-40cb-8633-5fb134f5fe07-kube-api-access-vsswx\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.103246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.103164    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-metrics-certs\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.103246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.103190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-maas-api-tls\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.103324 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.103243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2a487f-9525-40cb-8633-5fb134f5fe07-openshift-service-ca\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.134551 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.134520    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:21.203834 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.203793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-maas-api-tls\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.204033 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.203847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2a487f-9525-40cb-8633-5fb134f5fe07-openshift-service-ca\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.204033 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.203915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsswx\" (UniqueName: \"kubernetes.io/projected/ae2a487f-9525-40cb-8633-5fb134f5fe07-kube-api-access-vsswx\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.204033 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.203944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-metrics-certs\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.204559 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.204538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2a487f-9525-40cb-8633-5fb134f5fe07-openshift-service-ca\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.206397 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.206375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-metrics-certs\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.206521 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.206503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-maas-api-tls\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.212846 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.212826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsswx\" (UniqueName: \"kubernetes.io/projected/ae2a487f-9525-40cb-8633-5fb134f5fe07-kube-api-access-vsswx\") pod \"maas-api-55bbb86db8-9w7q4\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") " pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.385907 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.385827    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:21.596069 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.596038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:21.664824 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.664631    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"]
Sep 11 17:55:21.667103 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:55:21.667073    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2a487f_9525_40cb_8633_5fb134f5fe07.slice/crio-24b0e99b5bd2a15cec60a126d19600003cb3106fa7ea2cfa9524c96b1e508a92 WatchSource:0}: Error finding container 24b0e99b5bd2a15cec60a126d19600003cb3106fa7ea2cfa9524c96b1e508a92: Status 404 returned error can't find the container with id 24b0e99b5bd2a15cec60a126d19600003cb3106fa7ea2cfa9524c96b1e508a92
Sep 11 17:55:21.718743 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.718709    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:21.862054 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.862021    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"]
Sep 11 17:55:21.866148 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.866129    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:21.875560 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.875539    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 17:55:21.875759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.875740    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g9665\""
Sep 11 17:55:21.884722 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.884701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"]
Sep 11 17:55:21.911184 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.911152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bb792dc-ee5e-42b4-8f73-64513cfab123-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jdjnk\" (UID: \"8bb792dc-ee5e-42b4-8f73-64513cfab123\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:21.911333 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:21.911264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpqj\" (UniqueName: \"kubernetes.io/projected/8bb792dc-ee5e-42b4-8f73-64513cfab123-kube-api-access-wnpqj\") pod \"payload-processing-5b54b7fbb7-jdjnk\" (UID: \"8bb792dc-ee5e-42b4-8f73-64513cfab123\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:22.012075 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.011993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpqj\" (UniqueName: \"kubernetes.io/projected/8bb792dc-ee5e-42b4-8f73-64513cfab123-kube-api-access-wnpqj\") pod \"payload-processing-5b54b7fbb7-jdjnk\" (UID: \"8bb792dc-ee5e-42b4-8f73-64513cfab123\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:22.012075 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.012034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bb792dc-ee5e-42b4-8f73-64513cfab123-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jdjnk\" (UID: \"8bb792dc-ee5e-42b4-8f73-64513cfab123\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:22.012799 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.012779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bb792dc-ee5e-42b4-8f73-64513cfab123-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jdjnk\" (UID: \"8bb792dc-ee5e-42b4-8f73-64513cfab123\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:22.022251 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.022225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpqj\" (UniqueName: \"kubernetes.io/projected/8bb792dc-ee5e-42b4-8f73-64513cfab123-kube-api-access-wnpqj\") pod \"payload-processing-5b54b7fbb7-jdjnk\" (UID: \"8bb792dc-ee5e-42b4-8f73-64513cfab123\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:22.175663 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.175623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:22.453118 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.453085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"]
Sep 11 17:55:22.456257 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:55:22.456236    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb792dc_ee5e_42b4_8f73_64513cfab123.slice/crio-4617aefabe89ae47ad16fe93d4c7c9a9ba91342164748169bd6d8bc306ce2a0a WatchSource:0}: Error finding container 4617aefabe89ae47ad16fe93d4c7c9a9ba91342164748169bd6d8bc306ce2a0a: Status 404 returned error can't find the container with id 4617aefabe89ae47ad16fe93d4c7c9a9ba91342164748169bd6d8bc306ce2a0a
Sep 11 17:55:22.673414 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.673370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk" event={"ID":"8bb792dc-ee5e-42b4-8f73-64513cfab123","Type":"ContainerStarted","Data":"4617aefabe89ae47ad16fe93d4c7c9a9ba91342164748169bd6d8bc306ce2a0a"}
Sep 11 17:55:22.674864 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:22.674830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4" event={"ID":"ae2a487f-9525-40cb-8633-5fb134f5fe07","Type":"ContainerStarted","Data":"24b0e99b5bd2a15cec60a126d19600003cb3106fa7ea2cfa9524c96b1e508a92"}
Sep 11 17:55:24.685513 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:24.685473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk" event={"ID":"8bb792dc-ee5e-42b4-8f73-64513cfab123","Type":"ContainerStarted","Data":"65d98f8f78c3909952469bff1c708dadc7272c462e3971304dae639b066d6ce4"}
Sep 11 17:55:24.685977 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:24.685595    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:24.687096 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:24.687071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4" event={"ID":"ae2a487f-9525-40cb-8633-5fb134f5fe07","Type":"ContainerStarted","Data":"249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5"}
Sep 11 17:55:24.687222 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:24.687204    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:24.706105 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:24.706057    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk" podStartSLOduration=1.997558335 podStartE2EDuration="3.706041139s" totalImagesPullingTime="1.708482804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:55:24.704333795 +0000 UTC m=+628.991868100" watchObservedRunningTime="2026-09-11 17:55:24.706041139 +0000 UTC m=+628.993575447"
Sep 11 17:55:30.696178 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:30.696146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 17:55:30.732025 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:30.731974    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4" podStartSLOduration=7.723901102 podStartE2EDuration="9.731957332s" totalImagesPullingTime="2.00805623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:55:24.727926145 +0000 UTC m=+629.015460450" watchObservedRunningTime="2026-09-11 17:55:30.731957332 +0000 UTC m=+635.019491692"
Sep 11 17:55:31.896889 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:31.896834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:32.058017 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:32.057985    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:35.693158 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:35.693130    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdjnk"
Sep 11 17:55:42.313104 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:42.313071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:52.008983 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:52.008948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:58.065154 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.065121    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"]
Sep 11 17:55:58.070371 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.070346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.074257 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.074234    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jwbsk\""
Sep 11 17:55:58.075388 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.075368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 17:55:58.075594 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.075381    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 17:55:58.075594 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.075413    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 17:55:58.081649 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.081630    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"]
Sep 11 17:55:58.103264 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.103237    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:55:58.210965 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.210918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.211153 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.210981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.211153 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.211050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.211153 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.211123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48b13ca4-323f-4eb8-95bf-0c3ef2028423-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.211291 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.211182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.211291 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.211222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj5h6\" (UniqueName: \"kubernetes.io/projected/48b13ca4-323f-4eb8-95bf-0c3ef2028423-kube-api-access-sj5h6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.312540 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.312495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.312762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.312553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj5h6\" (UniqueName: \"kubernetes.io/projected/48b13ca4-323f-4eb8-95bf-0c3ef2028423-kube-api-access-sj5h6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.312762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.312584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.312762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.312633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.312762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.312663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.312762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.312745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48b13ca4-323f-4eb8-95bf-0c3ef2028423-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.313035 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.312981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.313035 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.313013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.313161 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.313138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.315121 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.315095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48b13ca4-323f-4eb8-95bf-0c3ef2028423-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.315434 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.315389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48b13ca4-323f-4eb8-95bf-0c3ef2028423-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.326846 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.326824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj5h6\" (UniqueName: \"kubernetes.io/projected/48b13ca4-323f-4eb8-95bf-0c3ef2028423-kube-api-access-sj5h6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w\" (UID: \"48b13ca4-323f-4eb8-95bf-0c3ef2028423\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.380444 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.380406    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:55:58.661352 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.661307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"]
Sep 11 17:55:58.663504 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:55:58.663472    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b13ca4_323f_4eb8_95bf_0c3ef2028423.slice/crio-412e9a98ec6d7203e85960202f0877e9391568b552a12cf717931a8db37e4707 WatchSource:0}: Error finding container 412e9a98ec6d7203e85960202f0877e9391568b552a12cf717931a8db37e4707: Status 404 returned error can't find the container with id 412e9a98ec6d7203e85960202f0877e9391568b552a12cf717931a8db37e4707
Sep 11 17:55:58.664921 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.664903    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:55:58.831190 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:58.831152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w" event={"ID":"48b13ca4-323f-4eb8-95bf-0c3ef2028423","Type":"ContainerStarted","Data":"412e9a98ec6d7203e85960202f0877e9391568b552a12cf717931a8db37e4707"}
Sep 11 17:55:59.836910 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:59.836874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w" event={"ID":"48b13ca4-323f-4eb8-95bf-0c3ef2028423","Type":"ContainerStarted","Data":"8b747e6325cee1b1f558cfe8aaa2f90c976d270c8d0d8d5b6efa97998ec4f413"}
Sep 11 17:55:59.861052 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:55:59.861003    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w" podStartSLOduration=0.905469096 podStartE2EDuration="1.860986905s" totalImagesPullingTime="955.517809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:55:59.859175123 +0000 UTC m=+664.146709429" watchObservedRunningTime="2026-09-11 17:55:59.860986905 +0000 UTC m=+664.148521210"
Sep 11 17:56:07.280713 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:07.280661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:56:08.381037 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:08.380993    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:56:08.381432 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:08.381065    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:56:08.393273 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:08.393243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:56:08.886403 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:08.886371    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w"
Sep 11 17:56:18.069892 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:18.069852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:56:23.343047 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.343010    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"]
Sep 11 17:56:23.346329 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.346312    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.353142 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.353123    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 17:56:23.367139 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.367109    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"]
Sep 11 17:56:23.389848 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.389813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.389848 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.389849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.390032 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.389879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.390032 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.389901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.390032 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.389928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnfvf\" (UniqueName: \"kubernetes.io/projected/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-kube-api-access-dnfvf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.390032 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.389955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.392286 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.392255    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:56:23.490406 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.490406 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnfvf\" (UniqueName: \"kubernetes.io/projected/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-kube-api-access-dnfvf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.490641 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.490641 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.490641 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.490826 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490644    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.490883 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.490924 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.491009 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.490988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.492724 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.492700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.493090 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.493069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.500246 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.500227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnfvf\" (UniqueName: \"kubernetes.io/projected/d9b1cb5a-bf3b-4424-b978-8ab64b78a67b-kube-api-access-dnfvf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4j9vf\" (UID: \"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.655747 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.655643    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:23.932722 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.932624    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"]
Sep 11 17:56:23.935498 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:56:23.935470    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b1cb5a_bf3b_4424_b978_8ab64b78a67b.slice/crio-f2b6084e4adf56cde8a81675f5885988c3f5c4ad30580b8a3bad9ed2bb6ba4a0 WatchSource:0}: Error finding container f2b6084e4adf56cde8a81675f5885988c3f5c4ad30580b8a3bad9ed2bb6ba4a0: Status 404 returned error can't find the container with id f2b6084e4adf56cde8a81675f5885988c3f5c4ad30580b8a3bad9ed2bb6ba4a0
Sep 11 17:56:23.941719 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:23.941671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf" event={"ID":"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b","Type":"ContainerStarted","Data":"f2b6084e4adf56cde8a81675f5885988c3f5c4ad30580b8a3bad9ed2bb6ba4a0"}
Sep 11 17:56:24.947536 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:24.947487    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf" event={"ID":"d9b1cb5a-bf3b-4424-b978-8ab64b78a67b","Type":"ContainerStarted","Data":"71bfbca916e132b0cd078bff9cc00ed6f910650c6a9e2ddd68e39673ee9d4fe5"}
Sep 11 17:56:24.968612 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:24.968554    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf" podStartSLOduration=1.7741699469999999 podStartE2EDuration="1.968534546s" totalImagesPullingTime="194.364599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:56:24.966763437 +0000 UTC m=+689.254297764" watchObservedRunningTime="2026-09-11 17:56:24.968534546 +0000 UTC m=+689.256068852"
Sep 11 17:56:33.086489 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:33.086454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:56:33.656473 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:33.656437    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:33.656710 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:33.656502    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:33.668994 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:33.668967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:33.999647 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:33.999573    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4j9vf"
Sep 11 17:56:53.867206 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:53.867131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:56:53.932690 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:56:53.932642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:41.511660 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:41.511621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:41.610627 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:41.610590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:42.817184 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:42.817146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:42.930587 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:42.930527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:51.796401 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:51.796367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:59.043666 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:59.043632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:59.259759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:59.259729    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:57:59.679448 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:57:59.679416    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:00.071025 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:00.070990    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:00.620244 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:00.620207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:00.724386 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:00.724354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:01.122002 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:01.121966    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:02.351363 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:02.351326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:02.558320 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:02.558290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:03.649075 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.649041    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"]
Sep 11 17:58:03.652462 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.652440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.663336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.663317    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-67477b-serving-cert\""
Sep 11 17:58:03.669154 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.669129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"]
Sep 11 17:58:03.741482 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.741447    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:03.827467 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.827428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.827467 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.827470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-metrics-certs\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.827733 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.827499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8js\" (UniqueName: \"kubernetes.io/projected/17924043-97c9-4dff-a6ee-73e13883fa16-kube-api-access-5m8js\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.827733 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.827519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17924043-97c9-4dff-a6ee-73e13883fa16-openshift-service-ca\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.870790 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.870751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:03.928304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.928218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.928304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.928257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-metrics-certs\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.928304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.928275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8js\" (UniqueName: \"kubernetes.io/projected/17924043-97c9-4dff-a6ee-73e13883fa16-kube-api-access-5m8js\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.928304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.928297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17924043-97c9-4dff-a6ee-73e13883fa16-openshift-service-ca\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.928617 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:58:03.928379    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-serving-cert: secret "maas-api-e2e-inf-a-67477b-serving-cert" not found
Sep 11 17:58:03.928617 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:58:03.928461    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls podName:17924043-97c9-4dff-a6ee-73e13883fa16 nodeName:}" failed. No retries permitted until 2026-09-11 17:58:04.428442499 +0000 UTC m=+788.715976783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls") pod "maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x" (UID: "17924043-97c9-4dff-a6ee-73e13883fa16") : secret "maas-api-e2e-inf-a-67477b-serving-cert" not found
Sep 11 17:58:03.928896 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.928880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17924043-97c9-4dff-a6ee-73e13883fa16-openshift-service-ca\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.930826 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.930802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-metrics-certs\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:03.940920 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:03.940900    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8js\" (UniqueName: \"kubernetes.io/projected/17924043-97c9-4dff-a6ee-73e13883fa16-kube-api-access-5m8js\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:04.174490 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.174449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:04.432947 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.432907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:04.435303 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.435280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls\") pod \"maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:04.482278 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.482251    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:04.563060 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.563026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:04.588044 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.588011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:04.616060 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.616030    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"]
Sep 11 17:58:04.621862 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.621804    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.625175 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.625101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-67477b-dockercfg-kxqfp\""
Sep 11 17:58:04.625630 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.625453    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-67477b\""
Sep 11 17:58:04.638404 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.638379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"]
Sep 11 17:58:04.723665 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.723587    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"]
Sep 11 17:58:04.727806 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.727781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:04.734662 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.734638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1753f10-bb34-4b6b-938a-8d79990167a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.734795 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.734728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-478hl\" (UniqueName: \"kubernetes.io/projected/b1753f10-bb34-4b6b-938a-8d79990167a8-kube-api-access-478hl\") pod \"payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.741273 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.741248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"]
Sep 11 17:58:04.835464 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.835424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-478hl\" (UniqueName: \"kubernetes.io/projected/b1753f10-bb34-4b6b-938a-8d79990167a8-kube-api-access-478hl\") pod \"payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.835464 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.835467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae4e081f-c685-455a-abd3-005908bb0115-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") " pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:04.835746 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.835528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1753f10-bb34-4b6b-938a-8d79990167a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.835746 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.835547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctds\" (UniqueName: \"kubernetes.io/projected/ae4e081f-c685-455a-abd3-005908bb0115-kube-api-access-9ctds\") pod \"payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") " pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:04.836267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.836242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1753f10-bb34-4b6b-938a-8d79990167a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.849318 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.849291    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"]
Sep 11 17:58:04.852007 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:04.851981    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17924043_97c9_4dff_a6ee_73e13883fa16.slice/crio-63a8183a403039aff816aae818986af65f753b79b0193dfb4e757cac9796d2bf WatchSource:0}: Error finding container 63a8183a403039aff816aae818986af65f753b79b0193dfb4e757cac9796d2bf: Status 404 returned error can't find the container with id 63a8183a403039aff816aae818986af65f753b79b0193dfb4e757cac9796d2bf
Sep 11 17:58:04.858356 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.858336    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-478hl\" (UniqueName: \"kubernetes.io/projected/b1753f10-bb34-4b6b-938a-8d79990167a8-kube-api-access-478hl\") pod \"payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.935385 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.935353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:04.936668 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.936633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae4e081f-c685-455a-abd3-005908bb0115-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") " pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:04.936864 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.936734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctds\" (UniqueName: \"kubernetes.io/projected/ae4e081f-c685-455a-abd3-005908bb0115-kube-api-access-9ctds\") pod \"payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") " pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:04.937417 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.937400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae4e081f-c685-455a-abd3-005908bb0115-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") " pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:04.947304 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:04.947284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctds\" (UniqueName: \"kubernetes.io/projected/ae4e081f-c685-455a-abd3-005908bb0115-kube-api-access-9ctds\") pod \"payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") " pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:05.036737 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.036702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:05.238374 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.238296    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"]
Sep 11 17:58:05.242729 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:05.242701    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1753f10_bb34_4b6b_938a_8d79990167a8.slice/crio-cb4d5757179eed595147e9409ccd8e790abcc1ce27a00fe85a64b5da667c340c WatchSource:0}: Error finding container cb4d5757179eed595147e9409ccd8e790abcc1ce27a00fe85a64b5da667c340c: Status 404 returned error can't find the container with id cb4d5757179eed595147e9409ccd8e790abcc1ce27a00fe85a64b5da667c340c
Sep 11 17:58:05.351532 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:05.351481    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4e081f_c685_455a_abd3_005908bb0115.slice/crio-7f4151e19489c8ab849d629573547c23b96d10523f0637f63d91e4c4c1411b53 WatchSource:0}: Error finding container 7f4151e19489c8ab849d629573547c23b96d10523f0637f63d91e4c4c1411b53: Status 404 returned error can't find the container with id 7f4151e19489c8ab849d629573547c23b96d10523f0637f63d91e4c4c1411b53
Sep 11 17:58:05.353530 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.353508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"]
Sep 11 17:58:05.371859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.371829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf" event={"ID":"ae4e081f-c685-455a-abd3-005908bb0115","Type":"ContainerStarted","Data":"7f4151e19489c8ab849d629573547c23b96d10523f0637f63d91e4c4c1411b53"}
Sep 11 17:58:05.373653 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.373620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x" event={"ID":"17924043-97c9-4dff-a6ee-73e13883fa16","Type":"ContainerStarted","Data":"6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7"}
Sep 11 17:58:05.373780 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.373709    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:05.373780 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.373740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x" event={"ID":"17924043-97c9-4dff-a6ee-73e13883fa16","Type":"ContainerStarted","Data":"63a8183a403039aff816aae818986af65f753b79b0193dfb4e757cac9796d2bf"}
Sep 11 17:58:05.375272 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.375248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx" event={"ID":"b1753f10-bb34-4b6b-938a-8d79990167a8","Type":"ContainerStarted","Data":"abcb82cb9b508bb7acb93f1c6a17317de88688acc16c1ddfd11d948128eb11cd"}
Sep 11 17:58:05.375362 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.375293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx" event={"ID":"b1753f10-bb34-4b6b-938a-8d79990167a8","Type":"ContainerStarted","Data":"cb4d5757179eed595147e9409ccd8e790abcc1ce27a00fe85a64b5da667c340c"}
Sep 11 17:58:05.375362 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.375319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:05.421000 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.420951    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x" podStartSLOduration=2.00940696 podStartE2EDuration="2.42093621s" totalImagesPullingTime="411.52925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:05.420480817 +0000 UTC m=+789.708015134" watchObservedRunningTime="2026-09-11 17:58:05.42093621 +0000 UTC m=+789.708470538"
Sep 11 17:58:05.445143 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:05.445090    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx" podStartSLOduration=1.445074049 podStartE2EDuration="1.445074049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:05.44334179 +0000 UTC m=+789.730876087" watchObservedRunningTime="2026-09-11 17:58:05.445074049 +0000 UTC m=+789.732608408"
Sep 11 17:58:06.384001 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:06.383964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf" event={"ID":"ae4e081f-c685-455a-abd3-005908bb0115","Type":"ContainerStarted","Data":"10aa75f423adb3fb390e3c84ef12a53987ddf9b51c8cd230e3b4d4ef30e3bc63"}
Sep 11 17:58:06.384367 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:06.384033    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:06.406369 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:06.406310    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf" podStartSLOduration=2.406290358 podStartE2EDuration="2.406290358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:06.404290337 +0000 UTC m=+790.691824644" watchObservedRunningTime="2026-09-11 17:58:06.406290358 +0000 UTC m=+790.693824665"
Sep 11 17:58:07.465810 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:07.465766    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:07.565244 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:07.565210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:07.735024 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:07.734944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:08.078996 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:08.078960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:08.196033 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:08.196003    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:08.473170 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:08.473089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:08.567718 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:08.567664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:09.061195 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:09.061155    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:10.525799 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:10.525751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:10.921866 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:10.921833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:11.114112 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:11.114083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:11.389137 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:11.389106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 17:58:11.605762 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:11.605729    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:11.786570 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:11.786475    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:11.908506 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:11.908464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:13.225305 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:13.225256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:13.389273 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:13.389235    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:13.490128 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:13.490057    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:14.192041 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.192006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:14.313966 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.313915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:14.406339 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.406308    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"]
Sep 11 17:58:14.410023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.410006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.413023 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.413005    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-5883b7\""
Sep 11 17:58:14.413457 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.413442    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-5883b7-dockercfg-8dkmr\""
Sep 11 17:58:14.422956 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.422935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h9xc\" (UniqueName: \"kubernetes.io/projected/70af7f24-e912-4047-94b9-22d274e45769-kube-api-access-7h9xc\") pod \"payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.423048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.422973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af7f24-e912-4047-94b9-22d274e45769-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.439424 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.439396    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"]
Sep 11 17:58:14.485693 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.485579    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"]
Sep 11 17:58:14.488929 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.488910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:14.519825 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.519793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"]
Sep 11 17:58:14.523666 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.523638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f0fc02-c83d-42bf-8b14-543138884033-plugins-config-volume\") pod \"payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") " pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:14.523785 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.523723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h9xc\" (UniqueName: \"kubernetes.io/projected/70af7f24-e912-4047-94b9-22d274e45769-kube-api-access-7h9xc\") pod \"payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.523785 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.523771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926jr\" (UniqueName: \"kubernetes.io/projected/97f0fc02-c83d-42bf-8b14-543138884033-kube-api-access-926jr\") pod \"payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") " pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:14.523878 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.523811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af7f24-e912-4047-94b9-22d274e45769-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.524696 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.524650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af7f24-e912-4047-94b9-22d274e45769-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.544165 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.544132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h9xc\" (UniqueName: \"kubernetes.io/projected/70af7f24-e912-4047-94b9-22d274e45769-kube-api-access-7h9xc\") pod \"payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.625009 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.624972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f0fc02-c83d-42bf-8b14-543138884033-plugins-config-volume\") pod \"payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") " pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:14.625153 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.625031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926jr\" (UniqueName: \"kubernetes.io/projected/97f0fc02-c83d-42bf-8b14-543138884033-kube-api-access-926jr\") pod \"payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") " pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:14.625760 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.625742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f0fc02-c83d-42bf-8b14-543138884033-plugins-config-volume\") pod \"payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") " pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:14.638615 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.638586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-926jr\" (UniqueName: \"kubernetes.io/projected/97f0fc02-c83d-42bf-8b14-543138884033-kube-api-access-926jr\") pod \"payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") " pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:14.720872 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.720827    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:14.798940 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:14.798905    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:15.044761 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.044668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:15.054311 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.054274    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"]
Sep 11 17:58:15.062309 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:15.062267    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70af7f24_e912_4047_94b9_22d274e45769.slice/crio-af0f6d7f1d142ab666b4eb9e9e8ba1f8ee6d5f6a337c0a48e2e06f368c0f03c3 WatchSource:0}: Error finding container af0f6d7f1d142ab666b4eb9e9e8ba1f8ee6d5f6a337c0a48e2e06f368c0f03c3: Status 404 returned error can't find the container with id af0f6d7f1d142ab666b4eb9e9e8ba1f8ee6d5f6a337c0a48e2e06f368c0f03c3
Sep 11 17:58:15.103093 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.103062    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"]
Sep 11 17:58:15.107106 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:15.107079    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f0fc02_c83d_42bf_8b14_543138884033.slice/crio-d07e860b69872f382f412f437f753220bed8fe0800e2fa31e617c857e31e2b32 WatchSource:0}: Error finding container d07e860b69872f382f412f437f753220bed8fe0800e2fa31e617c857e31e2b32: Status 404 returned error can't find the container with id d07e860b69872f382f412f437f753220bed8fe0800e2fa31e617c857e31e2b32
Sep 11 17:58:15.283640 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.283610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:15.392150 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.392113    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:15.426572 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.426540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg" event={"ID":"97f0fc02-c83d-42bf-8b14-543138884033","Type":"ContainerStarted","Data":"e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645"}
Sep 11 17:58:15.426761 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.426588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg" event={"ID":"97f0fc02-c83d-42bf-8b14-543138884033","Type":"ContainerStarted","Data":"d07e860b69872f382f412f437f753220bed8fe0800e2fa31e617c857e31e2b32"}
Sep 11 17:58:15.426761 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.426701    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:15.428130 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.428110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg" event={"ID":"70af7f24-e912-4047-94b9-22d274e45769","Type":"ContainerStarted","Data":"8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47"}
Sep 11 17:58:15.428243 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.428147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg" event={"ID":"70af7f24-e912-4047-94b9-22d274e45769","Type":"ContainerStarted","Data":"af0f6d7f1d142ab666b4eb9e9e8ba1f8ee6d5f6a337c0a48e2e06f368c0f03c3"}
Sep 11 17:58:15.428243 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.428224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:15.458005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.457954    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg" podStartSLOduration=1.457934954 podStartE2EDuration="1.457934954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:15.455830202 +0000 UTC m=+799.743364510" watchObservedRunningTime="2026-09-11 17:58:15.457934954 +0000 UTC m=+799.745469262"
Sep 11 17:58:15.500256 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.500202    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg" podStartSLOduration=1.500186544 podStartE2EDuration="1.500186544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:15.49952617 +0000 UTC m=+799.787060482" watchObservedRunningTime="2026-09-11 17:58:15.500186544 +0000 UTC m=+799.787720849"
Sep 11 17:58:15.859267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.859233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:15.977452 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:15.977420    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:16.066874 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.066841    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"]
Sep 11 17:58:16.070589 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.070572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.075550 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.075528    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f412cf1d\""
Sep 11 17:58:16.075700 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.075599    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f412cf1d-dockercfg-x4d2s\""
Sep 11 17:58:16.087959 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.087931    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"]
Sep 11 17:58:16.121562 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.121493    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"]
Sep 11 17:58:16.124736 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.124716    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.136117 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.136094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"]
Sep 11 17:58:16.139003 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.138980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee91165-7aa6-46d8-ac07-78faaccf079c-plugins-config-volume\") pod \"payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") " pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.139111 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.139023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656s7\" (UniqueName: \"kubernetes.io/projected/0ee91165-7aa6-46d8-ac07-78faaccf079c-kube-api-access-656s7\") pod \"payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") " pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.139111 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.139065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbnfs\" (UniqueName: \"kubernetes.io/projected/8736cf25-baf9-449c-8423-cb727d1c52f8-kube-api-access-wbnfs\") pod \"payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.139111 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.139094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8736cf25-baf9-449c-8423-cb727d1c52f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.239506 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.239460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee91165-7aa6-46d8-ac07-78faaccf079c-plugins-config-volume\") pod \"payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") " pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.239738 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.239522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-656s7\" (UniqueName: \"kubernetes.io/projected/0ee91165-7aa6-46d8-ac07-78faaccf079c-kube-api-access-656s7\") pod \"payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") " pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.239738 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.239554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbnfs\" (UniqueName: \"kubernetes.io/projected/8736cf25-baf9-449c-8423-cb727d1c52f8-kube-api-access-wbnfs\") pod \"payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.239738 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.239585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8736cf25-baf9-449c-8423-cb727d1c52f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.240414 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.240389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8736cf25-baf9-449c-8423-cb727d1c52f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.240520 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.240419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee91165-7aa6-46d8-ac07-78faaccf079c-plugins-config-volume\") pod \"payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") " pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.253688 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.253651    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-656s7\" (UniqueName: \"kubernetes.io/projected/0ee91165-7aa6-46d8-ac07-78faaccf079c-kube-api-access-656s7\") pod \"payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") " pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.260818 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.260792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbnfs\" (UniqueName: \"kubernetes.io/projected/8736cf25-baf9-449c-8423-cb727d1c52f8-kube-api-access-wbnfs\") pod \"payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.381347 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.381259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:16.385718 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.385664    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 17:58:16.435664 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.435404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:16.669426 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.669339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:16.684471 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.684152    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"]
Sep 11 17:58:16.686327 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:16.685793    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8736cf25_baf9_449c_8423_cb727d1c52f8.slice/crio-197de9e3a9b49c2082553ebd1e0e836f8d064f7361d65f52a2e098a6f545e7ea WatchSource:0}: Error finding container 197de9e3a9b49c2082553ebd1e0e836f8d064f7361d65f52a2e098a6f545e7ea: Status 404 returned error can't find the container with id 197de9e3a9b49c2082553ebd1e0e836f8d064f7361d65f52a2e098a6f545e7ea
Sep 11 17:58:16.753654 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:16.753615    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"]
Sep 11 17:58:16.754334 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:16.754306    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee91165_7aa6_46d8_ac07_78faaccf079c.slice/crio-b19fcf74ef45eca79baf0f2d6ea6519a46eb940655409b7adf7d80021471743a WatchSource:0}: Error finding container b19fcf74ef45eca79baf0f2d6ea6519a46eb940655409b7adf7d80021471743a: Status 404 returned error can't find the container with id b19fcf74ef45eca79baf0f2d6ea6519a46eb940655409b7adf7d80021471743a
Sep 11 17:58:17.219984 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.219947    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:17.390431 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.390387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 17:58:17.459613 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.459576    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm" event={"ID":"0ee91165-7aa6-46d8-ac07-78faaccf079c","Type":"ContainerStarted","Data":"0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2"}
Sep 11 17:58:17.460089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.459643    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:17.460089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.459671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm" event={"ID":"0ee91165-7aa6-46d8-ac07-78faaccf079c","Type":"ContainerStarted","Data":"b19fcf74ef45eca79baf0f2d6ea6519a46eb940655409b7adf7d80021471743a"}
Sep 11 17:58:17.461094 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.461072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8" event={"ID":"8736cf25-baf9-449c-8423-cb727d1c52f8","Type":"ContainerStarted","Data":"31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c"}
Sep 11 17:58:17.461191 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.461107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8" event={"ID":"8736cf25-baf9-449c-8423-cb727d1c52f8","Type":"ContainerStarted","Data":"197de9e3a9b49c2082553ebd1e0e836f8d064f7361d65f52a2e098a6f545e7ea"}
Sep 11 17:58:17.461233 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.461191    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:17.502273 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.502165    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm" podStartSLOduration=1.502142198 podStartE2EDuration="1.502142198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:17.500988853 +0000 UTC m=+801.788523160" watchObservedRunningTime="2026-09-11 17:58:17.502142198 +0000 UTC m=+801.789676508"
Sep 11 17:58:17.531920 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.531888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:17.539109 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.539063    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8" podStartSLOduration=1.539049653 podStartE2EDuration="1.539049653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:17.537533032 +0000 UTC m=+801.825067339" watchObservedRunningTime="2026-09-11 17:58:17.539049653 +0000 UTC m=+801.826583958"
Sep 11 17:58:17.890563 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.890520    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:17.995213 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:17.995182    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:18.188330 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:18.188248    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:18.340336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:18.340303    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:18.446466 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:18.446389    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:18.662667 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:18.662631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:18.766183 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:18.766098    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:18.881474 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:18.881441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:19.576873 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:19.576845    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:20.987051 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:20.987021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:21.155153 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:21.155114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:21.790289 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:21.790208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:21.954357 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:21.954318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:22.587834 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:22.587800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:23.480836 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:23.480805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:24.178960 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:24.178929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:25.480487 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:25.480443    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:26.455251 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:26.455221    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 17:58:26.455440 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:26.455290    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 17:58:26.491662 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:26.491630    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:27.646275 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:27.646231    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:27.746529 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:27.746492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:27.900625 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:27.900548    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:28.011228 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.011198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:28.124431 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.124397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:28.308861 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.308825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:28.420161 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.420133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:28.468594 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.468564    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:28.468787 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.468648    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:28.558582 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.558553    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:28.666987 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.666908    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"]
Sep 11 17:58:28.671791 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.671769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:28.681828 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.681808    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-fb8c5d\""
Sep 11 17:58:28.683379 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.683366    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-fb8c5d-dockercfg-kwbnh\""
Sep 11 17:58:28.693204 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.693177    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"]
Sep 11 17:58:28.719997 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.719967    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"]
Sep 11 17:58:28.723412 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.723393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:28.740482 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.740455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"]
Sep 11 17:58:28.753990 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.753952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzdsd\" (UniqueName: \"kubernetes.io/projected/d6a46ba0-1fba-4114-a408-6e665f7bb08d-kube-api-access-jzdsd\") pod \"payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:28.754149 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.754037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a46ba0-1fba-4114-a408-6e665f7bb08d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:28.855016 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.854980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft2zv\" (UniqueName: \"kubernetes.io/projected/4c852878-3121-4f32-a8fd-ad0059730c5b-kube-api-access-ft2zv\") pod \"payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:28.855016 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.855022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c852878-3121-4f32-a8fd-ad0059730c5b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:28.855218 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.855054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzdsd\" (UniqueName: \"kubernetes.io/projected/d6a46ba0-1fba-4114-a408-6e665f7bb08d-kube-api-access-jzdsd\") pod \"payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:28.855218 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.855101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a46ba0-1fba-4114-a408-6e665f7bb08d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:28.855841 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.855821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a46ba0-1fba-4114-a408-6e665f7bb08d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:28.867042 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.867014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzdsd\" (UniqueName: \"kubernetes.io/projected/d6a46ba0-1fba-4114-a408-6e665f7bb08d-kube-api-access-jzdsd\") pod \"payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:28.956114 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.956024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2zv\" (UniqueName: \"kubernetes.io/projected/4c852878-3121-4f32-a8fd-ad0059730c5b-kube-api-access-ft2zv\") pod \"payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:28.956114 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.956070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c852878-3121-4f32-a8fd-ad0059730c5b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:28.956817 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.956786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c852878-3121-4f32-a8fd-ad0059730c5b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:28.966236 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.966212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft2zv\" (UniqueName: \"kubernetes.io/projected/4c852878-3121-4f32-a8fd-ad0059730c5b-kube-api-access-ft2zv\") pod \"payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:28.981100 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:28.981074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:29.034249 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.034218    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:29.217635 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.217546    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:29.299966 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.299943    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"]
Sep 11 17:58:29.301544 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:29.301522    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a46ba0_1fba_4114_a408_6e665f7bb08d.slice/crio-f6c4af94ae721b77d843cd2b18048e49e1b55d900488ef691d8301c2c8116be2 WatchSource:0}: Error finding container f6c4af94ae721b77d843cd2b18048e49e1b55d900488ef691d8301c2c8116be2: Status 404 returned error can't find the container with id f6c4af94ae721b77d843cd2b18048e49e1b55d900488ef691d8301c2c8116be2
Sep 11 17:58:29.342405 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.342383    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"]
Sep 11 17:58:29.343814 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:29.343789    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c852878_3121_4f32_a8fd_ad0059730c5b.slice/crio-955389cb4177daf5a571a17ef2b65a5276ba5a22cd2d9c5bfd8570948bd1ed3c WatchSource:0}: Error finding container 955389cb4177daf5a571a17ef2b65a5276ba5a22cd2d9c5bfd8570948bd1ed3c: Status 404 returned error can't find the container with id 955389cb4177daf5a571a17ef2b65a5276ba5a22cd2d9c5bfd8570948bd1ed3c
Sep 11 17:58:29.524824 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.524722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln" event={"ID":"4c852878-3121-4f32-a8fd-ad0059730c5b","Type":"ContainerStarted","Data":"ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889"}
Sep 11 17:58:29.524824 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.524792    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:29.524824 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.524816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln" event={"ID":"4c852878-3121-4f32-a8fd-ad0059730c5b","Type":"ContainerStarted","Data":"955389cb4177daf5a571a17ef2b65a5276ba5a22cd2d9c5bfd8570948bd1ed3c"}
Sep 11 17:58:29.526539 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.526504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5" event={"ID":"d6a46ba0-1fba-4114-a408-6e665f7bb08d","Type":"ContainerStarted","Data":"fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6"}
Sep 11 17:58:29.526642 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.526549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5" event={"ID":"d6a46ba0-1fba-4114-a408-6e665f7bb08d","Type":"ContainerStarted","Data":"f6c4af94ae721b77d843cd2b18048e49e1b55d900488ef691d8301c2c8116be2"}
Sep 11 17:58:29.526642 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.526575    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:29.792843 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.792712    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5" podStartSLOduration=1.792690394 podStartE2EDuration="1.792690394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:29.790311244 +0000 UTC m=+814.077845550" watchObservedRunningTime="2026-09-11 17:58:29.792690394 +0000 UTC m=+814.080224694"
Sep 11 17:58:29.794053 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:29.794014    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln" podStartSLOduration=1.7940047049999999 podStartE2EDuration="1.794004705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:29.651315687 +0000 UTC m=+813.938849994" watchObservedRunningTime="2026-09-11 17:58:29.794004705 +0000 UTC m=+814.081539010"
Sep 11 17:58:30.615342 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:30.615305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:31.402968 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:31.402933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:31.755487 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:31.755384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:32.725263 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:32.725229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:34.340340 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:34.340307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:35.455160 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:35.455128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:36.365292 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:36.365253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:36.661155 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:36.661070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:36.759696 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:36.759648    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:37.403192 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:37.403158    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:38.249920 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:38.249831    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:40.533882 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:40.533851    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 17:58:40.534326 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:40.534008    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 17:58:42.108918 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.108884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:42.152399 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.152371    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"]
Sep 11 17:58:42.152588 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.152558    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm" podUID="0ee91165-7aa6-46d8-ac07-78faaccf079c" containerName="payload-processing" containerID="cri-o://0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2" gracePeriod=30
Sep 11 17:58:42.177397 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.177360    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"]
Sep 11 17:58:42.178197 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.177659    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8" podUID="8736cf25-baf9-449c-8423-cb727d1c52f8" containerName="payload-pre-processing" containerID="cri-o://31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c" gracePeriod=30
Sep 11 17:58:42.213776 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.213739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:42.318577 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.318538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:42.433884 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.433857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:42.439066 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.439019    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:42.461393 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.461369    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:42.536426 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.536394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:42.575504 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.575471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-656s7\" (UniqueName: \"kubernetes.io/projected/0ee91165-7aa6-46d8-ac07-78faaccf079c-kube-api-access-656s7\") pod \"0ee91165-7aa6-46d8-ac07-78faaccf079c\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") "
Sep 11 17:58:42.575704 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.575563    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbnfs\" (UniqueName: \"kubernetes.io/projected/8736cf25-baf9-449c-8423-cb727d1c52f8-kube-api-access-wbnfs\") pod \"8736cf25-baf9-449c-8423-cb727d1c52f8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") "
Sep 11 17:58:42.575704 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.575622    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee91165-7aa6-46d8-ac07-78faaccf079c-plugins-config-volume\") pod \"0ee91165-7aa6-46d8-ac07-78faaccf079c\" (UID: \"0ee91165-7aa6-46d8-ac07-78faaccf079c\") "
Sep 11 17:58:42.575704 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.575648    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8736cf25-baf9-449c-8423-cb727d1c52f8-plugins-config-volume\") pod \"8736cf25-baf9-449c-8423-cb727d1c52f8\" (UID: \"8736cf25-baf9-449c-8423-cb727d1c52f8\") "
Sep 11 17:58:42.576008 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.575977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ee91165-7aa6-46d8-ac07-78faaccf079c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ee91165-7aa6-46d8-ac07-78faaccf079c" (UID: "0ee91165-7aa6-46d8-ac07-78faaccf079c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:58:42.576250 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.576136    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8736cf25-baf9-449c-8423-cb727d1c52f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8736cf25-baf9-449c-8423-cb727d1c52f8" (UID: "8736cf25-baf9-449c-8423-cb727d1c52f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:58:42.578079 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.578045    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8736cf25-baf9-449c-8423-cb727d1c52f8-kube-api-access-wbnfs" (OuterVolumeSpecName: "kube-api-access-wbnfs") pod "8736cf25-baf9-449c-8423-cb727d1c52f8" (UID: "8736cf25-baf9-449c-8423-cb727d1c52f8"). InnerVolumeSpecName "kube-api-access-wbnfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:58:42.578195 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.578101    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ee91165-7aa6-46d8-ac07-78faaccf079c-kube-api-access-656s7" (OuterVolumeSpecName: "kube-api-access-656s7") pod "0ee91165-7aa6-46d8-ac07-78faaccf079c" (UID: "0ee91165-7aa6-46d8-ac07-78faaccf079c"). InnerVolumeSpecName "kube-api-access-656s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:58:42.587488 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.587456    2576 generic.go:356] "Generic (PLEG): container finished" podID="8736cf25-baf9-449c-8423-cb727d1c52f8" containerID="31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c" exitCode=0
Sep 11 17:58:42.587585 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.587508    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"
Sep 11 17:58:42.587641 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.587511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8" event={"ID":"8736cf25-baf9-449c-8423-cb727d1c52f8","Type":"ContainerDied","Data":"31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c"}
Sep 11 17:58:42.587641 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.587627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8" event={"ID":"8736cf25-baf9-449c-8423-cb727d1c52f8","Type":"ContainerDied","Data":"197de9e3a9b49c2082553ebd1e0e836f8d064f7361d65f52a2e098a6f545e7ea"}
Sep 11 17:58:42.587751 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.587654    2576 scope.go:117] "RemoveContainer" containerID="31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c"
Sep 11 17:58:42.588951 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.588930    2576 generic.go:356] "Generic (PLEG): container finished" podID="0ee91165-7aa6-46d8-ac07-78faaccf079c" containerID="0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2" exitCode=0
Sep 11 17:58:42.589046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.588958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm" event={"ID":"0ee91165-7aa6-46d8-ac07-78faaccf079c","Type":"ContainerDied","Data":"0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2"}
Sep 11 17:58:42.589046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.588994    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"
Sep 11 17:58:42.589046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.589035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm" event={"ID":"0ee91165-7aa6-46d8-ac07-78faaccf079c","Type":"ContainerDied","Data":"b19fcf74ef45eca79baf0f2d6ea6519a46eb940655409b7adf7d80021471743a"}
Sep 11 17:58:42.596354 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.596336    2576 scope.go:117] "RemoveContainer" containerID="31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c"
Sep 11 17:58:42.596702 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:58:42.596663    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c\": container with ID starting with 31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c not found: ID does not exist" containerID="31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c"
Sep 11 17:58:42.596811 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.596710    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c"} err="failed to get container status \"31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c\": rpc error: code = NotFound desc = could not find container \"31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c\": container with ID starting with 31944748873c98588eab9f1a4afd7caa62c88ee7d1a7ad25c417bc250bf49c7c not found: ID does not exist"
Sep 11 17:58:42.596811 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.596726    2576 scope.go:117] "RemoveContainer" containerID="0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2"
Sep 11 17:58:42.606112 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.606092    2576 scope.go:117] "RemoveContainer" containerID="0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2"
Sep 11 17:58:42.606366 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:58:42.606350    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2\": container with ID starting with 0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2 not found: ID does not exist" containerID="0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2"
Sep 11 17:58:42.606424 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.606372    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2"} err="failed to get container status \"0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2\": rpc error: code = NotFound desc = could not find container \"0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2\": container with ID starting with 0ba84e923e1d36ad017d6958f3480025f8d0eb57416461093bb13179159379f2 not found: ID does not exist"
Sep 11 17:58:42.621425 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.621405    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"]
Sep 11 17:58:42.628069 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.628050    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8"]
Sep 11 17:58:42.648413 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.648337    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"]
Sep 11 17:58:42.650005 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.649975    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:42.652787 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.652768    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm"]
Sep 11 17:58:42.676810 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.676773    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee91165-7aa6-46d8-ac07-78faaccf079c-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:58:42.676810 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.676807    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8736cf25-baf9-449c-8423-cb727d1c52f8-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:58:42.676983 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.676825    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-656s7\" (UniqueName: \"kubernetes.io/projected/0ee91165-7aa6-46d8-ac07-78faaccf079c-kube-api-access-656s7\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:58:42.676983 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.676840    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbnfs\" (UniqueName: \"kubernetes.io/projected/8736cf25-baf9-449c-8423-cb727d1c52f8-kube-api-access-wbnfs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:58:42.935983 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:42.935887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:43.109198 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:43.109164    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:43.291252 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:43.291178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:43.536348 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:43.536318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:43.872431 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:43.872400    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:44.019981 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:44.019953    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:44.239789 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:44.239717    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ee91165-7aa6-46d8-ac07-78faaccf079c" path="/var/lib/kubelet/pods/0ee91165-7aa6-46d8-ac07-78faaccf079c/volumes"
Sep 11 17:58:44.240115 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:44.240103    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8736cf25-baf9-449c-8423-cb727d1c52f8" path="/var/lib/kubelet/pods/8736cf25-baf9-449c-8423-cb727d1c52f8/volumes"
Sep 11 17:58:44.575011 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:44.574981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:45.599355 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:45.599325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:46.091115 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:46.091080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:46.196031 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:46.196001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:46.569581 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:46.569541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:48.463937 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:48.463902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:48.587510 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:48.587481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:48.728711 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:48.728607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:49.274766 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.274737    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:49.376518 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.376481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:49.414122 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.414090    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"]
Sep 11 17:58:49.414470 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.414458    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8736cf25-baf9-449c-8423-cb727d1c52f8" containerName="payload-pre-processing"
Sep 11 17:58:49.414512 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.414475    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8736cf25-baf9-449c-8423-cb727d1c52f8" containerName="payload-pre-processing"
Sep 11 17:58:49.414512 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.414488    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ee91165-7aa6-46d8-ac07-78faaccf079c" containerName="payload-processing"
Sep 11 17:58:49.414512 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.414493    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ee91165-7aa6-46d8-ac07-78faaccf079c" containerName="payload-processing"
Sep 11 17:58:49.414602 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.414575    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8736cf25-baf9-449c-8423-cb727d1c52f8" containerName="payload-pre-processing"
Sep 11 17:58:49.414602 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.414583    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ee91165-7aa6-46d8-ac07-78faaccf079c" containerName="payload-processing"
Sep 11 17:58:49.418917 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.418900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.422629 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.422603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-5d49a629-dockercfg-hqn9k\""
Sep 11 17:58:49.422790 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.422616    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-5d49a629\""
Sep 11 17:58:49.434226 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.434200    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"]
Sep 11 17:58:49.529545 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.529468    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"]
Sep 11 17:58:49.532925 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.532907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:49.539531 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.539506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8j6w\" (UniqueName: \"kubernetes.io/projected/c44fb927-dd08-4bc5-9832-64cf8a48be13-kube-api-access-z8j6w\") pod \"payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.539647 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.539585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44fb927-dd08-4bc5-9832-64cf8a48be13-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.550813 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.550789    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"]
Sep 11 17:58:49.640809 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.640769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44fb927-dd08-4bc5-9832-64cf8a48be13-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.640809 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.640802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr9xg\" (UniqueName: \"kubernetes.io/projected/a6125d51-30d6-4e8a-99cf-93a248068f7c-kube-api-access-fr9xg\") pod \"payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") " pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:49.641048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.640864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8j6w\" (UniqueName: \"kubernetes.io/projected/c44fb927-dd08-4bc5-9832-64cf8a48be13-kube-api-access-z8j6w\") pod \"payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.641048 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.640883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6125d51-30d6-4e8a-99cf-93a248068f7c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") " pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:49.641473 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.641452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44fb927-dd08-4bc5-9832-64cf8a48be13-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.654419 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.654387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8j6w\" (UniqueName: \"kubernetes.io/projected/c44fb927-dd08-4bc5-9832-64cf8a48be13-kube-api-access-z8j6w\") pod \"payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.728877 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.728845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:49.742302 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.742265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6125d51-30d6-4e8a-99cf-93a248068f7c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") " pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:49.742413 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.742367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr9xg\" (UniqueName: \"kubernetes.io/projected/a6125d51-30d6-4e8a-99cf-93a248068f7c-kube-api-access-fr9xg\") pod \"payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") " pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:49.743050 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.743029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6125d51-30d6-4e8a-99cf-93a248068f7c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") " pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:49.771843 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.771816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr9xg\" (UniqueName: \"kubernetes.io/projected/a6125d51-30d6-4e8a-99cf-93a248068f7c-kube-api-access-fr9xg\") pod \"payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") " pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:49.808234 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.808201    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:49.842891 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:49.842865    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:50.009607 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.009578    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"]
Sep 11 17:58:50.013547 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:50.013522    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44fb927_dd08_4bc5_9832_64cf8a48be13.slice/crio-e969bd11517461c153393b903e906f9a420828e03c9fc306c72b7f736491f1cc WatchSource:0}: Error finding container e969bd11517461c153393b903e906f9a420828e03c9fc306c72b7f736491f1cc: Status 404 returned error can't find the container with id e969bd11517461c153393b903e906f9a420828e03c9fc306c72b7f736491f1cc
Sep 11 17:58:50.125949 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.125923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"]
Sep 11 17:58:50.127246 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:58:50.127223    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6125d51_30d6_4e8a_99cf_93a248068f7c.slice/crio-2d6225f7fec5ad7c4d8322d1b714b122d7b36e5e5bda57bd5f35b1d0156ffcc0 WatchSource:0}: Error finding container 2d6225f7fec5ad7c4d8322d1b714b122d7b36e5e5bda57bd5f35b1d0156ffcc0: Status 404 returned error can't find the container with id 2d6225f7fec5ad7c4d8322d1b714b122d7b36e5e5bda57bd5f35b1d0156ffcc0
Sep 11 17:58:50.633821 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.633783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh" event={"ID":"a6125d51-30d6-4e8a-99cf-93a248068f7c","Type":"ContainerStarted","Data":"576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505"}
Sep 11 17:58:50.634280 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.633849    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:58:50.634280 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.633872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh" event={"ID":"a6125d51-30d6-4e8a-99cf-93a248068f7c","Type":"ContainerStarted","Data":"2d6225f7fec5ad7c4d8322d1b714b122d7b36e5e5bda57bd5f35b1d0156ffcc0"}
Sep 11 17:58:50.635393 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.635370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm" event={"ID":"c44fb927-dd08-4bc5-9832-64cf8a48be13","Type":"ContainerStarted","Data":"55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6"}
Sep 11 17:58:50.635495 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.635407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm" event={"ID":"c44fb927-dd08-4bc5-9832-64cf8a48be13","Type":"ContainerStarted","Data":"e969bd11517461c153393b903e906f9a420828e03c9fc306c72b7f736491f1cc"}
Sep 11 17:58:50.635495 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.635427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:58:50.660465 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.660422    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh" podStartSLOduration=1.660407881 podStartE2EDuration="1.660407881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:50.658788349 +0000 UTC m=+834.946322657" watchObservedRunningTime="2026-09-11 17:58:50.660407881 +0000 UTC m=+834.947942241"
Sep 11 17:58:50.685545 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:50.685498    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm" podStartSLOduration=1.685483214 podStartE2EDuration="1.685483214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:58:50.682813597 +0000 UTC m=+834.970347903" watchObservedRunningTime="2026-09-11 17:58:50.685483214 +0000 UTC m=+834.973017520"
Sep 11 17:58:51.263965 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:51.263920    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:51.762499 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:51.762461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:52.303285 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:52.303253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:58:53.620562 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:58:53.620533    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:01.644695 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:01.644638    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:59:01.645044 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:01.644842    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:59:03.754693 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:03.754636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:04.088716 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:04.088661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:04.330296 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:04.330259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:06.346802 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:06.346775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:06.986126 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:06.986079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:07.721582 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:07.721543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:08.831494 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:08.831462    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:09.921612 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:09.921567    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:10.871657 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:10.871617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:11.955729 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:11.955697    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:12.882641 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:12.882606    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:13.291550 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:13.291473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:13.401127 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:13.401091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:13.968422 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:13.968395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:15.284122 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:15.284087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:15.576320 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:15.576278    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:15.649180 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:15.649149    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:16.974752 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:16.974704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:17.805703 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:17.805633    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:17.846381 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:17.846350    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"]
Sep 11 17:59:17.846627 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:17.846596    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh" podUID="a6125d51-30d6-4e8a-99cf-93a248068f7c" containerName="payload-processing" containerID="cri-o://576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505" gracePeriod=30
Sep 11 17:59:17.855797 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:17.855774    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"]
Sep 11 17:59:17.856033 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:17.856010    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm" podUID="c44fb927-dd08-4bc5-9832-64cf8a48be13" containerName="payload-pre-processing" containerID="cri-o://55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6" gracePeriod=30
Sep 11 17:59:17.900332 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:17.900296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:18.051975 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.051948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:18.103030 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.103003    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:59:18.136963 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.136940    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:59:18.178632 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.178603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44fb927-dd08-4bc5-9832-64cf8a48be13-plugins-config-volume\") pod \"c44fb927-dd08-4bc5-9832-64cf8a48be13\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") "
Sep 11 17:59:18.178803 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.178653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8j6w\" (UniqueName: \"kubernetes.io/projected/c44fb927-dd08-4bc5-9832-64cf8a48be13-kube-api-access-z8j6w\") pod \"c44fb927-dd08-4bc5-9832-64cf8a48be13\" (UID: \"c44fb927-dd08-4bc5-9832-64cf8a48be13\") "
Sep 11 17:59:18.178803 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.178752    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr9xg\" (UniqueName: \"kubernetes.io/projected/a6125d51-30d6-4e8a-99cf-93a248068f7c-kube-api-access-fr9xg\") pod \"a6125d51-30d6-4e8a-99cf-93a248068f7c\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") "
Sep 11 17:59:18.178927 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.178810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6125d51-30d6-4e8a-99cf-93a248068f7c-plugins-config-volume\") pod \"a6125d51-30d6-4e8a-99cf-93a248068f7c\" (UID: \"a6125d51-30d6-4e8a-99cf-93a248068f7c\") "
Sep 11 17:59:18.179124 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.179092    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44fb927-dd08-4bc5-9832-64cf8a48be13-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c44fb927-dd08-4bc5-9832-64cf8a48be13" (UID: "c44fb927-dd08-4bc5-9832-64cf8a48be13"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:59:18.179248 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.179200    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6125d51-30d6-4e8a-99cf-93a248068f7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6125d51-30d6-4e8a-99cf-93a248068f7c" (UID: "a6125d51-30d6-4e8a-99cf-93a248068f7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:59:18.179952 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.179930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:18.180983 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.180958    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6125d51-30d6-4e8a-99cf-93a248068f7c-kube-api-access-fr9xg" (OuterVolumeSpecName: "kube-api-access-fr9xg") pod "a6125d51-30d6-4e8a-99cf-93a248068f7c" (UID: "a6125d51-30d6-4e8a-99cf-93a248068f7c"). InnerVolumeSpecName "kube-api-access-fr9xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:59:18.181036 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.180983    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c44fb927-dd08-4bc5-9832-64cf8a48be13-kube-api-access-z8j6w" (OuterVolumeSpecName: "kube-api-access-z8j6w") pod "c44fb927-dd08-4bc5-9832-64cf8a48be13" (UID: "c44fb927-dd08-4bc5-9832-64cf8a48be13"). InnerVolumeSpecName "kube-api-access-z8j6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:59:18.279861 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.279830    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6125d51-30d6-4e8a-99cf-93a248068f7c-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:18.279861 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.279855    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44fb927-dd08-4bc5-9832-64cf8a48be13-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:18.279861 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.279864    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8j6w\" (UniqueName: \"kubernetes.io/projected/c44fb927-dd08-4bc5-9832-64cf8a48be13-kube-api-access-z8j6w\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:18.280056 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.279874    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr9xg\" (UniqueName: \"kubernetes.io/projected/a6125d51-30d6-4e8a-99cf-93a248068f7c-kube-api-access-fr9xg\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:18.283501 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.283480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:18.378979 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.378879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:18.678533 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.678431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:18.769204 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.769170    2576 generic.go:356] "Generic (PLEG): container finished" podID="a6125d51-30d6-4e8a-99cf-93a248068f7c" containerID="576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505" exitCode=0
Sep 11 17:59:18.769389 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.769224    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"
Sep 11 17:59:18.769389 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.769247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh" event={"ID":"a6125d51-30d6-4e8a-99cf-93a248068f7c","Type":"ContainerDied","Data":"576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505"}
Sep 11 17:59:18.769389 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.769294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh" event={"ID":"a6125d51-30d6-4e8a-99cf-93a248068f7c","Type":"ContainerDied","Data":"2d6225f7fec5ad7c4d8322d1b714b122d7b36e5e5bda57bd5f35b1d0156ffcc0"}
Sep 11 17:59:18.769389 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.769319    2576 scope.go:117] "RemoveContainer" containerID="576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505"
Sep 11 17:59:18.770779 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.770754    2576 generic.go:356] "Generic (PLEG): container finished" podID="c44fb927-dd08-4bc5-9832-64cf8a48be13" containerID="55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6" exitCode=0
Sep 11 17:59:18.770901 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.770810    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"
Sep 11 17:59:18.770901 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.770850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm" event={"ID":"c44fb927-dd08-4bc5-9832-64cf8a48be13","Type":"ContainerDied","Data":"55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6"}
Sep 11 17:59:18.771028 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.770919    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm" event={"ID":"c44fb927-dd08-4bc5-9832-64cf8a48be13","Type":"ContainerDied","Data":"e969bd11517461c153393b903e906f9a420828e03c9fc306c72b7f736491f1cc"}
Sep 11 17:59:18.778495 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.778479    2576 scope.go:117] "RemoveContainer" containerID="576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505"
Sep 11 17:59:18.778768 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:59:18.778748    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505\": container with ID starting with 576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505 not found: ID does not exist" containerID="576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505"
Sep 11 17:59:18.778859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.778773    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505"} err="failed to get container status \"576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505\": rpc error: code = NotFound desc = could not find container \"576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505\": container with ID starting with 576f646d020347f6dbab3f2a485d599cc399ee215cf66ff665bf0182ca492505 not found: ID does not exist"
Sep 11 17:59:18.778859 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.778787    2576 scope.go:117] "RemoveContainer" containerID="55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6"
Sep 11 17:59:18.786203 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.786189    2576 scope.go:117] "RemoveContainer" containerID="55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6"
Sep 11 17:59:18.786465 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:59:18.786447    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6\": container with ID starting with 55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6 not found: ID does not exist" containerID="55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6"
Sep 11 17:59:18.786524 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.786474    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6"} err="failed to get container status \"55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6\": rpc error: code = NotFound desc = could not find container \"55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6\": container with ID starting with 55186398e952bed6f02d1a171fea8016b5d605c8c9183fd5bbc62e7ad82b8ce6 not found: ID does not exist"
Sep 11 17:59:18.801346 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.801325    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"]
Sep 11 17:59:18.807908 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.807886    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh"]
Sep 11 17:59:18.825853 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.825830    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"]
Sep 11 17:59:18.827435 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.827416    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm"]
Sep 11 17:59:18.863862 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:18.863838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:19.265495 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:19.265451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:19.556730 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:19.556697    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:20.119778 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:20.119748    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:20.239587 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:20.239551    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6125d51-30d6-4e8a-99cf-93a248068f7c" path="/var/lib/kubelet/pods/a6125d51-30d6-4e8a-99cf-93a248068f7c/volumes"
Sep 11 17:59:20.240012 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:20.239991    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c44fb927-dd08-4bc5-9832-64cf8a48be13" path="/var/lib/kubelet/pods/c44fb927-dd08-4bc5-9832-64cf8a48be13/volumes"
Sep 11 17:59:21.424729 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:21.424699    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:22.233415 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:22.233385    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:22.406186 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:22.406153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:22.746186 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:22.746152    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:24.173021 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:24.172966    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:24.305645 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:24.305610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:24.752326 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:24.752291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:25.200120 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.200090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:25.421730 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.421668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:25.580759 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.580727    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"]
Sep 11 17:59:25.581119 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.581107    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6125d51-30d6-4e8a-99cf-93a248068f7c" containerName="payload-processing"
Sep 11 17:59:25.581168 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.581121    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6125d51-30d6-4e8a-99cf-93a248068f7c" containerName="payload-processing"
Sep 11 17:59:25.581168 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.581137    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44fb927-dd08-4bc5-9832-64cf8a48be13" containerName="payload-pre-processing"
Sep 11 17:59:25.581168 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.581142    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44fb927-dd08-4bc5-9832-64cf8a48be13" containerName="payload-pre-processing"
Sep 11 17:59:25.581267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.581199    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c44fb927-dd08-4bc5-9832-64cf8a48be13" containerName="payload-pre-processing"
Sep 11 17:59:25.581267 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.581212    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6125d51-30d6-4e8a-99cf-93a248068f7c" containerName="payload-processing"
Sep 11 17:59:25.584171 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.584154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:25.593698 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.593664    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e436a33c\""
Sep 11 17:59:25.593831 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.593803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e436a33c-dockercfg-6lgvd\""
Sep 11 17:59:25.610884 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.610854    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"]
Sep 11 17:59:25.642475 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.642448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/909cb894-c6ac-4e97-8710-513a8f238b2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:25.642592 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.642533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p2fx\" (UniqueName: \"kubernetes.io/projected/909cb894-c6ac-4e97-8710-513a8f238b2e-kube-api-access-2p2fx\") pod \"payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:25.691763 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.691738    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"]
Sep 11 17:59:25.695046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.695025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:25.733159 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.733134    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"]
Sep 11 17:59:25.743392 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.743365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p2fx\" (UniqueName: \"kubernetes.io/projected/909cb894-c6ac-4e97-8710-513a8f238b2e-kube-api-access-2p2fx\") pod \"payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:25.743503 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.743407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/909cb894-c6ac-4e97-8710-513a8f238b2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:25.743503 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.743471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-plugins-config-volume\") pod \"payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") " pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:25.743503 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.743497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8s2f\" (UniqueName: \"kubernetes.io/projected/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-kube-api-access-k8s2f\") pod \"payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") " pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:25.744092 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.744075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/909cb894-c6ac-4e97-8710-513a8f238b2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:25.761810 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.761785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p2fx\" (UniqueName: \"kubernetes.io/projected/909cb894-c6ac-4e97-8710-513a8f238b2e-kube-api-access-2p2fx\") pod \"payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:25.844913 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.844836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-plugins-config-volume\") pod \"payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") " pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:25.844913 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.844873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8s2f\" (UniqueName: \"kubernetes.io/projected/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-kube-api-access-k8s2f\") pod \"payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") " pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:25.845511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.845489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-plugins-config-volume\") pod \"payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") " pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:25.860148 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.860121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8s2f\" (UniqueName: \"kubernetes.io/projected/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-kube-api-access-k8s2f\") pod \"payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") " pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:25.893535 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:25.893509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:26.004931 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.004898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:26.189401 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.189376    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"]
Sep 11 17:59:26.191081 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:59:26.191056    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909cb894_c6ac_4e97_8710_513a8f238b2e.slice/crio-34ecc75927672a451f7e5b3b9666e092c1c58a2e42b7498e623a2f85cf87c0e4 WatchSource:0}: Error finding container 34ecc75927672a451f7e5b3b9666e092c1c58a2e42b7498e623a2f85cf87c0e4: Status 404 returned error can't find the container with id 34ecc75927672a451f7e5b3b9666e092c1c58a2e42b7498e623a2f85cf87c0e4
Sep 11 17:59:26.238528 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.238491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:26.289046 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.289024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"]
Sep 11 17:59:26.291377 ip-10-0-140-186 kubenswrapper[2576]: W0911 17:59:26.291348    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3c5ed5_c3a7_4bd1_b946_e3a70a2f035d.slice/crio-84ea7ad2ee4c778bd4eeb0662840ff94a8a047f803785f2ae3d5096e831e0521 WatchSource:0}: Error finding container 84ea7ad2ee4c778bd4eeb0662840ff94a8a047f803785f2ae3d5096e831e0521: Status 404 returned error can't find the container with id 84ea7ad2ee4c778bd4eeb0662840ff94a8a047f803785f2ae3d5096e831e0521
Sep 11 17:59:26.820192 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.820154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz" event={"ID":"909cb894-c6ac-4e97-8710-513a8f238b2e","Type":"ContainerStarted","Data":"73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067"}
Sep 11 17:59:26.820403 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.820223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz" event={"ID":"909cb894-c6ac-4e97-8710-513a8f238b2e","Type":"ContainerStarted","Data":"34ecc75927672a451f7e5b3b9666e092c1c58a2e42b7498e623a2f85cf87c0e4"}
Sep 11 17:59:26.820403 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.820300    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:26.822198 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.822174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg" event={"ID":"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d","Type":"ContainerStarted","Data":"4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822"}
Sep 11 17:59:26.822385 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.822364    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:26.822535 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.822509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg" event={"ID":"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d","Type":"ContainerStarted","Data":"84ea7ad2ee4c778bd4eeb0662840ff94a8a047f803785f2ae3d5096e831e0521"}
Sep 11 17:59:26.852096 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.852050    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz" podStartSLOduration=1.852032275 podStartE2EDuration="1.852032275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:59:26.850928697 +0000 UTC m=+871.138463002" watchObservedRunningTime="2026-09-11 17:59:26.852032275 +0000 UTC m=+871.139566582"
Sep 11 17:59:26.898228 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:26.898186    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg" podStartSLOduration=1.898172557 podStartE2EDuration="1.898172557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:59:26.897265341 +0000 UTC m=+871.184799646" watchObservedRunningTime="2026-09-11 17:59:26.898172557 +0000 UTC m=+871.185706914"
Sep 11 17:59:27.462025 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:27.461993    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:28.274195 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:28.274163    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:29.103218 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:29.103189    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:33.153893 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:33.153860    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:37.829245 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:37.829214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:37.861845 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:37.861807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:38.834873 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:38.834839    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:47.699633 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:47.699511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:48.589503 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:48.589436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:49.485072 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:49.485041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:50.241363 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:50.241331    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:51.269897 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:51.269869    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:52.302876 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:52.302836    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:53.875831 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:53.875800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:54.016533 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.016500    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:54.612631 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.612599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:54.645543 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.645518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"]
Sep 11 17:59:54.645745 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.645719    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg" podUID="6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" containerName="payload-processing" containerID="cri-o://4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822" gracePeriod=30
Sep 11 17:59:54.654360 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.654339    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"]
Sep 11 17:59:54.654522 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.654504    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz" podUID="909cb894-c6ac-4e97-8710-513a8f238b2e" containerName="payload-pre-processing" containerID="cri-o://73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067" gracePeriod=30
Sep 11 17:59:54.716089 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.716063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:54.796037 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.795976    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:54.899209 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.899179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:54.904977 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.904955    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:54.937387 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.937366    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:54.974237 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.974200    2576 generic.go:356] "Generic (PLEG): container finished" podID="909cb894-c6ac-4e97-8710-513a8f238b2e" containerID="73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067" exitCode=0
Sep 11 17:59:54.974411 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.974255    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"
Sep 11 17:59:54.974411 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.974333    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz" event={"ID":"909cb894-c6ac-4e97-8710-513a8f238b2e","Type":"ContainerDied","Data":"73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067"}
Sep 11 17:59:54.974524 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.974412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz" event={"ID":"909cb894-c6ac-4e97-8710-513a8f238b2e","Type":"ContainerDied","Data":"34ecc75927672a451f7e5b3b9666e092c1c58a2e42b7498e623a2f85cf87c0e4"}
Sep 11 17:59:54.974524 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.974442    2576 scope.go:117] "RemoveContainer" containerID="73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067"
Sep 11 17:59:54.976184 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.976114    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" containerID="4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822" exitCode=0
Sep 11 17:59:54.976349 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.976148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg" event={"ID":"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d","Type":"ContainerDied","Data":"4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822"}
Sep 11 17:59:54.976511 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.976492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg" event={"ID":"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d","Type":"ContainerDied","Data":"84ea7ad2ee4c778bd4eeb0662840ff94a8a047f803785f2ae3d5096e831e0521"}
Sep 11 17:59:54.976664 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.976164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"
Sep 11 17:59:54.985874 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.985856    2576 scope.go:117] "RemoveContainer" containerID="73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067"
Sep 11 17:59:54.986189 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:59:54.986167    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067\": container with ID starting with 73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067 not found: ID does not exist" containerID="73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067"
Sep 11 17:59:54.986377 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.986353    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067"} err="failed to get container status \"73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067\": rpc error: code = NotFound desc = could not find container \"73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067\": container with ID starting with 73d8e0e75a8716d8e17e44aac4f0f3143224be684ee86ef0ce052e69a2080067 not found: ID does not exist"
Sep 11 17:59:54.986478 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.986467    2576 scope.go:117] "RemoveContainer" containerID="4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822"
Sep 11 17:59:54.989505 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.989485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:54.996303 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.996285    2576 scope.go:117] "RemoveContainer" containerID="4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822"
Sep 11 17:59:54.996587 ip-10-0-140-186 kubenswrapper[2576]: E0911 17:59:54.996569    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822\": container with ID starting with 4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822 not found: ID does not exist" containerID="4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822"
Sep 11 17:59:54.996662 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:54.996591    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822"} err="failed to get container status \"4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822\": rpc error: code = NotFound desc = could not find container \"4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822\": container with ID starting with 4aa539ac4435a0a5b5dcb6688ff5d735c79c29d2b7db0e963ea890a911aa0822 not found: ID does not exist"
Sep 11 17:59:55.099336 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.099307    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p2fx\" (UniqueName: \"kubernetes.io/projected/909cb894-c6ac-4e97-8710-513a8f238b2e-kube-api-access-2p2fx\") pod \"909cb894-c6ac-4e97-8710-513a8f238b2e\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") "
Sep 11 17:59:55.099526 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.099398    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-plugins-config-volume\") pod \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") "
Sep 11 17:59:55.099526 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.099440    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/909cb894-c6ac-4e97-8710-513a8f238b2e-plugins-config-volume\") pod \"909cb894-c6ac-4e97-8710-513a8f238b2e\" (UID: \"909cb894-c6ac-4e97-8710-513a8f238b2e\") "
Sep 11 17:59:55.099526 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.099463    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8s2f\" (UniqueName: \"kubernetes.io/projected/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-kube-api-access-k8s2f\") pod \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\" (UID: \"6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d\") "
Sep 11 17:59:55.099825 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.099801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/909cb894-c6ac-4e97-8710-513a8f238b2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "909cb894-c6ac-4e97-8710-513a8f238b2e" (UID: "909cb894-c6ac-4e97-8710-513a8f238b2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:59:55.099825 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.099798    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" (UID: "6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:59:55.101622 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.101593    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-kube-api-access-k8s2f" (OuterVolumeSpecName: "kube-api-access-k8s2f") pod "6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" (UID: "6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d"). InnerVolumeSpecName "kube-api-access-k8s2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:59:55.101740 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.101652    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/909cb894-c6ac-4e97-8710-513a8f238b2e-kube-api-access-2p2fx" (OuterVolumeSpecName: "kube-api-access-2p2fx") pod "909cb894-c6ac-4e97-8710-513a8f238b2e" (UID: "909cb894-c6ac-4e97-8710-513a8f238b2e"). InnerVolumeSpecName "kube-api-access-2p2fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:59:55.200551 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.200471    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/909cb894-c6ac-4e97-8710-513a8f238b2e-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:55.200551 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.200499    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8s2f\" (UniqueName: \"kubernetes.io/projected/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-kube-api-access-k8s2f\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:55.200551 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.200508    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p2fx\" (UniqueName: \"kubernetes.io/projected/909cb894-c6ac-4e97-8710-513a8f238b2e-kube-api-access-2p2fx\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:55.200551 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.200517    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 17:59:55.306555 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.306518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"]
Sep 11 17:59:55.310145 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.310124    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg"]
Sep 11 17:59:55.321356 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.321329    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"]
Sep 11 17:59:55.327784 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.327765    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz"]
Sep 11 17:59:55.389765 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:55.389736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:56.181113 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:56.181076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:56.240423 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:56.240299    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" path="/var/lib/kubelet/pods/6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d/volumes"
Sep 11 17:59:56.240755 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:56.240737    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="909cb894-c6ac-4e97-8710-513a8f238b2e" path="/var/lib/kubelet/pods/909cb894-c6ac-4e97-8710-513a8f238b2e/volumes"
Sep 11 17:59:56.616172 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:56.616134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:56.713982 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:56.713945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:57.159095 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:57.159057    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:57.531283 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:57.531207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:57.623951 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:57.623920    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:58.727268 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:58.727230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:59.414652 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:59.414614    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:59.570001 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:59.569971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 17:59:59.832917 ip-10-0-140-186 kubenswrapper[2576]: I0911 17:59:59.832886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:00.253855 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.253772    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"]
Sep 11 18:00:00.254132 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.254120    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="909cb894-c6ac-4e97-8710-513a8f238b2e" containerName="payload-pre-processing"
Sep 11 18:00:00.254174 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.254133    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="909cb894-c6ac-4e97-8710-513a8f238b2e" containerName="payload-pre-processing"
Sep 11 18:00:00.254174 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.254157    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" containerName="payload-processing"
Sep 11 18:00:00.254174 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.254163    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" containerName="payload-processing"
Sep 11 18:00:00.254268 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.254211    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="909cb894-c6ac-4e97-8710-513a8f238b2e" containerName="payload-pre-processing"
Sep 11 18:00:00.254268 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.254222    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3c5ed5-c3a7-4bd1-b946-e3a70a2f035d" containerName="payload-processing"
Sep 11 18:00:00.258627 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.258608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"
Sep 11 18:00:00.263688 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:00:00.263650    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="ace779d1-e36b-4005-b27c-807bacdd8f58" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"
Sep 11 18:00:00.263823 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:00:00.263719    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-cleanup-dockercfg-4wxpj\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\"" type="*v1.Secret"
Sep 11 18:00:00.298241 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:00.298209    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"]
Sep 11 18:00:01.007240 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:01.007206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:01.269541 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:01.269440    2576 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Sep 11 18:00:01.269541 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:01.269509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"
Sep 11 18:00:01.556096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:01.556069    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"]
Sep 11 18:00:01.558526 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:00:01.558496    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace779d1_e36b_4005_b27c_807bacdd8f58.slice/crio-bca5600242aa0fd3cd18c73b54397c574434221395f1923005e3baabc1797a17 WatchSource:0}: Error finding container bca5600242aa0fd3cd18c73b54397c574434221395f1923005e3baabc1797a17: Status 404 returned error can't find the container with id bca5600242aa0fd3cd18c73b54397c574434221395f1923005e3baabc1797a17
Sep 11 18:00:01.843316 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:01.843230    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:00:02.012869 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:02.012834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb" event={"ID":"ace779d1-e36b-4005-b27c-807bacdd8f58","Type":"ContainerStarted","Data":"bca5600242aa0fd3cd18c73b54397c574434221395f1923005e3baabc1797a17"}
Sep 11 18:00:02.191429 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:02.191351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:03.503666 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:03.503596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:04.114190 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:04.114142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:04.212829 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:04.212776    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:04.491274 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:04.491230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:04.587346 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:04.587291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:04.838284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:04.838222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:05.000430 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.000398    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:05.024477 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.024448    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"]
Sep 11 18:00:05.028600 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.028578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.029518 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.029493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb" event={"ID":"ace779d1-e36b-4005-b27c-807bacdd8f58","Type":"ContainerStarted","Data":"4c3ed66cca80dce85383b57b8b1431bed061a227dc48b866810c706a1a15dc15"}
Sep 11 18:00:05.033433 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.033389    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c83b88f4-dockercfg-2528x\""
Sep 11 18:00:05.033504 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.033437    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c83b88f4\""
Sep 11 18:00:05.042154 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.042132    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"]
Sep 11 18:00:05.083590 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.083562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j55t\" (UniqueName: \"kubernetes.io/projected/1f2444ef-af52-4445-a312-7f49712acc8b-kube-api-access-9j55t\") pod \"payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.083776 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.083616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2444ef-af52-4445-a312-7f49712acc8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.096508 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.096451    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb" podStartSLOduration=2.209386981 podStartE2EDuration="5.096432447s" totalImagesPullingTime="2.887045466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:00:05.095141925 +0000 UTC m=+909.382676231" watchObservedRunningTime="2026-09-11 18:00:05.096432447 +0000 UTC m=+909.383966755"
Sep 11 18:00:05.184496 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.184457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2444ef-af52-4445-a312-7f49712acc8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.184696 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.184535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j55t\" (UniqueName: \"kubernetes.io/projected/1f2444ef-af52-4445-a312-7f49712acc8b-kube-api-access-9j55t\") pod \"payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.185414 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.185388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2444ef-af52-4445-a312-7f49712acc8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.202808 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.202786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j55t\" (UniqueName: \"kubernetes.io/projected/1f2444ef-af52-4445-a312-7f49712acc8b-kube-api-access-9j55t\") pod \"payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.339107 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.339075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:05.622261 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:05.621929    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"]
Sep 11 18:00:05.631747 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:00:05.631721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2444ef_af52_4445_a312_7f49712acc8b.slice/crio-f37017e7557e1d2009ec9b8f9d3e7b07ab97eaece7aa99fa372f80ce72a7f22d WatchSource:0}: Error finding container f37017e7557e1d2009ec9b8f9d3e7b07ab97eaece7aa99fa372f80ce72a7f22d: Status 404 returned error can't find the container with id f37017e7557e1d2009ec9b8f9d3e7b07ab97eaece7aa99fa372f80ce72a7f22d
Sep 11 18:00:06.035879 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:06.035790    2576 generic.go:356] "Generic (PLEG): container finished" podID="ace779d1-e36b-4005-b27c-807bacdd8f58" containerID="4c3ed66cca80dce85383b57b8b1431bed061a227dc48b866810c706a1a15dc15" exitCode=0
Sep 11 18:00:06.035879 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:06.035870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb" event={"ID":"ace779d1-e36b-4005-b27c-807bacdd8f58","Type":"ContainerDied","Data":"4c3ed66cca80dce85383b57b8b1431bed061a227dc48b866810c706a1a15dc15"}
Sep 11 18:00:06.037283 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:06.037253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc" event={"ID":"1f2444ef-af52-4445-a312-7f49712acc8b","Type":"ContainerStarted","Data":"38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab"}
Sep 11 18:00:06.037393 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:06.037295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc" event={"ID":"1f2444ef-af52-4445-a312-7f49712acc8b","Type":"ContainerStarted","Data":"f37017e7557e1d2009ec9b8f9d3e7b07ab97eaece7aa99fa372f80ce72a7f22d"}
Sep 11 18:00:06.037393 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:06.037315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:07.172686 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:07.172640    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"
Sep 11 18:00:07.202932 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:07.202884    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc" podStartSLOduration=3.202866092 podStartE2EDuration="3.202866092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:00:06.07914847 +0000 UTC m=+910.366682776" watchObservedRunningTime="2026-09-11 18:00:07.202866092 +0000 UTC m=+911.490400398"
Sep 11 18:00:08.047546 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:08.047510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb" event={"ID":"ace779d1-e36b-4005-b27c-807bacdd8f58","Type":"ContainerDied","Data":"bca5600242aa0fd3cd18c73b54397c574434221395f1923005e3baabc1797a17"}
Sep 11 18:00:08.047546 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:08.047539    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"
Sep 11 18:00:08.047799 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:08.047563    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bca5600242aa0fd3cd18c73b54397c574434221395f1923005e3baabc1797a17"
Sep 11 18:00:09.777100 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:09.777063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:10.872151 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:10.872116    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:11.798580 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:11.798541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:12.834132 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:12.828634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:13.829155 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:13.829120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:15.012057 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:15.012010    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:17.044612 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:17.044582    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:20.048521 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.048486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:20.097695 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.097645    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"]
Sep 11 18:00:20.098190 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.098162    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg" podUID="97f0fc02-c83d-42bf-8b14-543138884033" containerName="payload-processing" containerID="cri-o://e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645" gracePeriod=30
Sep 11 18:00:20.112370 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.112344    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"]
Sep 11 18:00:20.112538 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.112520    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg" podUID="70af7f24-e912-4047-94b9-22d274e45769" containerName="payload-pre-processing" containerID="cri-o://8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47" gracePeriod=30
Sep 11 18:00:20.153560 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.153531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:20.265613 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.265582    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:20.395702 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.395662    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 18:00:20.398351 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.398330    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 18:00:20.411824 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.411766    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:20.524522 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.524492    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af7f24-e912-4047-94b9-22d274e45769-plugins-config-volume\") pod \"70af7f24-e912-4047-94b9-22d274e45769\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") "
Sep 11 18:00:20.524716 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.524561    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h9xc\" (UniqueName: \"kubernetes.io/projected/70af7f24-e912-4047-94b9-22d274e45769-kube-api-access-7h9xc\") pod \"70af7f24-e912-4047-94b9-22d274e45769\" (UID: \"70af7f24-e912-4047-94b9-22d274e45769\") "
Sep 11 18:00:20.524716 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.524631    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f0fc02-c83d-42bf-8b14-543138884033-plugins-config-volume\") pod \"97f0fc02-c83d-42bf-8b14-543138884033\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") "
Sep 11 18:00:20.524716 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.524655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-926jr\" (UniqueName: \"kubernetes.io/projected/97f0fc02-c83d-42bf-8b14-543138884033-kube-api-access-926jr\") pod \"97f0fc02-c83d-42bf-8b14-543138884033\" (UID: \"97f0fc02-c83d-42bf-8b14-543138884033\") "
Sep 11 18:00:20.525004 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.524918    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70af7f24-e912-4047-94b9-22d274e45769-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "70af7f24-e912-4047-94b9-22d274e45769" (UID: "70af7f24-e912-4047-94b9-22d274e45769"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:20.525106 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.525024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97f0fc02-c83d-42bf-8b14-543138884033-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97f0fc02-c83d-42bf-8b14-543138884033" (UID: "97f0fc02-c83d-42bf-8b14-543138884033"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:20.526828 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.526806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70af7f24-e912-4047-94b9-22d274e45769-kube-api-access-7h9xc" (OuterVolumeSpecName: "kube-api-access-7h9xc") pod "70af7f24-e912-4047-94b9-22d274e45769" (UID: "70af7f24-e912-4047-94b9-22d274e45769"). InnerVolumeSpecName "kube-api-access-7h9xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:20.526914 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.526838    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97f0fc02-c83d-42bf-8b14-543138884033-kube-api-access-926jr" (OuterVolumeSpecName: "kube-api-access-926jr") pod "97f0fc02-c83d-42bf-8b14-543138884033" (UID: "97f0fc02-c83d-42bf-8b14-543138884033"). InnerVolumeSpecName "kube-api-access-926jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:20.569828 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.569670    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:20.625692 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.625642    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f0fc02-c83d-42bf-8b14-543138884033-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:00:20.625692 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.625668    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-926jr\" (UniqueName: \"kubernetes.io/projected/97f0fc02-c83d-42bf-8b14-543138884033-kube-api-access-926jr\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:00:20.625692 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.625693    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af7f24-e912-4047-94b9-22d274e45769-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:00:20.625911 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.625702    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h9xc\" (UniqueName: \"kubernetes.io/projected/70af7f24-e912-4047-94b9-22d274e45769-kube-api-access-7h9xc\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:00:20.908891 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:20.908807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:21.010904 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.010865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:21.112009 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.111979    2576 generic.go:356] "Generic (PLEG): container finished" podID="97f0fc02-c83d-42bf-8b14-543138884033" containerID="e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645" exitCode=0
Sep 11 18:00:21.112434 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.112030    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"
Sep 11 18:00:21.112434 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.112072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg" event={"ID":"97f0fc02-c83d-42bf-8b14-543138884033","Type":"ContainerDied","Data":"e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645"}
Sep 11 18:00:21.112434 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.112119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg" event={"ID":"97f0fc02-c83d-42bf-8b14-543138884033","Type":"ContainerDied","Data":"d07e860b69872f382f412f437f753220bed8fe0800e2fa31e617c857e31e2b32"}
Sep 11 18:00:21.112434 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.112152    2576 scope.go:117] "RemoveContainer" containerID="e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645"
Sep 11 18:00:21.113563 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.113540    2576 generic.go:356] "Generic (PLEG): container finished" podID="70af7f24-e912-4047-94b9-22d274e45769" containerID="8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47" exitCode=0
Sep 11 18:00:21.113654 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.113588    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"
Sep 11 18:00:21.113778 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.113754    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg" event={"ID":"70af7f24-e912-4047-94b9-22d274e45769","Type":"ContainerDied","Data":"8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47"}
Sep 11 18:00:21.113863 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.113810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg" event={"ID":"70af7f24-e912-4047-94b9-22d274e45769","Type":"ContainerDied","Data":"af0f6d7f1d142ab666b4eb9e9e8ba1f8ee6d5f6a337c0a48e2e06f368c0f03c3"}
Sep 11 18:00:21.120648 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.120629    2576 scope.go:117] "RemoveContainer" containerID="e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645"
Sep 11 18:00:21.120987 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:00:21.120966    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645\": container with ID starting with e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645 not found: ID does not exist" containerID="e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645"
Sep 11 18:00:21.121077 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.120999    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645"} err="failed to get container status \"e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645\": rpc error: code = NotFound desc = could not find container \"e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645\": container with ID starting with e30d4e61f386c004736c69040bc11bab0e793a5782a8ec944a7b8f7114642645 not found: ID does not exist"
Sep 11 18:00:21.121077 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.121020    2576 scope.go:117] "RemoveContainer" containerID="8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47"
Sep 11 18:00:21.129420 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.129405    2576 scope.go:117] "RemoveContainer" containerID="8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47"
Sep 11 18:00:21.129663 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:00:21.129646    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47\": container with ID starting with 8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47 not found: ID does not exist" containerID="8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47"
Sep 11 18:00:21.129767 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.129671    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47"} err="failed to get container status \"8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47\": rpc error: code = NotFound desc = could not find container \"8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47\": container with ID starting with 8221731b63e610ba78f2c09248ba705ce92d506fbb101d0cf11194b891b55a47 not found: ID does not exist"
Sep 11 18:00:21.140991 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.140970    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"]
Sep 11 18:00:21.149378 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.149358    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg"]
Sep 11 18:00:21.161881 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.161834    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"]
Sep 11 18:00:21.164340 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.164320    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg"]
Sep 11 18:00:21.958916 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:21.958880    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:22.239737 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:22.239648    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70af7f24-e912-4047-94b9-22d274e45769" path="/var/lib/kubelet/pods/70af7f24-e912-4047-94b9-22d274e45769/volumes"
Sep 11 18:00:22.240082 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:22.240021    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97f0fc02-c83d-42bf-8b14-543138884033" path="/var/lib/kubelet/pods/97f0fc02-c83d-42bf-8b14-543138884033/volumes"
Sep 11 18:00:23.011671 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:23.011632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:23.861526 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:23.861494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:24.956926 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:24.956895    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:25.833229 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:25.833184    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:26.084492 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:26.084414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:27.070941 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:27.070901    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:28.065126 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:28.065085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:29.097439 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:29.097408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:31.289893 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.289855    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:31.317153 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.317122    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"]
Sep 11 18:00:31.317578 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.317531    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc" podUID="1f2444ef-af52-4445-a312-7f49712acc8b" containerName="payload-pre-processing" containerID="cri-o://38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab" gracePeriod=30
Sep 11 18:00:31.368813 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.368769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:31.486220 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.486181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:31.579711 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.579665    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:31.586490 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.586471    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:31.692786 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.692750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:31.730109 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.730079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j55t\" (UniqueName: \"kubernetes.io/projected/1f2444ef-af52-4445-a312-7f49712acc8b-kube-api-access-9j55t\") pod \"1f2444ef-af52-4445-a312-7f49712acc8b\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") "
Sep 11 18:00:31.730264 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.730121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2444ef-af52-4445-a312-7f49712acc8b-plugins-config-volume\") pod \"1f2444ef-af52-4445-a312-7f49712acc8b\" (UID: \"1f2444ef-af52-4445-a312-7f49712acc8b\") "
Sep 11 18:00:31.730533 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.730509    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f2444ef-af52-4445-a312-7f49712acc8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f2444ef-af52-4445-a312-7f49712acc8b" (UID: "1f2444ef-af52-4445-a312-7f49712acc8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:00:31.732299 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.732279    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2444ef-af52-4445-a312-7f49712acc8b-kube-api-access-9j55t" (OuterVolumeSpecName: "kube-api-access-9j55t") pod "1f2444ef-af52-4445-a312-7f49712acc8b" (UID: "1f2444ef-af52-4445-a312-7f49712acc8b"). InnerVolumeSpecName "kube-api-access-9j55t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:00:31.831750 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.831640    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j55t\" (UniqueName: \"kubernetes.io/projected/1f2444ef-af52-4445-a312-7f49712acc8b-kube-api-access-9j55t\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:00:31.831750 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:31.831668    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2444ef-af52-4445-a312-7f49712acc8b-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:00:32.170134 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.170037    2576 generic.go:356] "Generic (PLEG): container finished" podID="1f2444ef-af52-4445-a312-7f49712acc8b" containerID="38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab" exitCode=0
Sep 11 18:00:32.170134 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.170084    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc" event={"ID":"1f2444ef-af52-4445-a312-7f49712acc8b","Type":"ContainerDied","Data":"38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab"}
Sep 11 18:00:32.170134 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.170103    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"
Sep 11 18:00:32.170408 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.170148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc" event={"ID":"1f2444ef-af52-4445-a312-7f49712acc8b","Type":"ContainerDied","Data":"f37017e7557e1d2009ec9b8f9d3e7b07ab97eaece7aa99fa372f80ce72a7f22d"}
Sep 11 18:00:32.170408 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.170179    2576 scope.go:117] "RemoveContainer" containerID="38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab"
Sep 11 18:00:32.179523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.179495    2576 scope.go:117] "RemoveContainer" containerID="38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab"
Sep 11 18:00:32.179771 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:00:32.179752    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab\": container with ID starting with 38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab not found: ID does not exist" containerID="38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab"
Sep 11 18:00:32.179832 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.179778    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab"} err="failed to get container status \"38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab\": rpc error: code = NotFound desc = could not find container \"38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab\": container with ID starting with 38fb0532723c241ec86dd83e53de15907f9d7cffee23a763e3bb0ae1de91abab not found: ID does not exist"
Sep 11 18:00:32.196518 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.196494    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"]
Sep 11 18:00:32.200421 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.200402    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc"]
Sep 11 18:00:32.242827 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.240384    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f2444ef-af52-4445-a312-7f49712acc8b" path="/var/lib/kubelet/pods/1f2444ef-af52-4445-a312-7f49712acc8b/volumes"
Sep 11 18:00:32.490599 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.490502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:32.592161 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:32.592120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:33.110144 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:33.110110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:34.150288 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:34.150252    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:34.315272 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:34.315238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:40.609847 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:40.609810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:40.711709 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:40.711662    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:41.456239 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:41.456206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:48.119166 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:48.119130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:57.235063 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:57.235021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:00:59.745859 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:00:59.745824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:03.668965 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:03.668912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:03.930459 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:03.930349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:04.530064 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:04.530017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:04.822518 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:04.822484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:04.992983 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:04.992950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:06.780653 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:06.780611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:07.151767 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:07.151731    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:07.527450 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:07.527379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:07.635481 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:07.635439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:07.734800 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:07.734763    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:09.045071 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.045035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:09.858513 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858484    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"]
Sep 11 18:01:09.858856 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858844    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2444ef-af52-4445-a312-7f49712acc8b" containerName="payload-pre-processing"
Sep 11 18:01:09.858917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858858    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2444ef-af52-4445-a312-7f49712acc8b" containerName="payload-pre-processing"
Sep 11 18:01:09.858917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858867    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ace779d1-e36b-4005-b27c-807bacdd8f58" containerName="cleanup"
Sep 11 18:01:09.858917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858873    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ace779d1-e36b-4005-b27c-807bacdd8f58" containerName="cleanup"
Sep 11 18:01:09.858917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858880    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f0fc02-c83d-42bf-8b14-543138884033" containerName="payload-processing"
Sep 11 18:01:09.858917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858886    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f0fc02-c83d-42bf-8b14-543138884033" containerName="payload-processing"
Sep 11 18:01:09.858917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858897    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70af7f24-e912-4047-94b9-22d274e45769" containerName="payload-pre-processing"
Sep 11 18:01:09.858917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858902    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70af7f24-e912-4047-94b9-22d274e45769" containerName="payload-pre-processing"
Sep 11 18:01:09.859123 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858959    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ace779d1-e36b-4005-b27c-807bacdd8f58" containerName="cleanup"
Sep 11 18:01:09.859123 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858970    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="70af7f24-e912-4047-94b9-22d274e45769" containerName="payload-pre-processing"
Sep 11 18:01:09.859123 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858976    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2444ef-af52-4445-a312-7f49712acc8b" containerName="payload-pre-processing"
Sep 11 18:01:09.859123 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.858981    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="97f0fc02-c83d-42bf-8b14-543138884033" containerName="payload-processing"
Sep 11 18:01:09.863258 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.863235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:09.866122 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.866102    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-c69872-serving-cert\""
Sep 11 18:01:09.887800 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.887773    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"]
Sep 11 18:01:09.917251 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.917219    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:09.925341 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.925312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6chm\" (UniqueName: \"kubernetes.io/projected/672390f5-fdba-4fed-a358-fdcb3671cd60-kube-api-access-h6chm\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:09.925477 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.925353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-metrics-certs\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:09.925477 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.925377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672390f5-fdba-4fed-a358-fdcb3671cd60-openshift-service-ca\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:09.925477 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:09.925423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.025821 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.025783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-metrics-certs\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.026035 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.025832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672390f5-fdba-4fed-a358-fdcb3671cd60-openshift-service-ca\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.026035 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.025859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.026035 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.025897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6chm\" (UniqueName: \"kubernetes.io/projected/672390f5-fdba-4fed-a358-fdcb3671cd60-kube-api-access-h6chm\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.026035 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.025965    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:10.026035 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:01:10.026005    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-serving-cert: secret "maas-api-e2e-explicit-c69872-serving-cert" not found
Sep 11 18:01:10.026326 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:01:10.026082    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls podName:672390f5-fdba-4fed-a358-fdcb3671cd60 nodeName:}" failed. No retries permitted until 2026-09-11 18:01:10.526059867 +0000 UTC m=+974.813594166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls") pod "maas-api-e2e-explicit-c69872-84d97688f6-9xmqw" (UID: "672390f5-fdba-4fed-a358-fdcb3671cd60") : secret "maas-api-e2e-explicit-c69872-serving-cert" not found
Sep 11 18:01:10.026858 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.026835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672390f5-fdba-4fed-a358-fdcb3671cd60-openshift-service-ca\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.028430 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.028413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-metrics-certs\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.044277 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.044258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6chm\" (UniqueName: \"kubernetes.io/projected/672390f5-fdba-4fed-a358-fdcb3671cd60-kube-api-access-h6chm\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.164718 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.164581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:10.531372 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.531288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.533835 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.533812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls\") pod \"maas-api-e2e-explicit-c69872-84d97688f6-9xmqw\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.774114 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.774073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:10.795334 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.795258    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:10.842984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.841420    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"]
Sep 11 18:01:10.845522 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.845503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:10.849289 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.849248    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c69872-dockercfg-qh5t7\""
Sep 11 18:01:10.851084 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.850893    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c69872\""
Sep 11 18:01:10.870703 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.870650    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"]
Sep 11 18:01:10.934958 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.934926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/913840db-561c-4a26-b32d-85bf78f16a9f-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") " pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:10.935113 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:10.934989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz48h\" (UniqueName: \"kubernetes.io/projected/913840db-561c-4a26-b32d-85bf78f16a9f-kube-api-access-wz48h\") pod \"payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") " pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:11.036416 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.036338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz48h\" (UniqueName: \"kubernetes.io/projected/913840db-561c-4a26-b32d-85bf78f16a9f-kube-api-access-wz48h\") pod \"payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") " pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:11.036573 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.036431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/913840db-561c-4a26-b32d-85bf78f16a9f-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") " pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:11.037107 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.037087    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/913840db-561c-4a26-b32d-85bf78f16a9f-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") " pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:11.046775 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.046751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz48h\" (UniqueName: \"kubernetes.io/projected/913840db-561c-4a26-b32d-85bf78f16a9f-kube-api-access-wz48h\") pod \"payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") " pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:11.055607 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.055584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"]
Sep 11 18:01:11.057447 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:01:11.057422    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672390f5_fdba_4fed_a358_fdcb3671cd60.slice/crio-8cab07dee1b4d56c9a9a771cb992f44ffccc137cd8c20bf15697d6065c273738 WatchSource:0}: Error finding container 8cab07dee1b4d56c9a9a771cb992f44ffccc137cd8c20bf15697d6065c273738: Status 404 returned error can't find the container with id 8cab07dee1b4d56c9a9a771cb992f44ffccc137cd8c20bf15697d6065c273738
Sep 11 18:01:11.058928 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.058908    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:01:11.157451 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.157418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:11.170099 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.170070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:11.350092 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.350057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw" event={"ID":"672390f5-fdba-4fed-a358-fdcb3671cd60","Type":"ContainerStarted","Data":"8cab07dee1b4d56c9a9a771cb992f44ffccc137cd8c20bf15697d6065c273738"}
Sep 11 18:01:11.474057 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:11.474021    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"]
Sep 11 18:01:11.476825 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:01:11.476790    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913840db_561c_4a26_b32d_85bf78f16a9f.slice/crio-13a7840d28dfc90e4ab8ca273c94f0ddf7e372aee59d43e2d4e8d9a33ab8cf0b WatchSource:0}: Error finding container 13a7840d28dfc90e4ab8ca273c94f0ddf7e372aee59d43e2d4e8d9a33ab8cf0b: Status 404 returned error can't find the container with id 13a7840d28dfc90e4ab8ca273c94f0ddf7e372aee59d43e2d4e8d9a33ab8cf0b
Sep 11 18:01:12.362962 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:12.362910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw" event={"ID":"672390f5-fdba-4fed-a358-fdcb3671cd60","Type":"ContainerStarted","Data":"bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec"}
Sep 11 18:01:12.363406 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:12.363018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:12.364460 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:12.364430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv" event={"ID":"913840db-561c-4a26-b32d-85bf78f16a9f","Type":"ContainerStarted","Data":"00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d"}
Sep 11 18:01:12.364587 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:12.364474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv" event={"ID":"913840db-561c-4a26-b32d-85bf78f16a9f","Type":"ContainerStarted","Data":"13a7840d28dfc90e4ab8ca273c94f0ddf7e372aee59d43e2d4e8d9a33ab8cf0b"}
Sep 11 18:01:12.364587 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:12.364515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:12.391286 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:12.391231    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw" podStartSLOduration=2.908135288 podStartE2EDuration="3.391217385s" totalImagesPullingTime="483.082097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:01:12.39053679 +0000 UTC m=+976.678071097" watchObservedRunningTime="2026-09-11 18:01:12.391217385 +0000 UTC m=+976.678751690"
Sep 11 18:01:12.410662 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:12.410625    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv" podStartSLOduration=2.41061592 podStartE2EDuration="2.41061592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:01:12.410313506 +0000 UTC m=+976.697847815" watchObservedRunningTime="2026-09-11 18:01:12.41061592 +0000 UTC m=+976.698150226"
Sep 11 18:01:13.510351 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:13.510315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:13.645239 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:13.645202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:13.765959 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:13.765852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:16.950888 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:16.950785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:18.375794 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:18.375764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:01:23.373114 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:23.373074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:01:26.550384 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:26.550349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:28.306838 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:28.306801    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:29.700733 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:29.700667    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:34.219813 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:34.219779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:34.313901 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:34.313868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:35.052001 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:35.051952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:35.949854 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:35.949820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:36.876139 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:36.876091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:37.443747 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:37.443670    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:37.613313 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:37.613271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:37.772125 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:37.772028    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:48.163256 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:48.163221    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:49.033276 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:49.033227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:55.515153 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:55.515120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:55.710260 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:55.710211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:55.844035 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:55.844007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:56.705135 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:56.705102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:56.830762 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:56.830728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:01:58.536522 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:01:58.536487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:03.585172 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:03.585134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:06.360545 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:06.360497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:07.292435 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:07.292396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:07.904903 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:07.904869    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:08.010388 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:08.010345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:08.381116 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:08.381080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:09.528794 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:09.528758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:10.633375 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:10.633340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:15.161655 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:15.161619    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:15.260721 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:15.260665    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:17.754534 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:17.754494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:18.005294 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:18.005206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:18.115368 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:18.115334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:19.019614 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:19.019580    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:20.037414 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.037376    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:20.725094 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.725060    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"]
Sep 11 18:02:20.725297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.725277    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw" podUID="672390f5-fdba-4fed-a358-fdcb3671cd60" containerName="maas-api" containerID="cri-o://bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec" gracePeriod=30
Sep 11 18:02:20.779379 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.779348    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:20.827214 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.827179    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"]
Sep 11 18:02:20.827398 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.827373    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv" podUID="913840db-561c-4a26-b32d-85bf78f16a9f" containerName="payload-processing" containerID="cri-o://00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d" gracePeriod=30
Sep 11 18:02:20.894013 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.893983    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:20.988038 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:20.987980    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:21.002570 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.002546    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:02:21.030890 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.030862    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls\") pod \"672390f5-fdba-4fed-a358-fdcb3671cd60\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") "
Sep 11 18:02:21.031096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.030934    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6chm\" (UniqueName: \"kubernetes.io/projected/672390f5-fdba-4fed-a358-fdcb3671cd60-kube-api-access-h6chm\") pod \"672390f5-fdba-4fed-a358-fdcb3671cd60\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") "
Sep 11 18:02:21.031096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.031036    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-metrics-certs\") pod \"672390f5-fdba-4fed-a358-fdcb3671cd60\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") "
Sep 11 18:02:21.031255 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.031110    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672390f5-fdba-4fed-a358-fdcb3671cd60-openshift-service-ca\") pod \"672390f5-fdba-4fed-a358-fdcb3671cd60\" (UID: \"672390f5-fdba-4fed-a358-fdcb3671cd60\") "
Sep 11 18:02:21.031975 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.031891    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672390f5-fdba-4fed-a358-fdcb3671cd60-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "672390f5-fdba-4fed-a358-fdcb3671cd60" (UID: "672390f5-fdba-4fed-a358-fdcb3671cd60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:02:21.032239 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.032195    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672390f5-fdba-4fed-a358-fdcb3671cd60-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.035503 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.035473    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "672390f5-fdba-4fed-a358-fdcb3671cd60" (UID: "672390f5-fdba-4fed-a358-fdcb3671cd60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:02:21.035606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.035556    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "672390f5-fdba-4fed-a358-fdcb3671cd60" (UID: "672390f5-fdba-4fed-a358-fdcb3671cd60"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:02:21.035769 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.035744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672390f5-fdba-4fed-a358-fdcb3671cd60-kube-api-access-h6chm" (OuterVolumeSpecName: "kube-api-access-h6chm") pod "672390f5-fdba-4fed-a358-fdcb3671cd60" (UID: "672390f5-fdba-4fed-a358-fdcb3671cd60"). InnerVolumeSpecName "kube-api-access-h6chm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:02:21.087911 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.087872    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:21.101174 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.101150    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:02:21.132719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.132669    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/913840db-561c-4a26-b32d-85bf78f16a9f-plugins-config-volume\") pod \"913840db-561c-4a26-b32d-85bf78f16a9f\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") "
Sep 11 18:02:21.132904 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.132769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz48h\" (UniqueName: \"kubernetes.io/projected/913840db-561c-4a26-b32d-85bf78f16a9f-kube-api-access-wz48h\") pod \"913840db-561c-4a26-b32d-85bf78f16a9f\" (UID: \"913840db-561c-4a26-b32d-85bf78f16a9f\") "
Sep 11 18:02:21.133022 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.133005    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6chm\" (UniqueName: \"kubernetes.io/projected/672390f5-fdba-4fed-a358-fdcb3671cd60-kube-api-access-h6chm\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.133096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.133014    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913840db-561c-4a26-b32d-85bf78f16a9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "913840db-561c-4a26-b32d-85bf78f16a9f" (UID: "913840db-561c-4a26-b32d-85bf78f16a9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:02:21.133096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.133026    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.133096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.133072    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672390f5-fdba-4fed-a358-fdcb3671cd60-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.134992 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.134966    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/913840db-561c-4a26-b32d-85bf78f16a9f-kube-api-access-wz48h" (OuterVolumeSpecName: "kube-api-access-wz48h") pod "913840db-561c-4a26-b32d-85bf78f16a9f" (UID: "913840db-561c-4a26-b32d-85bf78f16a9f"). InnerVolumeSpecName "kube-api-access-wz48h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:02:21.234226 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.234142    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz48h\" (UniqueName: \"kubernetes.io/projected/913840db-561c-4a26-b32d-85bf78f16a9f-kube-api-access-wz48h\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.234226 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.234171    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/913840db-561c-4a26-b32d-85bf78f16a9f-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:02:21.268861 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.268810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:21.270363 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.270330    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"]
Sep 11 18:02:21.270911 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.270889    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913840db-561c-4a26-b32d-85bf78f16a9f" containerName="payload-processing"
Sep 11 18:02:21.270999 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.270915    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="913840db-561c-4a26-b32d-85bf78f16a9f" containerName="payload-processing"
Sep 11 18:02:21.270999 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.270957    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672390f5-fdba-4fed-a358-fdcb3671cd60" containerName="maas-api"
Sep 11 18:02:21.270999 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.270965    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="672390f5-fdba-4fed-a358-fdcb3671cd60" containerName="maas-api"
Sep 11 18:02:21.271153 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.271051    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="672390f5-fdba-4fed-a358-fdcb3671cd60" containerName="maas-api"
Sep 11 18:02:21.271153 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.271068    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="913840db-561c-4a26-b32d-85bf78f16a9f" containerName="payload-processing"
Sep 11 18:02:21.274467 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.274442    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.277394 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.277377    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-045ac32d-serving-cert\""
Sep 11 18:02:21.294830 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.294802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"]
Sep 11 18:02:21.334815 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.334774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.334815 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.334812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjmx\" (UniqueName: \"kubernetes.io/projected/31e45d2b-e778-4adc-b31f-63b4a197d99c-kube-api-access-tmjmx\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.335054 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.334847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-metrics-certs\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.335054 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.334875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e45d2b-e778-4adc-b31f-63b4a197d99c-openshift-service-ca\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.400421 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.400386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:21.436335 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.436296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.436335 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.436333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjmx\" (UniqueName: \"kubernetes.io/projected/31e45d2b-e778-4adc-b31f-63b4a197d99c-kube-api-access-tmjmx\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.436577 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.436362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-metrics-certs\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.436577 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.436395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e45d2b-e778-4adc-b31f-63b4a197d99c-openshift-service-ca\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.436577 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:21.436446    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-serving-cert: secret "maas-api-e2e-mt-045ac32d-serving-cert" not found
Sep 11 18:02:21.436577 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:21.436521    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls podName:31e45d2b-e778-4adc-b31f-63b4a197d99c nodeName:}" failed. No retries permitted until 2026-09-11 18:02:21.936503081 +0000 UTC m=+1046.224037380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls") pod "maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk" (UID: "31e45d2b-e778-4adc-b31f-63b4a197d99c") : secret "maas-api-e2e-mt-045ac32d-serving-cert" not found
Sep 11 18:02:21.437067 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.437048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e45d2b-e778-4adc-b31f-63b4a197d99c-openshift-service-ca\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.438995 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.438973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-metrics-certs\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.451847 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.451826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjmx\" (UniqueName: \"kubernetes.io/projected/31e45d2b-e778-4adc-b31f-63b4a197d99c-kube-api-access-tmjmx\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.679464 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.679415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:21.713139 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.713107    2576 generic.go:356] "Generic (PLEG): container finished" podID="913840db-561c-4a26-b32d-85bf78f16a9f" containerID="00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d" exitCode=0
Sep 11 18:02:21.713299 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.713165    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"
Sep 11 18:02:21.713299 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.713183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv" event={"ID":"913840db-561c-4a26-b32d-85bf78f16a9f","Type":"ContainerDied","Data":"00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d"}
Sep 11 18:02:21.713299 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.713265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv" event={"ID":"913840db-561c-4a26-b32d-85bf78f16a9f","Type":"ContainerDied","Data":"13a7840d28dfc90e4ab8ca273c94f0ddf7e372aee59d43e2d4e8d9a33ab8cf0b"}
Sep 11 18:02:21.713299 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.713289    2576 scope.go:117] "RemoveContainer" containerID="00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d"
Sep 11 18:02:21.714962 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.714935    2576 generic.go:356] "Generic (PLEG): container finished" podID="672390f5-fdba-4fed-a358-fdcb3671cd60" containerID="bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec" exitCode=0
Sep 11 18:02:21.715074 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.714981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw" event={"ID":"672390f5-fdba-4fed-a358-fdcb3671cd60","Type":"ContainerDied","Data":"bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec"}
Sep 11 18:02:21.715074 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.714988    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"
Sep 11 18:02:21.715074 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.715021    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw" event={"ID":"672390f5-fdba-4fed-a358-fdcb3671cd60","Type":"ContainerDied","Data":"8cab07dee1b4d56c9a9a771cb992f44ffccc137cd8c20bf15697d6065c273738"}
Sep 11 18:02:21.723715 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.723659    2576 scope.go:117] "RemoveContainer" containerID="00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d"
Sep 11 18:02:21.724014 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:21.723995    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d\": container with ID starting with 00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d not found: ID does not exist" containerID="00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d"
Sep 11 18:02:21.724088 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.724023    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d"} err="failed to get container status \"00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d\": rpc error: code = NotFound desc = could not find container \"00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d\": container with ID starting with 00fac07e320da1aea16a141779124eaa6fbae1665cc754856727b3956cf7da6d not found: ID does not exist"
Sep 11 18:02:21.724088 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.724040    2576 scope.go:117] "RemoveContainer" containerID="bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec"
Sep 11 18:02:21.732636 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.732492    2576 scope.go:117] "RemoveContainer" containerID="bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec"
Sep 11 18:02:21.732799 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:21.732779    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec\": container with ID starting with bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec not found: ID does not exist" containerID="bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec"
Sep 11 18:02:21.732847 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.732808    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec"} err="failed to get container status \"bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec\": rpc error: code = NotFound desc = could not find container \"bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec\": container with ID starting with bef7975056fa8c3b661db423cff255e34a5ae43bb5ba8d61efce957b0503feec not found: ID does not exist"
Sep 11 18:02:21.743882 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.743858    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"]
Sep 11 18:02:21.750284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.750259    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv"]
Sep 11 18:02:21.770561 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.770534    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"]
Sep 11 18:02:21.775227 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.775203    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c69872-84d97688f6-9xmqw"]
Sep 11 18:02:21.809719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.809667    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:21.940479 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.940391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:21.943172 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:21.943137    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls\") pod \"maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:22.150760 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.150727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:22.187005 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.186978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:22.243202 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.243175    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672390f5-fdba-4fed-a358-fdcb3671cd60" path="/var/lib/kubelet/pods/672390f5-fdba-4fed-a358-fdcb3671cd60/volumes"
Sep 11 18:02:22.243539 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.243522    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="913840db-561c-4a26-b32d-85bf78f16a9f" path="/var/lib/kubelet/pods/913840db-561c-4a26-b32d-85bf78f16a9f/volumes"
Sep 11 18:02:22.284912 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.284877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:22.367523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.367486    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"]
Sep 11 18:02:22.372121 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.372100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:22.376064 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:22.376037    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="739e79f6-258d-49f2-bf67-b6cbe7c2b966" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:22.376711 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:22.376662    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-mt-045ac32d\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-045ac32d\"" type="*v1.ConfigMap"
Sep 11 18:02:22.377479 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.377465    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-045ac32d-dockercfg-wr5pw\""
Sep 11 18:02:22.396032 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.396009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"]
Sep 11 18:02:22.444456 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.444366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:22.444598 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.444459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pqtq\" (UniqueName: \"kubernetes.io/projected/739e79f6-258d-49f2-bf67-b6cbe7c2b966-kube-api-access-8pqtq\") pod \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:22.462237 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.462209    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"]
Sep 11 18:02:22.465452 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.465437    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:22.506765 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.506731    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"]
Sep 11 18:02:22.536294 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.536254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"]
Sep 11 18:02:22.539585 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:02:22.539556    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e45d2b_e778_4adc_b31f_63b4a197d99c.slice/crio-ed3902dd7c56df33dd11c3e9bf37c4fb4b7cb82f6d899409c09e03479a1c2f23 WatchSource:0}: Error finding container ed3902dd7c56df33dd11c3e9bf37c4fb4b7cb82f6d899409c09e03479a1c2f23: Status 404 returned error can't find the container with id ed3902dd7c56df33dd11c3e9bf37c4fb4b7cb82f6d899409c09e03479a1c2f23
Sep 11 18:02:22.545721 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.545666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:22.545812 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.545754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m88pw\" (UniqueName: \"kubernetes.io/projected/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-kube-api-access-m88pw\") pod \"payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") " pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:22.545870 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.545825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pqtq\" (UniqueName: \"kubernetes.io/projected/739e79f6-258d-49f2-bf67-b6cbe7c2b966-kube-api-access-8pqtq\") pod \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:22.545934 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.545905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume\") pod \"payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") " pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:22.562976 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.562949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pqtq\" (UniqueName: \"kubernetes.io/projected/739e79f6-258d-49f2-bf67-b6cbe7c2b966-kube-api-access-8pqtq\") pod \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:22.647370 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.647337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume\") pod \"payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") " pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:22.647571 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.647409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88pw\" (UniqueName: \"kubernetes.io/projected/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-kube-api-access-m88pw\") pod \"payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") " pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:22.671159 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.671120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m88pw\" (UniqueName: \"kubernetes.io/projected/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-kube-api-access-m88pw\") pod \"payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") " pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:22.723084 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:22.722994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk" event={"ID":"31e45d2b-e778-4adc-b31f-63b4a197d99c","Type":"ContainerStarted","Data":"ed3902dd7c56df33dd11c3e9bf37c4fb4b7cb82f6d899409c09e03479a1c2f23"}
Sep 11 18:02:23.439947 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:23.439869    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:23.546622 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:23.546588    2576 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-mt-045ac32d: failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:02:23.546801 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:23.546667    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume podName:739e79f6-258d-49f2-bf67-b6cbe7c2b966 nodeName:}" failed. No retries permitted until 2026-09-11 18:02:24.046650157 +0000 UTC m=+1048.334184441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume") pod "payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f" (UID: "739e79f6-258d-49f2-bf67-b6cbe7c2b966") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:02:23.648221 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:23.648193    2576 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-mt-045ac32d: failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:02:23.648388 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:02:23.648277    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume podName:a18b0a43-f4ed-48b9-b3b7-7a9c1048405e nodeName:}" failed. No retries permitted until 2026-09-11 18:02:24.148258774 +0000 UTC m=+1048.435793060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume") pod "payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2" (UID: "a18b0a43-f4ed-48b9-b3b7-7a9c1048405e") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:02:23.679025 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:23.678995    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-045ac32d\""
Sep 11 18:02:23.731223 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:23.731134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk" event={"ID":"31e45d2b-e778-4adc-b31f-63b4a197d99c","Type":"ContainerStarted","Data":"69ec0adf4a5027f6c71a16490a9f8443ce9cad62ad4e61a1f6ed1dda0fa09d5b"}
Sep 11 18:02:23.731223 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:23.731197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:23.780077 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:23.780013    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk" podStartSLOduration=2.258837203 podStartE2EDuration="2.77999537s" totalImagesPullingTime="521.158167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:02:23.778782061 +0000 UTC m=+1048.066316367" watchObservedRunningTime="2026-09-11 18:02:23.77999537 +0000 UTC m=+1048.067529677"
Sep 11 18:02:24.060163 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.060125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:24.060802 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.060784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:24.161620 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.161585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume\") pod \"payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") " pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:24.162308 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.162288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume\") pod \"payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") " pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:24.182687 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.182648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:24.275916 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.275869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:24.472140 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.472104    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"]
Sep 11 18:02:24.479820 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:02:24.479790    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739e79f6_258d_49f2_bf67_b6cbe7c2b966.slice/crio-c2c08dd20096b147da9ec7b8df2ca3b78f265f32fa83687fe7d7f0e9f05cd752 WatchSource:0}: Error finding container c2c08dd20096b147da9ec7b8df2ca3b78f265f32fa83687fe7d7f0e9f05cd752: Status 404 returned error can't find the container with id c2c08dd20096b147da9ec7b8df2ca3b78f265f32fa83687fe7d7f0e9f05cd752
Sep 11 18:02:24.564490 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.564458    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"]
Sep 11 18:02:24.568249 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:02:24.568208    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18b0a43_f4ed_48b9_b3b7_7a9c1048405e.slice/crio-ff28b77bc550d5840d42485d7213d449cc534c855cfc9c7ef8ad689bb1151e55 WatchSource:0}: Error finding container ff28b77bc550d5840d42485d7213d449cc534c855cfc9c7ef8ad689bb1151e55: Status 404 returned error can't find the container with id ff28b77bc550d5840d42485d7213d449cc534c855cfc9c7ef8ad689bb1151e55
Sep 11 18:02:24.738311 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.738271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f" event={"ID":"739e79f6-258d-49f2-bf67-b6cbe7c2b966","Type":"ContainerStarted","Data":"a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3"}
Sep 11 18:02:24.738489 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.738339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f" event={"ID":"739e79f6-258d-49f2-bf67-b6cbe7c2b966","Type":"ContainerStarted","Data":"c2c08dd20096b147da9ec7b8df2ca3b78f265f32fa83687fe7d7f0e9f05cd752"}
Sep 11 18:02:24.738489 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.738371    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:24.739957 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.739928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2" event={"ID":"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e","Type":"ContainerStarted","Data":"589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287"}
Sep 11 18:02:24.740072 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.739979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2" event={"ID":"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e","Type":"ContainerStarted","Data":"ff28b77bc550d5840d42485d7213d449cc534c855cfc9c7ef8ad689bb1151e55"}
Sep 11 18:02:24.740139 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.740082    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:24.792720 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.790340    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f" podStartSLOduration=2.790317398 podStartE2EDuration="2.790317398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:02:24.789887496 +0000 UTC m=+1049.077421806" watchObservedRunningTime="2026-09-11 18:02:24.790317398 +0000 UTC m=+1049.077851707"
Sep 11 18:02:24.825924 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:24.825873    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2" podStartSLOduration=2.825856043 podStartE2EDuration="2.825856043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:02:24.822819428 +0000 UTC m=+1049.110353736" watchObservedRunningTime="2026-09-11 18:02:24.825856043 +0000 UTC m=+1049.113390349"
Sep 11 18:02:25.185586 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:25.185541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:26.450652 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:26.450616    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:27.527294 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:27.527262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:29.745879 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:29.745849    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:02:31.007342 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:31.007310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:31.213386 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:31.213347    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:31.413353 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:31.413289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:31.889089 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:31.889056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:32.479363 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:32.479336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:32.812694 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:32.812646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:34.617341 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:34.617307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:34.831258 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:34.831225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:35.028232 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:35.028137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:35.748213 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:35.748175    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:02:35.748721 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:35.748263    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:02:44.829853 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:44.829813    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:47.422599 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:47.422512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:47.553381 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:47.553346    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:48.284187 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:48.284155    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:48.844335 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:48.844306    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:49.070998 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:49.070948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:49.423376 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:49.423338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:49.666305 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:49.666274    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:54.273150 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:54.273114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:56.851276 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:56.851243    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:57.006221 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:57.006174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:58.271541 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:58.271497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:58.412230 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:58.412188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:58.527220 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:58.527127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:58.673085 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:58.673052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:58.821708 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:58.821655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:02:59.698494 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:02:59.698450    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:00.230292 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:00.230247    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:00.948158 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:00.948118    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:01.216415 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:01.216306    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:02.438452 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:02.438413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:03.844212 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:03.844172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:03.948886 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:03.948851    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:04.721324 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:04.721290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:05.710422 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:05.710362    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:06.809124 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:06.809084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:07.773795 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.773733    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"]
Sep 11 18:03:07.774078 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.773997    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk" podUID="31e45d2b-e778-4adc-b31f-63b4a197d99c" containerName="maas-api" containerID="cri-o://69ec0adf4a5027f6c71a16490a9f8443ce9cad62ad4e61a1f6ed1dda0fa09d5b" gracePeriod=30
Sep 11 18:03:07.884084 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.884053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:07.961882 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.961008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"]
Sep 11 18:03:07.961882 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.961276    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2" podUID="a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" containerName="payload-processing" containerID="cri-o://589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287" gracePeriod=30
Sep 11 18:03:07.965342 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.965304    2576 generic.go:356] "Generic (PLEG): container finished" podID="31e45d2b-e778-4adc-b31f-63b4a197d99c" containerID="69ec0adf4a5027f6c71a16490a9f8443ce9cad62ad4e61a1f6ed1dda0fa09d5b" exitCode=0
Sep 11 18:03:07.965639 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.965527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk" event={"ID":"31e45d2b-e778-4adc-b31f-63b4a197d99c","Type":"ContainerDied","Data":"69ec0adf4a5027f6c71a16490a9f8443ce9cad62ad4e61a1f6ed1dda0fa09d5b"}
Sep 11 18:03:07.981714 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.981527    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"]
Sep 11 18:03:07.981848 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:07.981779    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f" podUID="739e79f6-258d-49f2-bf67-b6cbe7c2b966" containerName="payload-pre-processing" containerID="cri-o://a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3" gracePeriod=30
Sep 11 18:03:08.114728 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.114656    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:03:08.152526 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.152479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:08.164375 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.164348    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmjmx\" (UniqueName: \"kubernetes.io/projected/31e45d2b-e778-4adc-b31f-63b4a197d99c-kube-api-access-tmjmx\") pod \"31e45d2b-e778-4adc-b31f-63b4a197d99c\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") "
Sep 11 18:03:08.164580 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.164562    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls\") pod \"31e45d2b-e778-4adc-b31f-63b4a197d99c\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") "
Sep 11 18:03:08.164731 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.164717    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-metrics-certs\") pod \"31e45d2b-e778-4adc-b31f-63b4a197d99c\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") "
Sep 11 18:03:08.164881 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.164864    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e45d2b-e778-4adc-b31f-63b4a197d99c-openshift-service-ca\") pod \"31e45d2b-e778-4adc-b31f-63b4a197d99c\" (UID: \"31e45d2b-e778-4adc-b31f-63b4a197d99c\") "
Sep 11 18:03:08.165694 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.165650    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e45d2b-e778-4adc-b31f-63b4a197d99c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31e45d2b-e778-4adc-b31f-63b4a197d99c" (UID: "31e45d2b-e778-4adc-b31f-63b4a197d99c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:08.172126 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.172093    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e45d2b-e778-4adc-b31f-63b4a197d99c-kube-api-access-tmjmx" (OuterVolumeSpecName: "kube-api-access-tmjmx") pod "31e45d2b-e778-4adc-b31f-63b4a197d99c" (UID: "31e45d2b-e778-4adc-b31f-63b4a197d99c"). InnerVolumeSpecName "kube-api-access-tmjmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:08.172222 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.172099    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31e45d2b-e778-4adc-b31f-63b4a197d99c" (UID: "31e45d2b-e778-4adc-b31f-63b4a197d99c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:03:08.173304 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.173285    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31e45d2b-e778-4adc-b31f-63b4a197d99c" (UID: "31e45d2b-e778-4adc-b31f-63b4a197d99c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:03:08.260771 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.260747    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:03:08.265940 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.265917    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmjmx\" (UniqueName: \"kubernetes.io/projected/31e45d2b-e778-4adc-b31f-63b4a197d99c-kube-api-access-tmjmx\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.266034 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.265946    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.266034 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.265961    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e45d2b-e778-4adc-b31f-63b4a197d99c-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.266034 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.265975    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e45d2b-e778-4adc-b31f-63b4a197d99c-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.272945 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.272922    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:03:08.366574 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.366540    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume\") pod \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") "
Sep 11 18:03:08.366987 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.366960    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "739e79f6-258d-49f2-bf67-b6cbe7c2b966" (UID: "739e79f6-258d-49f2-bf67-b6cbe7c2b966"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:08.367102 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.367082    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m88pw\" (UniqueName: \"kubernetes.io/projected/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-kube-api-access-m88pw\") pod \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") "
Sep 11 18:03:08.367448 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.367428    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pqtq\" (UniqueName: \"kubernetes.io/projected/739e79f6-258d-49f2-bf67-b6cbe7c2b966-kube-api-access-8pqtq\") pod \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\" (UID: \"739e79f6-258d-49f2-bf67-b6cbe7c2b966\") "
Sep 11 18:03:08.367629 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.367612    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume\") pod \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\" (UID: \"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e\") "
Sep 11 18:03:08.368041 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.368010    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" (UID: "a18b0a43-f4ed-48b9-b3b7-7a9c1048405e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:08.368874 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.368835    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/739e79f6-258d-49f2-bf67-b6cbe7c2b966-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.368874 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.368863    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.370006 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.369981    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-kube-api-access-m88pw" (OuterVolumeSpecName: "kube-api-access-m88pw") pod "a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" (UID: "a18b0a43-f4ed-48b9-b3b7-7a9c1048405e"). InnerVolumeSpecName "kube-api-access-m88pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:08.370111 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.370003    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/739e79f6-258d-49f2-bf67-b6cbe7c2b966-kube-api-access-8pqtq" (OuterVolumeSpecName: "kube-api-access-8pqtq") pod "739e79f6-258d-49f2-bf67-b6cbe7c2b966" (UID: "739e79f6-258d-49f2-bf67-b6cbe7c2b966"). InnerVolumeSpecName "kube-api-access-8pqtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:08.375360 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.375338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:08.469788 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.469756    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m88pw\" (UniqueName: \"kubernetes.io/projected/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e-kube-api-access-m88pw\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.469788 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.469781    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pqtq\" (UniqueName: \"kubernetes.io/projected/739e79f6-258d-49f2-bf67-b6cbe7c2b966-kube-api-access-8pqtq\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:08.522867 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.522835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:08.849306 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.849273    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:08.973047 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.973012    2576 generic.go:356] "Generic (PLEG): container finished" podID="739e79f6-258d-49f2-bf67-b6cbe7c2b966" containerID="a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3" exitCode=0
Sep 11 18:03:08.973476 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.973055    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"
Sep 11 18:03:08.973476 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.973107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f" event={"ID":"739e79f6-258d-49f2-bf67-b6cbe7c2b966","Type":"ContainerDied","Data":"a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3"}
Sep 11 18:03:08.973476 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.973175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f" event={"ID":"739e79f6-258d-49f2-bf67-b6cbe7c2b966","Type":"ContainerDied","Data":"c2c08dd20096b147da9ec7b8df2ca3b78f265f32fa83687fe7d7f0e9f05cd752"}
Sep 11 18:03:08.973476 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.973208    2576 scope.go:117] "RemoveContainer" containerID="a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3"
Sep 11 18:03:08.975114 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.975092    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"
Sep 11 18:03:08.975257 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.975094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk" event={"ID":"31e45d2b-e778-4adc-b31f-63b4a197d99c","Type":"ContainerDied","Data":"ed3902dd7c56df33dd11c3e9bf37c4fb4b7cb82f6d899409c09e03479a1c2f23"}
Sep 11 18:03:08.976713 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.976669    2576 generic.go:356] "Generic (PLEG): container finished" podID="a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" containerID="589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287" exitCode=0
Sep 11 18:03:08.976844 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.976716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2" event={"ID":"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e","Type":"ContainerDied","Data":"589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287"}
Sep 11 18:03:08.976844 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.976731    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"
Sep 11 18:03:08.976844 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.976762    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2" event={"ID":"a18b0a43-f4ed-48b9-b3b7-7a9c1048405e","Type":"ContainerDied","Data":"ff28b77bc550d5840d42485d7213d449cc534c855cfc9c7ef8ad689bb1151e55"}
Sep 11 18:03:08.986866 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.986837    2576 scope.go:117] "RemoveContainer" containerID="a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3"
Sep 11 18:03:08.987596 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:03:08.987428    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3\": container with ID starting with a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3 not found: ID does not exist" containerID="a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3"
Sep 11 18:03:08.987709 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.987608    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3"} err="failed to get container status \"a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3\": rpc error: code = NotFound desc = could not find container \"a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3\": container with ID starting with a7692738a25d2ec13922f5adc263746414c052b326dfda38868d700499f9e2c3 not found: ID does not exist"
Sep 11 18:03:08.987709 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.987632    2576 scope.go:117] "RemoveContainer" containerID="69ec0adf4a5027f6c71a16490a9f8443ce9cad62ad4e61a1f6ed1dda0fa09d5b"
Sep 11 18:03:08.996733 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:08.996655    2576 scope.go:117] "RemoveContainer" containerID="589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287"
Sep 11 18:03:09.004787 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.004769    2576 scope.go:117] "RemoveContainer" containerID="589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287"
Sep 11 18:03:09.005109 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:03:09.005089    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287\": container with ID starting with 589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287 not found: ID does not exist" containerID="589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287"
Sep 11 18:03:09.005161 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.005117    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287"} err="failed to get container status \"589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287\": rpc error: code = NotFound desc = could not find container \"589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287\": container with ID starting with 589d0f874da560c90df3e7ef3650d1aabdd92f9c912e596bd18e7557c5806287 not found: ID does not exist"
Sep 11 18:03:09.005808 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.005790    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"]
Sep 11 18:03:09.021187 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.021136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:09.024295 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.024274    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-045ac32d-85dc79fdd4-99pvk"]
Sep 11 18:03:09.054702 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.054664    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"]
Sep 11 18:03:09.067871 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.067844    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f"]
Sep 11 18:03:09.086340 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.086312    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"]
Sep 11 18:03:09.094652 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:09.094627    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2"]
Sep 11 18:03:10.241785 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:10.241755    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e45d2b-e778-4adc-b31f-63b4a197d99c" path="/var/lib/kubelet/pods/31e45d2b-e778-4adc-b31f-63b4a197d99c/volumes"
Sep 11 18:03:10.242187 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:10.242115    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="739e79f6-258d-49f2-bf67-b6cbe7c2b966" path="/var/lib/kubelet/pods/739e79f6-258d-49f2-bf67-b6cbe7c2b966/volumes"
Sep 11 18:03:10.242421 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:10.242408    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" path="/var/lib/kubelet/pods/a18b0a43-f4ed-48b9-b3b7-7a9c1048405e/volumes"
Sep 11 18:03:11.843605 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:11.843566    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:11.991087 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:11.991048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:12.616693 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.616642    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"]
Sep 11 18:03:12.616891 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.616868    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x" podUID="17924043-97c9-4dff-a6ee-73e13883fa16" containerName="maas-api" containerID="cri-o://6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7" gracePeriod=30
Sep 11 18:03:12.711398 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.711354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:12.779690 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.779633    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"]
Sep 11 18:03:12.780762 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.779947    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf" podUID="ae4e081f-c685-455a-abd3-005908bb0115" containerName="payload-processing" containerID="cri-o://10aa75f423adb3fb390e3c84ef12a53987ddf9b51c8cd230e3b4d4ef30e3bc63" gracePeriod=30
Sep 11 18:03:12.815131 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.814719    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"]
Sep 11 18:03:12.815131 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.814976    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx" podUID="b1753f10-bb34-4b6b-938a-8d79990167a8" containerName="payload-pre-processing" containerID="cri-o://abcb82cb9b508bb7acb93f1c6a17317de88688acc16c1ddfd11d948128eb11cd" gracePeriod=30
Sep 11 18:03:12.844109 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.844054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:12.940103 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.940070    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 18:03:12.985074 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:12.985037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:13.002647 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.002616    2576 generic.go:356] "Generic (PLEG): container finished" podID="ae4e081f-c685-455a-abd3-005908bb0115" containerID="10aa75f423adb3fb390e3c84ef12a53987ddf9b51c8cd230e3b4d4ef30e3bc63" exitCode=0
Sep 11 18:03:13.002884 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.002704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf" event={"ID":"ae4e081f-c685-455a-abd3-005908bb0115","Type":"ContainerDied","Data":"10aa75f423adb3fb390e3c84ef12a53987ddf9b51c8cd230e3b4d4ef30e3bc63"}
Sep 11 18:03:13.004509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.004302    2576 generic.go:356] "Generic (PLEG): container finished" podID="17924043-97c9-4dff-a6ee-73e13883fa16" containerID="6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7" exitCode=0
Sep 11 18:03:13.004509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.004362    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"
Sep 11 18:03:13.004509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.004382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x" event={"ID":"17924043-97c9-4dff-a6ee-73e13883fa16","Type":"ContainerDied","Data":"6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7"}
Sep 11 18:03:13.004509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.004435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x" event={"ID":"17924043-97c9-4dff-a6ee-73e13883fa16","Type":"ContainerDied","Data":"63a8183a403039aff816aae818986af65f753b79b0193dfb4e757cac9796d2bf"}
Sep 11 18:03:13.004509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.004464    2576 scope.go:117] "RemoveContainer" containerID="6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7"
Sep 11 18:03:13.006470 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.006446    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1753f10-bb34-4b6b-938a-8d79990167a8" containerID="abcb82cb9b508bb7acb93f1c6a17317de88688acc16c1ddfd11d948128eb11cd" exitCode=0
Sep 11 18:03:13.006554 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.006486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx" event={"ID":"b1753f10-bb34-4b6b-938a-8d79990167a8","Type":"ContainerDied","Data":"abcb82cb9b508bb7acb93f1c6a17317de88688acc16c1ddfd11d948128eb11cd"}
Sep 11 18:03:13.011962 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.011937    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17924043-97c9-4dff-a6ee-73e13883fa16-openshift-service-ca\") pod \"17924043-97c9-4dff-a6ee-73e13883fa16\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") "
Sep 11 18:03:13.012070 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.011987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls\") pod \"17924043-97c9-4dff-a6ee-73e13883fa16\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") "
Sep 11 18:03:13.012070 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.012019    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-metrics-certs\") pod \"17924043-97c9-4dff-a6ee-73e13883fa16\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") "
Sep 11 18:03:13.012200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.012079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m8js\" (UniqueName: \"kubernetes.io/projected/17924043-97c9-4dff-a6ee-73e13883fa16-kube-api-access-5m8js\") pod \"17924043-97c9-4dff-a6ee-73e13883fa16\" (UID: \"17924043-97c9-4dff-a6ee-73e13883fa16\") "
Sep 11 18:03:13.012428 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.012322    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17924043-97c9-4dff-a6ee-73e13883fa16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17924043-97c9-4dff-a6ee-73e13883fa16" (UID: "17924043-97c9-4dff-a6ee-73e13883fa16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:13.015974 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.015946    2576 scope.go:117] "RemoveContainer" containerID="6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7"
Sep 11 18:03:13.016051 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.016003    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "17924043-97c9-4dff-a6ee-73e13883fa16" (UID: "17924043-97c9-4dff-a6ee-73e13883fa16"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:03:13.016051 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.016015    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17924043-97c9-4dff-a6ee-73e13883fa16-kube-api-access-5m8js" (OuterVolumeSpecName: "kube-api-access-5m8js") pod "17924043-97c9-4dff-a6ee-73e13883fa16" (UID: "17924043-97c9-4dff-a6ee-73e13883fa16"). InnerVolumeSpecName "kube-api-access-5m8js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:13.016171 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.016102    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17924043-97c9-4dff-a6ee-73e13883fa16" (UID: "17924043-97c9-4dff-a6ee-73e13883fa16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:03:13.016423 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:03:13.016397    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7\": container with ID starting with 6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7 not found: ID does not exist" containerID="6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7"
Sep 11 18:03:13.016487 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.016435    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7"} err="failed to get container status \"6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7\": rpc error: code = NotFound desc = could not find container \"6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7\": container with ID starting with 6705ae8a299ba1ec9dc91ca5d90ffdd9c135d795478b708e855da8936dc8cee7 not found: ID does not exist"
Sep 11 18:03:13.072026 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.072000    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 18:03:13.100652 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.100623    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 18:03:13.113477 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.113445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ctds\" (UniqueName: \"kubernetes.io/projected/ae4e081f-c685-455a-abd3-005908bb0115-kube-api-access-9ctds\") pod \"ae4e081f-c685-455a-abd3-005908bb0115\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") "
Sep 11 18:03:13.113649 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.113503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae4e081f-c685-455a-abd3-005908bb0115-plugins-config-volume\") pod \"ae4e081f-c685-455a-abd3-005908bb0115\" (UID: \"ae4e081f-c685-455a-abd3-005908bb0115\") "
Sep 11 18:03:13.116189 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.114040    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m8js\" (UniqueName: \"kubernetes.io/projected/17924043-97c9-4dff-a6ee-73e13883fa16-kube-api-access-5m8js\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.116189 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.114074    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17924043-97c9-4dff-a6ee-73e13883fa16-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.116189 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.114090    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.116189 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.114104    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17924043-97c9-4dff-a6ee-73e13883fa16-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.116189 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.114440    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4e081f-c685-455a-abd3-005908bb0115-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae4e081f-c685-455a-abd3-005908bb0115" (UID: "ae4e081f-c685-455a-abd3-005908bb0115"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:13.120747 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.120636    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4e081f-c685-455a-abd3-005908bb0115-kube-api-access-9ctds" (OuterVolumeSpecName: "kube-api-access-9ctds") pod "ae4e081f-c685-455a-abd3-005908bb0115" (UID: "ae4e081f-c685-455a-abd3-005908bb0115"). InnerVolumeSpecName "kube-api-access-9ctds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:13.186514 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.186425    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:13.215414 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.215382    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1753f10-bb34-4b6b-938a-8d79990167a8-plugins-config-volume\") pod \"b1753f10-bb34-4b6b-938a-8d79990167a8\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") "
Sep 11 18:03:13.215617 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.215424    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-478hl\" (UniqueName: \"kubernetes.io/projected/b1753f10-bb34-4b6b-938a-8d79990167a8-kube-api-access-478hl\") pod \"b1753f10-bb34-4b6b-938a-8d79990167a8\" (UID: \"b1753f10-bb34-4b6b-938a-8d79990167a8\") "
Sep 11 18:03:13.215719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.215658    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ctds\" (UniqueName: \"kubernetes.io/projected/ae4e081f-c685-455a-abd3-005908bb0115-kube-api-access-9ctds\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.215719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.215691    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae4e081f-c685-455a-abd3-005908bb0115-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.215888 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.215860    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1753f10-bb34-4b6b-938a-8d79990167a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b1753f10-bb34-4b6b-938a-8d79990167a8" (UID: "b1753f10-bb34-4b6b-938a-8d79990167a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:13.217742 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.217711    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1753f10-bb34-4b6b-938a-8d79990167a8-kube-api-access-478hl" (OuterVolumeSpecName: "kube-api-access-478hl") pod "b1753f10-bb34-4b6b-938a-8d79990167a8" (UID: "b1753f10-bb34-4b6b-938a-8d79990167a8"). InnerVolumeSpecName "kube-api-access-478hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:13.316365 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.316329    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1753f10-bb34-4b6b-938a-8d79990167a8-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.316480 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.316368    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-478hl\" (UniqueName: \"kubernetes.io/projected/b1753f10-bb34-4b6b-938a-8d79990167a8-kube-api-access-478hl\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:13.335310 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.335276    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"]
Sep 11 18:03:13.342276 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.342247    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:13.351174 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.351149    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-67477b-74cb97c79f-mms9x"]
Sep 11 18:03:13.680834 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.680801    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:13.905229 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:13.905137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:14.013023 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.012993    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"
Sep 11 18:03:14.013023 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.013006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf" event={"ID":"ae4e081f-c685-455a-abd3-005908bb0115","Type":"ContainerDied","Data":"7f4151e19489c8ab849d629573547c23b96d10523f0637f63d91e4c4c1411b53"}
Sep 11 18:03:14.013284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.013078    2576 scope.go:117] "RemoveContainer" containerID="10aa75f423adb3fb390e3c84ef12a53987ddf9b51c8cd230e3b4d4ef30e3bc63"
Sep 11 18:03:14.015540 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.015516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx" event={"ID":"b1753f10-bb34-4b6b-938a-8d79990167a8","Type":"ContainerDied","Data":"cb4d5757179eed595147e9409ccd8e790abcc1ce27a00fe85a64b5da667c340c"}
Sep 11 18:03:14.015699 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.015577    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"
Sep 11 18:03:14.023331 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.023311    2576 scope.go:117] "RemoveContainer" containerID="abcb82cb9b508bb7acb93f1c6a17317de88688acc16c1ddfd11d948128eb11cd"
Sep 11 18:03:14.052886 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.052864    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"]
Sep 11 18:03:14.062903 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.062883    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf"]
Sep 11 18:03:14.131352 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.131322    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"]
Sep 11 18:03:14.142499 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.142475    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx"]
Sep 11 18:03:14.239784 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.239705    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17924043-97c9-4dff-a6ee-73e13883fa16" path="/var/lib/kubelet/pods/17924043-97c9-4dff-a6ee-73e13883fa16/volumes"
Sep 11 18:03:14.240068 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.240056    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4e081f-c685-455a-abd3-005908bb0115" path="/var/lib/kubelet/pods/ae4e081f-c685-455a-abd3-005908bb0115/volumes"
Sep 11 18:03:14.240367 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:14.240355    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1753f10-bb34-4b6b-938a-8d79990167a8" path="/var/lib/kubelet/pods/b1753f10-bb34-4b6b-938a-8d79990167a8/volumes"
Sep 11 18:03:15.405212 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:15.405181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:21.924126 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:21.924090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:22.061621 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:22.061578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:22.292937 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:22.292827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:22.695585 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:22.695544    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:25.147442 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:25.147396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:25.355098 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:25.355057    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:26.044715 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:26.044655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:27.209670 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:27.209617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:30.239367 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:30.239333    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:30.374107 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:30.374078    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:30.558982 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:30.558948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:30.665034 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:30.665001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:35.134882 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.134843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:35.190937 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.190903    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"]
Sep 11 18:03:35.205259 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.205228    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fb8c5d-29819160-9x7nb"]
Sep 11 18:03:35.272516 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.272477    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"]
Sep 11 18:03:35.272756 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.272729    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln" podUID="4c852878-3121-4f32-a8fd-ad0059730c5b" containerName="payload-processing" containerID="cri-o://ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889" gracePeriod=30
Sep 11 18:03:35.278363 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.278338    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"]
Sep 11 18:03:35.278608 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.278557    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5" podUID="d6a46ba0-1fba-4114-a408-6e665f7bb08d" containerName="payload-pre-processing" containerID="cri-o://fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6" gracePeriod=30
Sep 11 18:03:35.341018 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.340990    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:35.503507 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.503409    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:35.558014 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.554092    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 18:03:35.575403 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.575380    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 18:03:35.674608 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.674515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:35.704869 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.704834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c852878-3121-4f32-a8fd-ad0059730c5b-plugins-config-volume\") pod \"4c852878-3121-4f32-a8fd-ad0059730c5b\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") "
Sep 11 18:03:35.705022 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.704893    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft2zv\" (UniqueName: \"kubernetes.io/projected/4c852878-3121-4f32-a8fd-ad0059730c5b-kube-api-access-ft2zv\") pod \"4c852878-3121-4f32-a8fd-ad0059730c5b\" (UID: \"4c852878-3121-4f32-a8fd-ad0059730c5b\") "
Sep 11 18:03:35.705022 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.704925    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a46ba0-1fba-4114-a408-6e665f7bb08d-plugins-config-volume\") pod \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") "
Sep 11 18:03:35.705161 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.705087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzdsd\" (UniqueName: \"kubernetes.io/projected/d6a46ba0-1fba-4114-a408-6e665f7bb08d-kube-api-access-jzdsd\") pod \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\" (UID: \"d6a46ba0-1fba-4114-a408-6e665f7bb08d\") "
Sep 11 18:03:35.705263 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.705238    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c852878-3121-4f32-a8fd-ad0059730c5b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4c852878-3121-4f32-a8fd-ad0059730c5b" (UID: "4c852878-3121-4f32-a8fd-ad0059730c5b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:35.705387 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.705267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a46ba0-1fba-4114-a408-6e665f7bb08d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6a46ba0-1fba-4114-a408-6e665f7bb08d" (UID: "d6a46ba0-1fba-4114-a408-6e665f7bb08d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:03:35.705439 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.705395    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c852878-3121-4f32-a8fd-ad0059730c5b-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:35.705439 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.705410    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a46ba0-1fba-4114-a408-6e665f7bb08d-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:35.707084 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.707062    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c852878-3121-4f32-a8fd-ad0059730c5b-kube-api-access-ft2zv" (OuterVolumeSpecName: "kube-api-access-ft2zv") pod "4c852878-3121-4f32-a8fd-ad0059730c5b" (UID: "4c852878-3121-4f32-a8fd-ad0059730c5b"). InnerVolumeSpecName "kube-api-access-ft2zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:35.707215 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.707196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a46ba0-1fba-4114-a408-6e665f7bb08d-kube-api-access-jzdsd" (OuterVolumeSpecName: "kube-api-access-jzdsd") pod "d6a46ba0-1fba-4114-a408-6e665f7bb08d" (UID: "d6a46ba0-1fba-4114-a408-6e665f7bb08d"). InnerVolumeSpecName "kube-api-access-jzdsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:03:35.806829 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.806786    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft2zv\" (UniqueName: \"kubernetes.io/projected/4c852878-3121-4f32-a8fd-ad0059730c5b-kube-api-access-ft2zv\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:35.806829 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.806819    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzdsd\" (UniqueName: \"kubernetes.io/projected/d6a46ba0-1fba-4114-a408-6e665f7bb08d-kube-api-access-jzdsd\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:03:35.844211 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:35.844170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:36.125426 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.125391    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c852878-3121-4f32-a8fd-ad0059730c5b" containerID="ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889" exitCode=0
Sep 11 18:03:36.125613 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.125438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"
Sep 11 18:03:36.125613 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.125484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln" event={"ID":"4c852878-3121-4f32-a8fd-ad0059730c5b","Type":"ContainerDied","Data":"ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889"}
Sep 11 18:03:36.125613 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.125576    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln" event={"ID":"4c852878-3121-4f32-a8fd-ad0059730c5b","Type":"ContainerDied","Data":"955389cb4177daf5a571a17ef2b65a5276ba5a22cd2d9c5bfd8570948bd1ed3c"}
Sep 11 18:03:36.125613 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.125604    2576 scope.go:117] "RemoveContainer" containerID="ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889"
Sep 11 18:03:36.126905 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.126880    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6a46ba0-1fba-4114-a408-6e665f7bb08d" containerID="fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6" exitCode=0
Sep 11 18:03:36.127000 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.126920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5" event={"ID":"d6a46ba0-1fba-4114-a408-6e665f7bb08d","Type":"ContainerDied","Data":"fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6"}
Sep 11 18:03:36.127000 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.126937    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"
Sep 11 18:03:36.127000 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.126952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5" event={"ID":"d6a46ba0-1fba-4114-a408-6e665f7bb08d","Type":"ContainerDied","Data":"f6c4af94ae721b77d843cd2b18048e49e1b55d900488ef691d8301c2c8116be2"}
Sep 11 18:03:36.134802 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.134653    2576 scope.go:117] "RemoveContainer" containerID="ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889"
Sep 11 18:03:36.135046 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:03:36.135022    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889\": container with ID starting with ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889 not found: ID does not exist" containerID="ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889"
Sep 11 18:03:36.135395 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.135056    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889"} err="failed to get container status \"ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889\": rpc error: code = NotFound desc = could not find container \"ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889\": container with ID starting with ed0c9ee6e5838611757b483e98a8804ed8a2d5ac2664f9ba97c1c42ebbae4889 not found: ID does not exist"
Sep 11 18:03:36.135395 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.135078    2576 scope.go:117] "RemoveContainer" containerID="fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6"
Sep 11 18:03:36.143668 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.143652    2576 scope.go:117] "RemoveContainer" containerID="fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6"
Sep 11 18:03:36.143936 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:03:36.143917    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6\": container with ID starting with fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6 not found: ID does not exist" containerID="fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6"
Sep 11 18:03:36.144013 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.143942    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6"} err="failed to get container status \"fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6\": rpc error: code = NotFound desc = could not find container \"fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6\": container with ID starting with fb0a88c39f2c93312fd0c8ddc757db1553fa9cb41c55d00a6daa4a8479429ff6 not found: ID does not exist"
Sep 11 18:03:36.164076 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.164039    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"]
Sep 11 18:03:36.173984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.173959    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln"]
Sep 11 18:03:36.197822 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.193312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:36.201420 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.201392    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"]
Sep 11 18:03:36.211797 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.211770    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5"]
Sep 11 18:03:36.238649 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.238619    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c852878-3121-4f32-a8fd-ad0059730c5b" path="/var/lib/kubelet/pods/4c852878-3121-4f32-a8fd-ad0059730c5b/volumes"
Sep 11 18:03:36.238931 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.238918    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ace779d1-e36b-4005-b27c-807bacdd8f58" path="/var/lib/kubelet/pods/ace779d1-e36b-4005-b27c-807bacdd8f58/volumes"
Sep 11 18:03:36.239184 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.239174    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a46ba0-1fba-4114-a408-6e665f7bb08d" path="/var/lib/kubelet/pods/d6a46ba0-1fba-4114-a408-6e665f7bb08d/volumes"
Sep 11 18:03:36.394708 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:36.394611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:39.264259 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:39.264223    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:39.445071 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:39.445038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:40.175359 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:40.175314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:40.752210 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:40.752172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:41.602317 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:41.602282    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:44.173830 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:44.173796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:44.695348 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:44.695297    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:44.804646 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:44.804614    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:45.190502 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.190469    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:45.310151 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.310116    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:45.539784 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.539699    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:45.970656 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.970625    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"]
Sep 11 18:03:45.971097 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971082    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1753f10-bb34-4b6b-938a-8d79990167a8" containerName="payload-pre-processing"
Sep 11 18:03:45.971146 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971101    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1753f10-bb34-4b6b-938a-8d79990167a8" containerName="payload-pre-processing"
Sep 11 18:03:45.971146 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971113    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="739e79f6-258d-49f2-bf67-b6cbe7c2b966" containerName="payload-pre-processing"
Sep 11 18:03:45.971146 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971122    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="739e79f6-258d-49f2-bf67-b6cbe7c2b966" containerName="payload-pre-processing"
Sep 11 18:03:45.971146 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971133    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e45d2b-e778-4adc-b31f-63b4a197d99c" containerName="maas-api"
Sep 11 18:03:45.971146 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971141    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e45d2b-e778-4adc-b31f-63b4a197d99c" containerName="maas-api"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971153    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c852878-3121-4f32-a8fd-ad0059730c5b" containerName="payload-processing"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971161    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c852878-3121-4f32-a8fd-ad0059730c5b" containerName="payload-processing"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971174    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a46ba0-1fba-4114-a408-6e665f7bb08d" containerName="payload-pre-processing"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971182    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a46ba0-1fba-4114-a408-6e665f7bb08d" containerName="payload-pre-processing"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971194    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17924043-97c9-4dff-a6ee-73e13883fa16" containerName="maas-api"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971202    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17924043-97c9-4dff-a6ee-73e13883fa16" containerName="maas-api"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971209    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" containerName="payload-processing"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971218    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" containerName="payload-processing"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971234    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e081f-c685-455a-abd3-005908bb0115" containerName="payload-processing"
Sep 11 18:03:45.971297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971241    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e081f-c685-455a-abd3-005908bb0115" containerName="payload-processing"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971323    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a46ba0-1fba-4114-a408-6e665f7bb08d" containerName="payload-pre-processing"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971333    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1753f10-bb34-4b6b-938a-8d79990167a8" containerName="payload-pre-processing"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971344    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="739e79f6-258d-49f2-bf67-b6cbe7c2b966" containerName="payload-pre-processing"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971353    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4e081f-c685-455a-abd3-005908bb0115" containerName="payload-processing"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971362    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e45d2b-e778-4adc-b31f-63b4a197d99c" containerName="maas-api"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971369    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17924043-97c9-4dff-a6ee-73e13883fa16" containerName="maas-api"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971377    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c852878-3121-4f32-a8fd-ad0059730c5b" containerName="payload-processing"
Sep 11 18:03:45.971606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.971386    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18b0a43-f4ed-48b9-b3b7-7a9c1048405e" containerName="payload-processing"
Sep 11 18:03:45.976021 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.975993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:45.979373 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.979346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-fd32cd-serving-cert\""
Sep 11 18:03:45.999657 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:45.999621    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"]
Sep 11 18:03:46.043223 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.043191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:46.093246 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.093213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.093423 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.093265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.093423 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.093315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e09cf0-ec74-4a69-ad41-052aaacccabb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.093423 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.093343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjtgz\" (UniqueName: \"kubernetes.io/projected/01e09cf0-ec74-4a69-ad41-052aaacccabb-kube-api-access-pjtgz\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.180277 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.180247    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:46.194447 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.194415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.194919 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.194460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.194919 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:03:46.194580    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-serving-cert: secret "maas-api-e2e-shared-a-w2-fd32cd-serving-cert" not found
Sep 11 18:03:46.194919 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:03:46.194667    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls podName:01e09cf0-ec74-4a69-ad41-052aaacccabb nodeName:}" failed. No retries permitted until 2026-09-11 18:03:46.694647527 +0000 UTC m=+1130.982181832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls") pod "maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx" (UID: "01e09cf0-ec74-4a69-ad41-052aaacccabb") : secret "maas-api-e2e-shared-a-w2-fd32cd-serving-cert" not found
Sep 11 18:03:46.194919 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.194718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e09cf0-ec74-4a69-ad41-052aaacccabb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.194919 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.194754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjtgz\" (UniqueName: \"kubernetes.io/projected/01e09cf0-ec74-4a69-ad41-052aaacccabb-kube-api-access-pjtgz\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.195371 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.195353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e09cf0-ec74-4a69-ad41-052aaacccabb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.197197 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.197174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.211146 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.211119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjtgz\" (UniqueName: \"kubernetes.io/projected/01e09cf0-ec74-4a69-ad41-052aaacccabb-kube-api-access-pjtgz\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.291767 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.291665    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:46.467003 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.466961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:46.575448 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.575411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:46.699103 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.699062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.701720 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.701694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.727144 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.727115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:46.837732 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.837611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:46.886564 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.886529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:46.971334 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:46.971300    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:47.017256 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.017227    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"]
Sep 11 18:03:47.021814 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.021791    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.025650 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.025629    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-fd32cd\""
Sep 11 18:03:47.025775 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.025631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-fd32cd-dockercfg-5bcsg\""
Sep 11 18:03:47.049669 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.049644    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"]
Sep 11 18:03:47.052929 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.052911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.100537 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.100457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"]
Sep 11 18:03:47.103317 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.103279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7jj\" (UniqueName: \"kubernetes.io/projected/21a3b767-aab3-43f2-b787-29c868e729a1-kube-api-access-xf7jj\") pod \"payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.103487 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.103358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a3b767-aab3-43f2-b787-29c868e729a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.105416 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.105380    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"]
Sep 11 18:03:47.190118 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.190094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"]
Sep 11 18:03:47.192101 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:03:47.192078    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e09cf0_ec74_4a69_ad41_052aaacccabb.slice/crio-7984d4e3c9ef8119fd46dd76d8d949704ee6f05463740f459620e25eac90ef37 WatchSource:0}: Error finding container 7984d4e3c9ef8119fd46dd76d8d949704ee6f05463740f459620e25eac90ef37: Status 404 returned error can't find the container with id 7984d4e3c9ef8119fd46dd76d8d949704ee6f05463740f459620e25eac90ef37
Sep 11 18:03:47.204656 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.204625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7jj\" (UniqueName: \"kubernetes.io/projected/21a3b767-aab3-43f2-b787-29c868e729a1-kube-api-access-xf7jj\") pod \"payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.204979 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.204687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfpxv\" (UniqueName: \"kubernetes.io/projected/ad920abb-53c7-4845-bdc1-d268eb8beaed-kube-api-access-qfpxv\") pod \"payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.204979 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.204727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a3b767-aab3-43f2-b787-29c868e729a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.204979 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.204763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad920abb-53c7-4845-bdc1-d268eb8beaed-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.205378 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.205359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a3b767-aab3-43f2-b787-29c868e729a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.221136 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.221109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7jj\" (UniqueName: \"kubernetes.io/projected/21a3b767-aab3-43f2-b787-29c868e729a1-kube-api-access-xf7jj\") pod \"payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.305728 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.305661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfpxv\" (UniqueName: \"kubernetes.io/projected/ad920abb-53c7-4845-bdc1-d268eb8beaed-kube-api-access-qfpxv\") pod \"payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.305907 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.305788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad920abb-53c7-4845-bdc1-d268eb8beaed-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.306474 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.306441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad920abb-53c7-4845-bdc1-d268eb8beaed-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.329064 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.329041    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfpxv\" (UniqueName: \"kubernetes.io/projected/ad920abb-53c7-4845-bdc1-d268eb8beaed-kube-api-access-qfpxv\") pod \"payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.332815 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.332778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:47.362612 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.362554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:47.617328 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.617287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"]
Sep 11 18:03:47.618857 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:03:47.618832    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a3b767_aab3_43f2_b787_29c868e729a1.slice/crio-c02c1aadaf8f3bf738a96a10dcfca6173ef02001811081250004fd8cb7007802 WatchSource:0}: Error finding container c02c1aadaf8f3bf738a96a10dcfca6173ef02001811081250004fd8cb7007802: Status 404 returned error can't find the container with id c02c1aadaf8f3bf738a96a10dcfca6173ef02001811081250004fd8cb7007802
Sep 11 18:03:47.655250 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:47.655110    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"]
Sep 11 18:03:47.662147 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:03:47.662112    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad920abb_53c7_4845_bdc1_d268eb8beaed.slice/crio-dd48935fe34fc3b39e1b291bebb97a11a3ae909c0b1299ad31ec373158d21004 WatchSource:0}: Error finding container dd48935fe34fc3b39e1b291bebb97a11a3ae909c0b1299ad31ec373158d21004: Status 404 returned error can't find the container with id dd48935fe34fc3b39e1b291bebb97a11a3ae909c0b1299ad31ec373158d21004
Sep 11 18:03:48.187248 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.187213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx" event={"ID":"01e09cf0-ec74-4a69-ad41-052aaacccabb","Type":"ContainerStarted","Data":"042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd"}
Sep 11 18:03:48.187434 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.187273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx" event={"ID":"01e09cf0-ec74-4a69-ad41-052aaacccabb","Type":"ContainerStarted","Data":"7984d4e3c9ef8119fd46dd76d8d949704ee6f05463740f459620e25eac90ef37"}
Sep 11 18:03:48.187434 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.187308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:48.189032 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.189005    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8" event={"ID":"21a3b767-aab3-43f2-b787-29c868e729a1","Type":"ContainerStarted","Data":"b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25"}
Sep 11 18:03:48.189186 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.189057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8" event={"ID":"21a3b767-aab3-43f2-b787-29c868e729a1","Type":"ContainerStarted","Data":"c02c1aadaf8f3bf738a96a10dcfca6173ef02001811081250004fd8cb7007802"}
Sep 11 18:03:48.189186 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.189085    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:48.190691 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.190651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk" event={"ID":"ad920abb-53c7-4845-bdc1-d268eb8beaed","Type":"ContainerStarted","Data":"7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad"}
Sep 11 18:03:48.190790 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.190715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk" event={"ID":"ad920abb-53c7-4845-bdc1-d268eb8beaed","Type":"ContainerStarted","Data":"dd48935fe34fc3b39e1b291bebb97a11a3ae909c0b1299ad31ec373158d21004"}
Sep 11 18:03:48.190790 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.190750    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:03:48.218011 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.217961    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx" podStartSLOduration=2.816835408 podStartE2EDuration="3.217945159s" totalImagesPullingTime="401.109751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:48.217244261 +0000 UTC m=+1132.504778569" watchObservedRunningTime="2026-09-11 18:03:48.217945159 +0000 UTC m=+1132.505479466"
Sep 11 18:03:48.244868 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:48.244818    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8" podStartSLOduration=2.24480339 podStartE2EDuration="2.24480339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:48.242912089 +0000 UTC m=+1132.530446395" watchObservedRunningTime="2026-09-11 18:03:48.24480339 +0000 UTC m=+1132.532337697"
Sep 11 18:03:49.035424 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:49.035391    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:49.715697 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:49.715638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:49.860294 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:49.860247    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:50.369232 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:50.369170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:51.779179 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:51.779139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:51.966049 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:51.966016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:52.632783 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.632746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:52.766813 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.766780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:52.840394 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.840333    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk" podStartSLOduration=5.840315797 podStartE2EDuration="5.840315797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:48.269041535 +0000 UTC m=+1132.556575841" watchObservedRunningTime="2026-09-11 18:03:52.840315797 +0000 UTC m=+1137.127850103"
Sep 11 18:03:52.842008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.841987    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"]
Sep 11 18:03:52.845382 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.845366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:52.848522 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.848499    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-386935-dockercfg-jf99t\""
Sep 11 18:03:52.848649 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.848542    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-386935\""
Sep 11 18:03:52.874499 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.874467    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"]
Sep 11 18:03:52.932637 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.932556    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"]
Sep 11 18:03:52.935977 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.935945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:52.958539 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.958513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg75c\" (UniqueName: \"kubernetes.io/projected/30eb460d-0026-41fb-894b-2aeb630eeefa-kube-api-access-lg75c\") pod \"payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:52.958714 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.958547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30eb460d-0026-41fb-894b-2aeb630eeefa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:52.966854 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:52.966827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"]
Sep 11 18:03:53.059952 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.059914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:53.060147 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.060033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg75c\" (UniqueName: \"kubernetes.io/projected/30eb460d-0026-41fb-894b-2aeb630eeefa-kube-api-access-lg75c\") pod \"payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:53.060147 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.060058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xxmh\" (UniqueName: \"kubernetes.io/projected/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-kube-api-access-8xxmh\") pod \"payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:53.060147 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.060078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30eb460d-0026-41fb-894b-2aeb630eeefa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:53.060837 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.060808    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30eb460d-0026-41fb-894b-2aeb630eeefa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:53.073693 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.073645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg75c\" (UniqueName: \"kubernetes.io/projected/30eb460d-0026-41fb-894b-2aeb630eeefa-kube-api-access-lg75c\") pod \"payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:53.156388 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.156345    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:53.160767 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.160747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xxmh\" (UniqueName: \"kubernetes.io/projected/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-kube-api-access-8xxmh\") pod \"payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:53.160834 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.160800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:53.161446 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.161423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:53.177031 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.177001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xxmh\" (UniqueName: \"kubernetes.io/projected/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-kube-api-access-8xxmh\") pod \"payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:53.247256 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.247227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:53.371623 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.371590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:53.447585 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.447560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"]
Sep 11 18:03:53.449419 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:03:53.449394    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30eb460d_0026_41fb_894b_2aeb630eeefa.slice/crio-be38950212431d681450f0b2b0a5ee856b7d548d679811e84da766420cda7cce WatchSource:0}: Error finding container be38950212431d681450f0b2b0a5ee856b7d548d679811e84da766420cda7cce: Status 404 returned error can't find the container with id be38950212431d681450f0b2b0a5ee856b7d548d679811e84da766420cda7cce
Sep 11 18:03:53.550596 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:53.550559    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"]
Sep 11 18:03:53.564602 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:03:53.564568    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cd2eda_4870_4b5d_88a3_3d9634baf42b.slice/crio-ad331e613c83a53d1ccc12b4fd5c04b168341f12bb46d9631ce230b2aff45278 WatchSource:0}: Error finding container ad331e613c83a53d1ccc12b4fd5c04b168341f12bb46d9631ce230b2aff45278: Status 404 returned error can't find the container with id ad331e613c83a53d1ccc12b4fd5c04b168341f12bb46d9631ce230b2aff45278
Sep 11 18:03:54.201136 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.201106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:03:54.225231 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.225199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f" event={"ID":"d4cd2eda-4870-4b5d-88a3-3d9634baf42b","Type":"ContainerStarted","Data":"7d67b2900926d04859b278a8557cdce56a95b3a86d30ed5a71d64a9305ab6335"}
Sep 11 18:03:54.225421 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.225248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f" event={"ID":"d4cd2eda-4870-4b5d-88a3-3d9634baf42b","Type":"ContainerStarted","Data":"ad331e613c83a53d1ccc12b4fd5c04b168341f12bb46d9631ce230b2aff45278"}
Sep 11 18:03:54.225421 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.225279    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:03:54.227154 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.227129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh" event={"ID":"30eb460d-0026-41fb-894b-2aeb630eeefa","Type":"ContainerStarted","Data":"6df5bb147bcc84a1b4db6af2934b5ba7b86b17449e572c20ec22d8ce6f8ebdb0"}
Sep 11 18:03:54.227268 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.227175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh" event={"ID":"30eb460d-0026-41fb-894b-2aeb630eeefa","Type":"ContainerStarted","Data":"be38950212431d681450f0b2b0a5ee856b7d548d679811e84da766420cda7cce"}
Sep 11 18:03:54.227268 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.227202    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:03:54.568195 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.568119    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f" podStartSLOduration=2.5680960539999997 podStartE2EDuration="2.568096054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:54.567495284 +0000 UTC m=+1138.855029592" watchObservedRunningTime="2026-09-11 18:03:54.568096054 +0000 UTC m=+1138.855630363"
Sep 11 18:03:54.568799 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:54.568757    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh" podStartSLOduration=2.568743939 podStartE2EDuration="2.568743939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:03:54.374620211 +0000 UTC m=+1138.662154514" watchObservedRunningTime="2026-09-11 18:03:54.568743939 +0000 UTC m=+1138.856278249"
Sep 11 18:03:55.219915 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:55.219882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:03:59.197871 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:59.197840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:03:59.198294 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:03:59.197912    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:04:05.234090 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:05.234057    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:04:05.234559 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:05.234117    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:04:07.693932 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:07.693890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:11.142697 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:11.142642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:11.258263 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:11.258232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:12.051556 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:12.051515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:15.286510 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:15.286470    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:15.544408 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:15.544283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:15.845138 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:15.845102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:16.463488 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:16.463415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:16.615934 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:16.615873    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:18.114333 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:18.114299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:18.425254 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:18.425143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:19.142903 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.142853    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:19.268665 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.268628    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:19.592099 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.592059    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:19.824131 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.824097    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"]
Sep 11 18:04:19.829115 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.829095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:19.838998 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.838969    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:19.840570 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.840551    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f95803\""
Sep 11 18:04:19.860919 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.860844    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"]
Sep 11 18:04:19.886874 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.886836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb161548-7942-4cf8-afe3-79153253e805-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:19.887051 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.886925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67f88\" (UniqueName: \"kubernetes.io/projected/cb161548-7942-4cf8-afe3-79153253e805-kube-api-access-67f88\") pod \"payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:19.987548 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.987509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67f88\" (UniqueName: \"kubernetes.io/projected/cb161548-7942-4cf8-afe3-79153253e805-kube-api-access-67f88\") pod \"payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:19.987769 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.987566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb161548-7942-4cf8-afe3-79153253e805-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:19.988254 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.988232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb161548-7942-4cf8-afe3-79153253e805-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:19.996203 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.996176    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"]
Sep 11 18:04:19.999619 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:19.999599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.003749 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.003728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f95803-dockercfg-lmscp\""
Sep 11 18:04:20.013552 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.009484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67f88\" (UniqueName: \"kubernetes.io/projected/cb161548-7942-4cf8-afe3-79153253e805-kube-api-access-67f88\") pod \"payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:20.035895 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.035863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"]
Sep 11 18:04:20.088303 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.088261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hvwj\" (UniqueName: \"kubernetes.io/projected/25afd15c-1a86-475d-80ed-de71016e6c7e-kube-api-access-2hvwj\") pod \"payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.088499 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.088391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25afd15c-1a86-475d-80ed-de71016e6c7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.138807 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.138731    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:20.190523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.189431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25afd15c-1a86-475d-80ed-de71016e6c7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.190523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.189523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hvwj\" (UniqueName: \"kubernetes.io/projected/25afd15c-1a86-475d-80ed-de71016e6c7e-kube-api-access-2hvwj\") pod \"payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.190523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.190468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25afd15c-1a86-475d-80ed-de71016e6c7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.225644 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.225614    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hvwj\" (UniqueName: \"kubernetes.io/projected/25afd15c-1a86-475d-80ed-de71016e6c7e-kube-api-access-2hvwj\") pod \"payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.314384 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.314343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:20.426645 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.426620    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"]
Sep 11 18:04:20.428501 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:04:20.428473    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb161548_7942_4cf8_afe3_79153253e805.slice/crio-93fe51161bdbd0abb99721fb5db510c4c2b35aa4a4f88491b8d8b37b1d96535b WatchSource:0}: Error finding container 93fe51161bdbd0abb99721fb5db510c4c2b35aa4a4f88491b8d8b37b1d96535b: Status 404 returned error can't find the container with id 93fe51161bdbd0abb99721fb5db510c4c2b35aa4a4f88491b8d8b37b1d96535b
Sep 11 18:04:20.465531 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.465491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:20.610320 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:20.610289    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"]
Sep 11 18:04:20.613185 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:04:20.613158    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25afd15c_1a86_475d_80ed_de71016e6c7e.slice/crio-cc593d0df2fbb1b0be1b182fea6c1f457680aa50cb10dec33eb39c10a0196c0c WatchSource:0}: Error finding container cc593d0df2fbb1b0be1b182fea6c1f457680aa50cb10dec33eb39c10a0196c0c: Status 404 returned error can't find the container with id cc593d0df2fbb1b0be1b182fea6c1f457680aa50cb10dec33eb39c10a0196c0c
Sep 11 18:04:21.377602 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.377565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7" event={"ID":"25afd15c-1a86-475d-80ed-de71016e6c7e","Type":"ContainerStarted","Data":"3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41"}
Sep 11 18:04:21.378078 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.377634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7" event={"ID":"25afd15c-1a86-475d-80ed-de71016e6c7e","Type":"ContainerStarted","Data":"cc593d0df2fbb1b0be1b182fea6c1f457680aa50cb10dec33eb39c10a0196c0c"}
Sep 11 18:04:21.378078 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.377666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:21.379305 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.379282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj" event={"ID":"cb161548-7942-4cf8-afe3-79153253e805","Type":"ContainerStarted","Data":"d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b"}
Sep 11 18:04:21.379423 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.379320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj" event={"ID":"cb161548-7942-4cf8-afe3-79153253e805","Type":"ContainerStarted","Data":"93fe51161bdbd0abb99721fb5db510c4c2b35aa4a4f88491b8d8b37b1d96535b"}
Sep 11 18:04:21.379423 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.379359    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:21.465514 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.465456    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7" podStartSLOduration=2.46543984 podStartE2EDuration="2.46543984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:21.425213507 +0000 UTC m=+1165.712747815" watchObservedRunningTime="2026-09-11 18:04:21.46543984 +0000 UTC m=+1165.752974211"
Sep 11 18:04:21.465829 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:21.465791    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj" podStartSLOduration=2.465782421 podStartE2EDuration="2.465782421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:21.46391613 +0000 UTC m=+1165.751450455" watchObservedRunningTime="2026-09-11 18:04:21.465782421 +0000 UTC m=+1165.753316728"
Sep 11 18:04:22.901422 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:22.901386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:23.247129 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.247046    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"]
Sep 11 18:04:23.250435 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.250410    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.257653 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.257609    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-3ebea5\""
Sep 11 18:04:23.300222 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.300192    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"]
Sep 11 18:04:23.319757 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.319728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8213aa-52d0-4925-b1e2-f25b47992082-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.319906 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.319762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn772\" (UniqueName: \"kubernetes.io/projected/aa8213aa-52d0-4925-b1e2-f25b47992082-kube-api-access-nn772\") pod \"payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.403375 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.403339    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"]
Sep 11 18:04:23.406812 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.406790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.412778 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.412757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-3ebea5-dockercfg-dmcqv\""
Sep 11 18:04:23.420226 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.420201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8213aa-52d0-4925-b1e2-f25b47992082-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.420366 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.420233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn772\" (UniqueName: \"kubernetes.io/projected/aa8213aa-52d0-4925-b1e2-f25b47992082-kube-api-access-nn772\") pod \"payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.420900 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.420878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8213aa-52d0-4925-b1e2-f25b47992082-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.443304 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.443278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn772\" (UniqueName: \"kubernetes.io/projected/aa8213aa-52d0-4925-b1e2-f25b47992082-kube-api-access-nn772\") pod \"payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.521119 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.521030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqxg4\" (UniqueName: \"kubernetes.io/projected/a5d7c656-05eb-4288-b84d-7f1e4f311a54-kube-api-access-wqxg4\") pod \"payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.521119 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.521099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7c656-05eb-4288-b84d-7f1e4f311a54-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.561736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.561710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:23.568255 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.568227    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"]
Sep 11 18:04:23.623566 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.622599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqxg4\" (UniqueName: \"kubernetes.io/projected/a5d7c656-05eb-4288-b84d-7f1e4f311a54-kube-api-access-wqxg4\") pod \"payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.623566 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.622701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7c656-05eb-4288-b84d-7f1e4f311a54-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.623823 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.623616    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7c656-05eb-4288-b84d-7f1e4f311a54-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.674350 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.673665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqxg4\" (UniqueName: \"kubernetes.io/projected/a5d7c656-05eb-4288-b84d-7f1e4f311a54-kube-api-access-wqxg4\") pod \"payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.716991 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.716950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:23.882047 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:23.882021    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"]
Sep 11 18:04:23.884012 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:04:23.883987    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8213aa_52d0_4925_b1e2_f25b47992082.slice/crio-8663ffd89129905f816b4ae642d68a7a7d131cd6c5d514a0b2a9e8289de33da9 WatchSource:0}: Error finding container 8663ffd89129905f816b4ae642d68a7a7d131cd6c5d514a0b2a9e8289de33da9: Status 404 returned error can't find the container with id 8663ffd89129905f816b4ae642d68a7a7d131cd6c5d514a0b2a9e8289de33da9
Sep 11 18:04:24.032255 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.032171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:24.094404 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.094374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"]
Sep 11 18:04:24.102833 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:04:24.102807    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d7c656_05eb_4288_b84d_7f1e4f311a54.slice/crio-8c33b6df3fbc2fd8aff8ae155ef0eb46deea7a6e55a471f445b486550bb7b2aa WatchSource:0}: Error finding container 8c33b6df3fbc2fd8aff8ae155ef0eb46deea7a6e55a471f445b486550bb7b2aa: Status 404 returned error can't find the container with id 8c33b6df3fbc2fd8aff8ae155ef0eb46deea7a6e55a471f445b486550bb7b2aa
Sep 11 18:04:24.396699 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.396641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v" event={"ID":"a5d7c656-05eb-4288-b84d-7f1e4f311a54","Type":"ContainerStarted","Data":"c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b"}
Sep 11 18:04:24.396910 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.396720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v" event={"ID":"a5d7c656-05eb-4288-b84d-7f1e4f311a54","Type":"ContainerStarted","Data":"8c33b6df3fbc2fd8aff8ae155ef0eb46deea7a6e55a471f445b486550bb7b2aa"}
Sep 11 18:04:24.396910 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.396841    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:24.398201 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.398173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7" event={"ID":"aa8213aa-52d0-4925-b1e2-f25b47992082","Type":"ContainerStarted","Data":"4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978"}
Sep 11 18:04:24.398313 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.398209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7" event={"ID":"aa8213aa-52d0-4925-b1e2-f25b47992082","Type":"ContainerStarted","Data":"8663ffd89129905f816b4ae642d68a7a7d131cd6c5d514a0b2a9e8289de33da9"}
Sep 11 18:04:24.398395 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.398321    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:24.442814 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.442773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:24.455665 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.455605    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v" podStartSLOduration=1.455584995 podStartE2EDuration="1.455584995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:24.452629273 +0000 UTC m=+1168.740163579" watchObservedRunningTime="2026-09-11 18:04:24.455584995 +0000 UTC m=+1168.743119303"
Sep 11 18:04:24.493516 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:24.493467    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7" podStartSLOduration=1.493449388 podStartE2EDuration="1.493449388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:04:24.492342416 +0000 UTC m=+1168.779876724" watchObservedRunningTime="2026-09-11 18:04:24.493449388 +0000 UTC m=+1168.780983752"
Sep 11 18:04:25.633107 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:25.633068    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:25.836516 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:25.836454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:26.977829 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:26.977784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:27.984177 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:27.984145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:28.813666 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:28.813634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:28.951310 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:28.951279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:29.820429 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:29.820385    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:31.112100 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:31.112065    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:32.254773 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:32.254740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:32.387089 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:32.387057    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:04:32.387257 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:32.387146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:04:33.658293 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:33.658243    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:35.404913 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:35.404881    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:04:35.405312 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:35.405012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:04:35.968291 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:35.968254    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:37.092352 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:37.092317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:37.925141 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:37.925107    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:38.929770 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:38.929738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:39.119718 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:39.119686    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:39.623863 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:39.623817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:40.166641 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:40.166605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:40.311023 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:40.310995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:40.540722 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:40.540597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:41.340346 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:41.340307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:42.464214 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:42.464178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:43.057858 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:43.057813    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:43.179097 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:43.179056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:44.125246 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:44.125212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:44.755430 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:44.755382    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:46.007635 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:46.007607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:46.986223 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:46.986187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:47.106016 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:47.105984    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:47.968858 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:47.968794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:48.057915 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:48.057887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:48.159978 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:48.159950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:48.571052 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:48.571019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:48.674299 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:48.674262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:04:58.041000 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:04:58.040970    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:10.778456 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:10.778415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:11.890515 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:11.890476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:12.949690 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:12.949634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:13.205552 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:13.205456    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:13.993849 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:13.993818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:15.559432 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:15.559397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:16.967787 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:16.967749    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:29.941287 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:29.941250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:44.148660 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:44.148621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:05:44.414528 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:05:44.414438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:20.713096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:20.713015    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:24.135547 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:24.135511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:25.304050 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:25.304014    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:26.620033 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:26.619983    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:27.772380 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:27.772344    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:29.010724 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:29.010691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:30.257606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:30.257575    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:31.647885 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:31.647846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:39.740245 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:39.740205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:39.871181 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:39.871145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:39.986312 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:39.986270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:40.107837 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:40.107804    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:40.335344 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:40.335311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:40.756492 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:40.756457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:42.353509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:42.353474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:43.516052 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:43.516016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:43.907331 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:43.907299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:44.976825 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:44.976785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:46.518533 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:46.518502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:49.153947 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:49.153910    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:56.341957 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:56.341889    2576 scope.go:117] "RemoveContainer" containerID="4c3ed66cca80dce85383b57b8b1431bed061a227dc48b866810c706a1a15dc15"
Sep 11 18:06:57.736385 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:57.736339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:06:57.980859 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:06:57.980822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:25.954328 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:25.954238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:29.395636 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:29.395599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:36.242694 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:36.242627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:36.395561 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:36.395531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:36.629994 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:36.629948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:38.075608 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:38.075572    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:38.211266 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:38.211177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:38.952188 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:38.952151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:39.146918 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:39.146882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:40.625923 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:40.625891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:45.218974 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:45.218937    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:47.625294 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:47.625260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:47.845694 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:47.845643    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:48.374107 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:48.374072    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:56.996548 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:56.996504    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:57.182255 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:57.182224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:07:57.337265 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:07:57.337232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:00.202589 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:00.202554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:01.187969 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:01.187932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:07.871723 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:07.871666    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:08.076824 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:08.076792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:09.612382 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:09.612346    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:29.109178 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:29.109140    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:35.092666 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:35.092632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:35.950791 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:35.950760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:36.055419 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:36.055387    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:36.353100 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:36.353067    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:36.720604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:36.720517    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:36.971868 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:36.971784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:38.980985 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:38.980954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:39.656605 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:39.656572    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:39.802543 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:39.802511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:40.544552 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:40.544522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:41.684665 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:41.684624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:43.001726 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:43.001694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:44.111827 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:44.111793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:45.247180 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:45.247137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:45.469231 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:45.469200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:45.815547 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:45.815508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:46.584540 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:46.584502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:46.858799 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:46.858658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:59.830278 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:59.830238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:08:59.930149 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:08:59.930115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:09.137259 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:09.137221    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:09.805489 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:09.805452    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:10.372743 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:10.372712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:10.735907 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:10.735818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:11.037420 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:11.037322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:11.363222 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:11.363185    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:12.307576 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:12.307546    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:14.073537 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:14.073501    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:15.235329 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:15.235299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:15.406999 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:15.406965    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:15.908814 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:15.908784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:16.373155 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:16.373123    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:17.870280 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:17.870244    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:19.702877 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.702845    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"]
Sep 11 18:09:19.706411 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.706394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.713578 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.713559    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f1705a-serving-cert\""
Sep 11 18:09:19.729118 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.729088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"]
Sep 11 18:09:19.768116 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.768076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:19.790528 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.790493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlltz\" (UniqueName: \"kubernetes.io/projected/30012a71-39c9-489b-bb67-4ed890efb457-kube-api-access-mlltz\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.790719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.790534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30012a71-39c9-489b-bb67-4ed890efb457-openshift-service-ca\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.790719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.790558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-metrics-certs\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.790719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.790601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.891969 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.891924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30012a71-39c9-489b-bb67-4ed890efb457-openshift-service-ca\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.891969 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.891970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-metrics-certs\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.892191 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.891994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.892191 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.892091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlltz\" (UniqueName: \"kubernetes.io/projected/30012a71-39c9-489b-bb67-4ed890efb457-kube-api-access-mlltz\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.892191 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:09:19.892173    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-serving-cert: secret "maas-api-e2e-api-b-f1705a-serving-cert" not found
Sep 11 18:09:19.892290 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:09:19.892258    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls podName:30012a71-39c9-489b-bb67-4ed890efb457 nodeName:}" failed. No retries permitted until 2026-09-11 18:09:20.392235477 +0000 UTC m=+1464.679769764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls") pod "maas-api-e2e-api-b-f1705a-7688d87c6-29clj" (UID: "30012a71-39c9-489b-bb67-4ed890efb457") : secret "maas-api-e2e-api-b-f1705a-serving-cert" not found
Sep 11 18:09:19.892810 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.892783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30012a71-39c9-489b-bb67-4ed890efb457-openshift-service-ca\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.894600 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.894575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-metrics-certs\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.905424 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.905398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlltz\" (UniqueName: \"kubernetes.io/projected/30012a71-39c9-489b-bb67-4ed890efb457-kube-api-access-mlltz\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:19.946440 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:19.946393    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:20.095740 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.095706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:20.396610 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.396526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:20.399041 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.399020    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls\") pod \"maas-api-e2e-api-b-f1705a-7688d87c6-29clj\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:20.616918 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.616876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:20.637597 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.637564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:20.816607 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.816579    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:20.875553 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.875512    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"]
Sep 11 18:09:20.880293 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.880275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:20.885748 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.885729    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-f1705a\""
Sep 11 18:09:20.885858 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.885818    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-f1705a-dockercfg-kd5vf\""
Sep 11 18:09:20.904813 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.904784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"]
Sep 11 18:09:20.914968 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.914938    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"]
Sep 11 18:09:20.919071 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:09:20.919016    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30012a71_39c9_489b_bb67_4ed890efb457.slice/crio-eec23719ac570e8f2d4d715ab60d3a88e08d0545ac8d8eaecdf6d7c0b0ed5746 WatchSource:0}: Error finding container eec23719ac570e8f2d4d715ab60d3a88e08d0545ac8d8eaecdf6d7c0b0ed5746: Status 404 returned error can't find the container with id eec23719ac570e8f2d4d715ab60d3a88e08d0545ac8d8eaecdf6d7c0b0ed5746
Sep 11 18:09:20.920951 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:20.920933    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:09:21.002303 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.002266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95038938-0c36-407d-a53c-dc4d7d1a3a81-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.002476 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.002314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6kl\" (UniqueName: \"kubernetes.io/projected/95038938-0c36-407d-a53c-dc4d7d1a3a81-kube-api-access-ct6kl\") pod \"payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.102798 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.102766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95038938-0c36-407d-a53c-dc4d7d1a3a81-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.102959 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.102819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6kl\" (UniqueName: \"kubernetes.io/projected/95038938-0c36-407d-a53c-dc4d7d1a3a81-kube-api-access-ct6kl\") pod \"payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.103589 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.103571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95038938-0c36-407d-a53c-dc4d7d1a3a81-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.118327 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.118290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6kl\" (UniqueName: \"kubernetes.io/projected/95038938-0c36-407d-a53c-dc4d7d1a3a81-kube-api-access-ct6kl\") pod \"payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.191026 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.190940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.321544 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.321515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:21.481685 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.481593    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"]
Sep 11 18:09:21.490061 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:09:21.490035    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95038938_0c36_407d_a53c_dc4d7d1a3a81.slice/crio-99bc9331dbacf2282ea394e25f8bb3a529c1db9271b5f7f9a301938979f3756c WatchSource:0}: Error finding container 99bc9331dbacf2282ea394e25f8bb3a529c1db9271b5f7f9a301938979f3756c: Status 404 returned error can't find the container with id 99bc9331dbacf2282ea394e25f8bb3a529c1db9271b5f7f9a301938979f3756c
Sep 11 18:09:21.855479 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.855443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk" event={"ID":"95038938-0c36-407d-a53c-dc4d7d1a3a81","Type":"ContainerStarted","Data":"edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277"}
Sep 11 18:09:21.856004 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.855503    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:21.856004 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.855534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk" event={"ID":"95038938-0c36-407d-a53c-dc4d7d1a3a81","Type":"ContainerStarted","Data":"99bc9331dbacf2282ea394e25f8bb3a529c1db9271b5f7f9a301938979f3756c"}
Sep 11 18:09:21.857024 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.857003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj" event={"ID":"30012a71-39c9-489b-bb67-4ed890efb457","Type":"ContainerStarted","Data":"ff7f6046b01701245abb9bb29400f4741c1c7b43ab05ecdff9d3845d7885b247"}
Sep 11 18:09:21.857112 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.857050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj" event={"ID":"30012a71-39c9-489b-bb67-4ed890efb457","Type":"ContainerStarted","Data":"eec23719ac570e8f2d4d715ab60d3a88e08d0545ac8d8eaecdf6d7c0b0ed5746"}
Sep 11 18:09:21.857112 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.857070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:21.889929 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.889879    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk" podStartSLOduration=1.8898634159999999 podStartE2EDuration="1.889863416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:09:21.884860725 +0000 UTC m=+1466.172395031" watchObservedRunningTime="2026-09-11 18:09:21.889863416 +0000 UTC m=+1466.177397749"
Sep 11 18:09:21.913081 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:21.913034    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj" podStartSLOduration=2.553119708 podStartE2EDuration="2.913016115s" totalImagesPullingTime="359.896407ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:09:21.910849895 +0000 UTC m=+1466.198384202" watchObservedRunningTime="2026-09-11 18:09:21.913016115 +0000 UTC m=+1466.200550423"
Sep 11 18:09:22.834942 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:22.834904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:24.282340 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:24.282311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:25.281636 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:25.281578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:26.573510 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:26.573472    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:27.869397 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:27.869360    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:09:32.866726 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:32.866666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:09:41.928280 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:41.928211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:42.796846 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:42.796805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:43.224789 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:43.224653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:44.294893 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:44.294851    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:45.185739 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:45.185672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:45.645775 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:45.645742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:46.967731 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:46.967692    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:48.028266 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:48.028230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:49.109472 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:49.109441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:50.501466 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:50.501434    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:51.683693 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:51.683643    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:52.979943 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:52.979911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:54.168784 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:54.168733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:55.151630 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:55.151592    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:55.314324 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:55.314289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:55.452947 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:55.452851    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:56.442355 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:56.442314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:58.706177 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:58.706136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:09:58.853046 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:09:58.853012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:02.772401 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:02.772366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:04.697308 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:04.697272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:04.810840 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:04.810799    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:04.926569 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:04.926307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:05.054349 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:05.054317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:05.403402 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:05.403304    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:05.516369 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:05.516332    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:06.381512 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:06.381478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:07.716220 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:07.716187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:09.145258 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:09.145223    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:10.195161 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:10.195127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:11.439818 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:11.439784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:12.975408 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:12.975350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:13.126181 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:13.126147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:13.345320 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:13.345286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:14.041968 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:14.041933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:15.581207 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:15.581172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:17.242538 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:17.242449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:18.653446 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:18.653409    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:19.933415 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:19.933383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:21.693232 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:21.693197    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:22.614825 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:22.614793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:23.096385 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:23.096345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:29.074350 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.074311    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"]
Sep 11 18:10:29.075015 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.074538    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj" podUID="30012a71-39c9-489b-bb67-4ed890efb457" containerName="maas-api" containerID="cri-o://ff7f6046b01701245abb9bb29400f4741c1c7b43ab05ecdff9d3845d7885b247" gracePeriod=30
Sep 11 18:10:29.152890 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.152857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:29.203232 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.203200    2576 generic.go:356] "Generic (PLEG): container finished" podID="30012a71-39c9-489b-bb67-4ed890efb457" containerID="ff7f6046b01701245abb9bb29400f4741c1c7b43ab05ecdff9d3845d7885b247" exitCode=0
Sep 11 18:10:29.203408 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.203279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj" event={"ID":"30012a71-39c9-489b-bb67-4ed890efb457","Type":"ContainerDied","Data":"ff7f6046b01701245abb9bb29400f4741c1c7b43ab05ecdff9d3845d7885b247"}
Sep 11 18:10:29.205977 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.205948    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"]
Sep 11 18:10:29.206183 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.206160    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk" podUID="95038938-0c36-407d-a53c-dc4d7d1a3a81" containerName="payload-pre-processing" containerID="cri-o://edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277" gracePeriod=30
Sep 11 18:10:29.282298 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.282163    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:29.340317 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.340290    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:10:29.387901 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.387872    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:29.472117 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.472094    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:10:29.497444 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.497411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:29.513641 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.513611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-metrics-certs\") pod \"30012a71-39c9-489b-bb67-4ed890efb457\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") "
Sep 11 18:10:29.513835 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.513703    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30012a71-39c9-489b-bb67-4ed890efb457-openshift-service-ca\") pod \"30012a71-39c9-489b-bb67-4ed890efb457\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") "
Sep 11 18:10:29.513835 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.513732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls\") pod \"30012a71-39c9-489b-bb67-4ed890efb457\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") "
Sep 11 18:10:29.513835 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.513765    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlltz\" (UniqueName: \"kubernetes.io/projected/30012a71-39c9-489b-bb67-4ed890efb457-kube-api-access-mlltz\") pod \"30012a71-39c9-489b-bb67-4ed890efb457\" (UID: \"30012a71-39c9-489b-bb67-4ed890efb457\") "
Sep 11 18:10:29.514361 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.514330    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30012a71-39c9-489b-bb67-4ed890efb457-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "30012a71-39c9-489b-bb67-4ed890efb457" (UID: "30012a71-39c9-489b-bb67-4ed890efb457"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:29.516413 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.516386    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "30012a71-39c9-489b-bb67-4ed890efb457" (UID: "30012a71-39c9-489b-bb67-4ed890efb457"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:10:29.516769 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.516741    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "30012a71-39c9-489b-bb67-4ed890efb457" (UID: "30012a71-39c9-489b-bb67-4ed890efb457"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:10:29.516879 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.516845    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30012a71-39c9-489b-bb67-4ed890efb457-kube-api-access-mlltz" (OuterVolumeSpecName: "kube-api-access-mlltz") pod "30012a71-39c9-489b-bb67-4ed890efb457" (UID: "30012a71-39c9-489b-bb67-4ed890efb457"). InnerVolumeSpecName "kube-api-access-mlltz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:29.614912 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.614819    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct6kl\" (UniqueName: \"kubernetes.io/projected/95038938-0c36-407d-a53c-dc4d7d1a3a81-kube-api-access-ct6kl\") pod \"95038938-0c36-407d-a53c-dc4d7d1a3a81\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") "
Sep 11 18:10:29.614912 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.614871    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95038938-0c36-407d-a53c-dc4d7d1a3a81-plugins-config-volume\") pod \"95038938-0c36-407d-a53c-dc4d7d1a3a81\" (UID: \"95038938-0c36-407d-a53c-dc4d7d1a3a81\") "
Sep 11 18:10:29.615127 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.615115    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:29.615164 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.615132    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30012a71-39c9-489b-bb67-4ed890efb457-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:29.615164 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.615143    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30012a71-39c9-489b-bb67-4ed890efb457-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:29.615164 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.615152    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlltz\" (UniqueName: \"kubernetes.io/projected/30012a71-39c9-489b-bb67-4ed890efb457-kube-api-access-mlltz\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:29.615259 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.615234    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95038938-0c36-407d-a53c-dc4d7d1a3a81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95038938-0c36-407d-a53c-dc4d7d1a3a81" (UID: "95038938-0c36-407d-a53c-dc4d7d1a3a81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:29.617131 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.617103    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95038938-0c36-407d-a53c-dc4d7d1a3a81-kube-api-access-ct6kl" (OuterVolumeSpecName: "kube-api-access-ct6kl") pod "95038938-0c36-407d-a53c-dc4d7d1a3a81" (UID: "95038938-0c36-407d-a53c-dc4d7d1a3a81"). InnerVolumeSpecName "kube-api-access-ct6kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:29.631744 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.631715    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:29.716068 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.716030    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95038938-0c36-407d-a53c-dc4d7d1a3a81-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:29.716068 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.716064    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct6kl\" (UniqueName: \"kubernetes.io/projected/95038938-0c36-407d-a53c-dc4d7d1a3a81-kube-api-access-ct6kl\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:29.962584 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:29.962483    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:30.078242 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.078202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:30.209243 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.209206    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"
Sep 11 18:10:30.209449 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.209240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj" event={"ID":"30012a71-39c9-489b-bb67-4ed890efb457","Type":"ContainerDied","Data":"eec23719ac570e8f2d4d715ab60d3a88e08d0545ac8d8eaecdf6d7c0b0ed5746"}
Sep 11 18:10:30.209449 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.209307    2576 scope.go:117] "RemoveContainer" containerID="ff7f6046b01701245abb9bb29400f4741c1c7b43ab05ecdff9d3845d7885b247"
Sep 11 18:10:30.210773 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.210556    2576 generic.go:356] "Generic (PLEG): container finished" podID="95038938-0c36-407d-a53c-dc4d7d1a3a81" containerID="edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277" exitCode=0
Sep 11 18:10:30.210773 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.210599    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"
Sep 11 18:10:30.210773 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.210612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk" event={"ID":"95038938-0c36-407d-a53c-dc4d7d1a3a81","Type":"ContainerDied","Data":"edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277"}
Sep 11 18:10:30.210773 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.210649    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk" event={"ID":"95038938-0c36-407d-a53c-dc4d7d1a3a81","Type":"ContainerDied","Data":"99bc9331dbacf2282ea394e25f8bb3a529c1db9271b5f7f9a301938979f3756c"}
Sep 11 18:10:30.218421 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.218394    2576 scope.go:117] "RemoveContainer" containerID="edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277"
Sep 11 18:10:30.226935 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.226917    2576 scope.go:117] "RemoveContainer" containerID="edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277"
Sep 11 18:10:30.227234 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:10:30.227214    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277\": container with ID starting with edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277 not found: ID does not exist" containerID="edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277"
Sep 11 18:10:30.227298 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.227245    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277"} err="failed to get container status \"edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277\": rpc error: code = NotFound desc = could not find container \"edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277\": container with ID starting with edd647a9f9d733d1c112746ae576bad3a600cf81ec21f8ab4aa4ec997f663277 not found: ID does not exist"
Sep 11 18:10:30.242000 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.241973    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"]
Sep 11 18:10:30.247057 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.247030    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk"]
Sep 11 18:10:30.272139 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.272108    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"]
Sep 11 18:10:30.282186 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:30.282150    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f1705a-7688d87c6-29clj"]
Sep 11 18:10:31.223686 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:31.223655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:32.242703 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:32.241076    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30012a71-39c9-489b-bb67-4ed890efb457" path="/var/lib/kubelet/pods/30012a71-39c9-489b-bb67-4ed890efb457/volumes"
Sep 11 18:10:32.242703 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:32.241617    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95038938-0c36-407d-a53c-dc4d7d1a3a81" path="/var/lib/kubelet/pods/95038938-0c36-407d-a53c-dc4d7d1a3a81/volumes"
Sep 11 18:10:33.679998 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:33.679962    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:33.899509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:33.899470    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:34.458132 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:34.458093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:36.789060 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:36.789026    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:36.960015 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:36.959981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:37.185150 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:37.185115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:37.769739 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:37.769704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:38.904553 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:38.904519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:39.763621 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:39.763587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:40.568506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:40.568473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:41.498281 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:41.498249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:42.464407 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:42.464368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:45.569718 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:45.569667    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:47.675510 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:47.675448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:48.314561 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.314530    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"]
Sep 11 18:10:48.314808 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.314784    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx" podUID="01e09cf0-ec74-4a69-ad41-052aaacccabb" containerName="maas-api" containerID="cri-o://042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd" gracePeriod=30
Sep 11 18:10:48.357429 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.357395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:48.403986 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.403947    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"]
Sep 11 18:10:48.404195 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.404169    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk" podUID="ad920abb-53c7-4845-bdc1-d268eb8beaed" containerName="payload-processing" containerID="cri-o://7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad" gracePeriod=30
Sep 11 18:10:48.423115 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.423093    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"]
Sep 11 18:10:48.423301 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.423280    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8" podUID="21a3b767-aab3-43f2-b787-29c868e729a1" containerName="payload-pre-processing" containerID="cri-o://b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25" gracePeriod=30
Sep 11 18:10:48.462144 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.462113    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:48.561450 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.561306    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:48.666820 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.666603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:48.671592 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.669844    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:10:48.701395 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.701345    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:10:48.718499 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.718475    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:10:48.782076 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a3b767-aab3-43f2-b787-29c868e729a1-plugins-config-volume\") pod \"21a3b767-aab3-43f2-b787-29c868e729a1\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") "
Sep 11 18:10:48.782076 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782077    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfpxv\" (UniqueName: \"kubernetes.io/projected/ad920abb-53c7-4845-bdc1-d268eb8beaed-kube-api-access-qfpxv\") pod \"ad920abb-53c7-4845-bdc1-d268eb8beaed\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") "
Sep 11 18:10:48.782282 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782110    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad920abb-53c7-4845-bdc1-d268eb8beaed-plugins-config-volume\") pod \"ad920abb-53c7-4845-bdc1-d268eb8beaed\" (UID: \"ad920abb-53c7-4845-bdc1-d268eb8beaed\") "
Sep 11 18:10:48.782282 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782136    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf7jj\" (UniqueName: \"kubernetes.io/projected/21a3b767-aab3-43f2-b787-29c868e729a1-kube-api-access-xf7jj\") pod \"21a3b767-aab3-43f2-b787-29c868e729a1\" (UID: \"21a3b767-aab3-43f2-b787-29c868e729a1\") "
Sep 11 18:10:48.782282 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782189    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls\") pod \"01e09cf0-ec74-4a69-ad41-052aaacccabb\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") "
Sep 11 18:10:48.782282 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782234    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjtgz\" (UniqueName: \"kubernetes.io/projected/01e09cf0-ec74-4a69-ad41-052aaacccabb-kube-api-access-pjtgz\") pod \"01e09cf0-ec74-4a69-ad41-052aaacccabb\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") "
Sep 11 18:10:48.782282 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782263    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e09cf0-ec74-4a69-ad41-052aaacccabb-openshift-service-ca\") pod \"01e09cf0-ec74-4a69-ad41-052aaacccabb\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") "
Sep 11 18:10:48.782552 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782347    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-metrics-certs\") pod \"01e09cf0-ec74-4a69-ad41-052aaacccabb\" (UID: \"01e09cf0-ec74-4a69-ad41-052aaacccabb\") "
Sep 11 18:10:48.782552 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782477    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21a3b767-aab3-43f2-b787-29c868e729a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21a3b767-aab3-43f2-b787-29c868e729a1" (UID: "21a3b767-aab3-43f2-b787-29c868e729a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:48.782698 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782566    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad920abb-53c7-4845-bdc1-d268eb8beaed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad920abb-53c7-4845-bdc1-d268eb8beaed" (UID: "ad920abb-53c7-4845-bdc1-d268eb8beaed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:48.782698 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.782594    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a3b767-aab3-43f2-b787-29c868e729a1-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:48.783163 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.783087    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e09cf0-ec74-4a69-ad41-052aaacccabb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01e09cf0-ec74-4a69-ad41-052aaacccabb" (UID: "01e09cf0-ec74-4a69-ad41-052aaacccabb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:10:48.785273 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.785228    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01e09cf0-ec74-4a69-ad41-052aaacccabb" (UID: "01e09cf0-ec74-4a69-ad41-052aaacccabb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:10:48.785372 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.785297    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01e09cf0-ec74-4a69-ad41-052aaacccabb-kube-api-access-pjtgz" (OuterVolumeSpecName: "kube-api-access-pjtgz") pod "01e09cf0-ec74-4a69-ad41-052aaacccabb" (UID: "01e09cf0-ec74-4a69-ad41-052aaacccabb"). InnerVolumeSpecName "kube-api-access-pjtgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:48.785429 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.785400    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "01e09cf0-ec74-4a69-ad41-052aaacccabb" (UID: "01e09cf0-ec74-4a69-ad41-052aaacccabb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:10:48.785719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.785663    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad920abb-53c7-4845-bdc1-d268eb8beaed-kube-api-access-qfpxv" (OuterVolumeSpecName: "kube-api-access-qfpxv") pod "ad920abb-53c7-4845-bdc1-d268eb8beaed" (UID: "ad920abb-53c7-4845-bdc1-d268eb8beaed"). InnerVolumeSpecName "kube-api-access-qfpxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:48.786054 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.786032    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a3b767-aab3-43f2-b787-29c868e729a1-kube-api-access-xf7jj" (OuterVolumeSpecName: "kube-api-access-xf7jj") pod "21a3b767-aab3-43f2-b787-29c868e729a1" (UID: "21a3b767-aab3-43f2-b787-29c868e729a1"). InnerVolumeSpecName "kube-api-access-xf7jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:10:48.794707 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.794658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:48.883736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.883614    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjtgz\" (UniqueName: \"kubernetes.io/projected/01e09cf0-ec74-4a69-ad41-052aaacccabb-kube-api-access-pjtgz\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:48.883736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.883655    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e09cf0-ec74-4a69-ad41-052aaacccabb-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:48.883736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.883670    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:48.883736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.883704    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfpxv\" (UniqueName: \"kubernetes.io/projected/ad920abb-53c7-4845-bdc1-d268eb8beaed-kube-api-access-qfpxv\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:48.883736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.883718    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad920abb-53c7-4845-bdc1-d268eb8beaed-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:48.883736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.883731    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf7jj\" (UniqueName: \"kubernetes.io/projected/21a3b767-aab3-43f2-b787-29c868e729a1-kube-api-access-xf7jj\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:48.884166 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:48.883744    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e09cf0-ec74-4a69-ad41-052aaacccabb-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:10:49.044417 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.044380    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:49.158467 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.158385    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:49.308099 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.308060    2576 generic.go:356] "Generic (PLEG): container finished" podID="21a3b767-aab3-43f2-b787-29c868e729a1" containerID="b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25" exitCode=0
Sep 11 18:10:49.308284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.308106    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"
Sep 11 18:10:49.308284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.308144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8" event={"ID":"21a3b767-aab3-43f2-b787-29c868e729a1","Type":"ContainerDied","Data":"b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25"}
Sep 11 18:10:49.308284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.308200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8" event={"ID":"21a3b767-aab3-43f2-b787-29c868e729a1","Type":"ContainerDied","Data":"c02c1aadaf8f3bf738a96a10dcfca6173ef02001811081250004fd8cb7007802"}
Sep 11 18:10:49.308284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.308227    2576 scope.go:117] "RemoveContainer" containerID="b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25"
Sep 11 18:10:49.309451 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.309424    2576 generic.go:356] "Generic (PLEG): container finished" podID="ad920abb-53c7-4845-bdc1-d268eb8beaed" containerID="7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad" exitCode=0
Sep 11 18:10:49.309451 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.309459    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"
Sep 11 18:10:49.309646 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.309515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk" event={"ID":"ad920abb-53c7-4845-bdc1-d268eb8beaed","Type":"ContainerDied","Data":"7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad"}
Sep 11 18:10:49.309646 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.309564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk" event={"ID":"ad920abb-53c7-4845-bdc1-d268eb8beaed","Type":"ContainerDied","Data":"dd48935fe34fc3b39e1b291bebb97a11a3ae909c0b1299ad31ec373158d21004"}
Sep 11 18:10:49.311408 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.311381    2576 generic.go:356] "Generic (PLEG): container finished" podID="01e09cf0-ec74-4a69-ad41-052aaacccabb" containerID="042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd" exitCode=0
Sep 11 18:10:49.311523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.311414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx" event={"ID":"01e09cf0-ec74-4a69-ad41-052aaacccabb","Type":"ContainerDied","Data":"042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd"}
Sep 11 18:10:49.311523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.311478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx" event={"ID":"01e09cf0-ec74-4a69-ad41-052aaacccabb","Type":"ContainerDied","Data":"7984d4e3c9ef8119fd46dd76d8d949704ee6f05463740f459620e25eac90ef37"}
Sep 11 18:10:49.311523 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.311425    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"
Sep 11 18:10:49.317738 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.317481    2576 scope.go:117] "RemoveContainer" containerID="b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25"
Sep 11 18:10:49.317803 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:10:49.317787    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25\": container with ID starting with b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25 not found: ID does not exist" containerID="b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25"
Sep 11 18:10:49.317855 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.317814    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25"} err="failed to get container status \"b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25\": rpc error: code = NotFound desc = could not find container \"b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25\": container with ID starting with b2d8ac22f95ae7f242013c3159ccdfe9e87232af048c65aff19c567301f60a25 not found: ID does not exist"
Sep 11 18:10:49.317855 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.317836    2576 scope.go:117] "RemoveContainer" containerID="7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad"
Sep 11 18:10:49.335368 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.335344    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"]
Sep 11 18:10:49.339245 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.339219    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8"]
Sep 11 18:10:49.340769 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.340744    2576 scope.go:117] "RemoveContainer" containerID="7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad"
Sep 11 18:10:49.341117 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:10:49.341097    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad\": container with ID starting with 7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad not found: ID does not exist" containerID="7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad"
Sep 11 18:10:49.341182 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.341128    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad"} err="failed to get container status \"7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad\": rpc error: code = NotFound desc = could not find container \"7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad\": container with ID starting with 7b1412d82f7fb1982648e73bf39a4fab50b8048fe977165c598fb33efdbd75ad not found: ID does not exist"
Sep 11 18:10:49.341182 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.341154    2576 scope.go:117] "RemoveContainer" containerID="042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd"
Sep 11 18:10:49.349498 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.349468    2576 scope.go:117] "RemoveContainer" containerID="042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd"
Sep 11 18:10:49.349929 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:10:49.349909    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd\": container with ID starting with 042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd not found: ID does not exist" containerID="042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd"
Sep 11 18:10:49.349990 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.349935    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd"} err="failed to get container status \"042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd\": rpc error: code = NotFound desc = could not find container \"042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd\": container with ID starting with 042b903a1a2bea07e8069db4d34a69a786810115a434282a7e737e6f3af476dd not found: ID does not exist"
Sep 11 18:10:49.356980 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.356959    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"]
Sep 11 18:10:49.361364 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.361335    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-fd32cd-7cdfdb9756-zp5gx"]
Sep 11 18:10:49.382869 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.382845    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"]
Sep 11 18:10:49.386069 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.386042    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk"]
Sep 11 18:10:49.994025 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:49.993989    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:50.239970 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:50.239939    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01e09cf0-ec74-4a69-ad41-052aaacccabb" path="/var/lib/kubelet/pods/01e09cf0-ec74-4a69-ad41-052aaacccabb/volumes"
Sep 11 18:10:50.240284 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:50.240271    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a3b767-aab3-43f2-b787-29c868e729a1" path="/var/lib/kubelet/pods/21a3b767-aab3-43f2-b787-29c868e729a1/volumes"
Sep 11 18:10:50.240586 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:50.240572    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad920abb-53c7-4845-bdc1-d268eb8beaed" path="/var/lib/kubelet/pods/ad920abb-53c7-4845-bdc1-d268eb8beaed/volumes"
Sep 11 18:10:51.286342 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:51.286304    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:51.939401 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:51.939360    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:56.286445 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:56.286413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:56.673220 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:56.673188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:56.824850 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:56.824818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:57.396964 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:57.396927    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:58.743108 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:58.743060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:59.746265 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:10:59.746230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:00.734921 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:00.734888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:01.807436 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:01.807393    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:07.639757 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.639719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:07.677747 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.677712    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"]
Sep 11 18:11:07.678100 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.678057    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj" podUID="cb161548-7942-4cf8-afe3-79153253e805" containerName="payload-processing" containerID="cri-o://d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b" gracePeriod=30
Sep 11 18:11:07.688347 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.688317    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"]
Sep 11 18:11:07.688630 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.688597    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7" podUID="25afd15c-1a86-475d-80ed-de71016e6c7e" containerName="payload-pre-processing" containerID="cri-o://3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41" gracePeriod=30
Sep 11 18:11:07.726203 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.726171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:07.800865 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.800827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:07.902488 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.902456    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:07.943196 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.943171    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:11:07.978208 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.978178    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:11:07.980936 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:07.980907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:08.051089 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.051051    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb161548-7942-4cf8-afe3-79153253e805-plugins-config-volume\") pod \"cb161548-7942-4cf8-afe3-79153253e805\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") "
Sep 11 18:11:08.051266 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.051114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hvwj\" (UniqueName: \"kubernetes.io/projected/25afd15c-1a86-475d-80ed-de71016e6c7e-kube-api-access-2hvwj\") pod \"25afd15c-1a86-475d-80ed-de71016e6c7e\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") "
Sep 11 18:11:08.051266 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.051173    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67f88\" (UniqueName: \"kubernetes.io/projected/cb161548-7942-4cf8-afe3-79153253e805-kube-api-access-67f88\") pod \"cb161548-7942-4cf8-afe3-79153253e805\" (UID: \"cb161548-7942-4cf8-afe3-79153253e805\") "
Sep 11 18:11:08.051266 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.051190    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25afd15c-1a86-475d-80ed-de71016e6c7e-plugins-config-volume\") pod \"25afd15c-1a86-475d-80ed-de71016e6c7e\" (UID: \"25afd15c-1a86-475d-80ed-de71016e6c7e\") "
Sep 11 18:11:08.051621 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.051589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb161548-7942-4cf8-afe3-79153253e805-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb161548-7942-4cf8-afe3-79153253e805" (UID: "cb161548-7942-4cf8-afe3-79153253e805"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:11:08.051785 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.051622    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25afd15c-1a86-475d-80ed-de71016e6c7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25afd15c-1a86-475d-80ed-de71016e6c7e" (UID: "25afd15c-1a86-475d-80ed-de71016e6c7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:11:08.053500 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.053473    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25afd15c-1a86-475d-80ed-de71016e6c7e-kube-api-access-2hvwj" (OuterVolumeSpecName: "kube-api-access-2hvwj") pod "25afd15c-1a86-475d-80ed-de71016e6c7e" (UID: "25afd15c-1a86-475d-80ed-de71016e6c7e"). InnerVolumeSpecName "kube-api-access-2hvwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:11:08.053571 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.053514    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb161548-7942-4cf8-afe3-79153253e805-kube-api-access-67f88" (OuterVolumeSpecName: "kube-api-access-67f88") pod "cb161548-7942-4cf8-afe3-79153253e805" (UID: "cb161548-7942-4cf8-afe3-79153253e805"). InnerVolumeSpecName "kube-api-access-67f88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:11:08.151794 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.151701    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb161548-7942-4cf8-afe3-79153253e805-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:11:08.151794 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.151733    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hvwj\" (UniqueName: \"kubernetes.io/projected/25afd15c-1a86-475d-80ed-de71016e6c7e-kube-api-access-2hvwj\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:11:08.151794 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.151742    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67f88\" (UniqueName: \"kubernetes.io/projected/cb161548-7942-4cf8-afe3-79153253e805-kube-api-access-67f88\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:11:08.151794 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.151752    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25afd15c-1a86-475d-80ed-de71016e6c7e-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:11:08.333306 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.333269    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:08.412417 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.412324    2576 generic.go:356] "Generic (PLEG): container finished" podID="25afd15c-1a86-475d-80ed-de71016e6c7e" containerID="3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41" exitCode=0
Sep 11 18:11:08.412417 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.412383    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"
Sep 11 18:11:08.412667 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.412369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7" event={"ID":"25afd15c-1a86-475d-80ed-de71016e6c7e","Type":"ContainerDied","Data":"3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41"}
Sep 11 18:11:08.412667 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.412529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7" event={"ID":"25afd15c-1a86-475d-80ed-de71016e6c7e","Type":"ContainerDied","Data":"cc593d0df2fbb1b0be1b182fea6c1f457680aa50cb10dec33eb39c10a0196c0c"}
Sep 11 18:11:08.412667 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.412569    2576 scope.go:117] "RemoveContainer" containerID="3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41"
Sep 11 18:11:08.414243 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.414222    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb161548-7942-4cf8-afe3-79153253e805" containerID="d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b" exitCode=0
Sep 11 18:11:08.414345 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.414279    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"
Sep 11 18:11:08.414345 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.414284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj" event={"ID":"cb161548-7942-4cf8-afe3-79153253e805","Type":"ContainerDied","Data":"d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b"}
Sep 11 18:11:08.414345 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.414330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj" event={"ID":"cb161548-7942-4cf8-afe3-79153253e805","Type":"ContainerDied","Data":"93fe51161bdbd0abb99721fb5db510c4c2b35aa4a4f88491b8d8b37b1d96535b"}
Sep 11 18:11:08.421440 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.421425    2576 scope.go:117] "RemoveContainer" containerID="3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41"
Sep 11 18:11:08.421732 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:08.421665    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41\": container with ID starting with 3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41 not found: ID does not exist" containerID="3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41"
Sep 11 18:11:08.421732 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.421721    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41"} err="failed to get container status \"3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41\": rpc error: code = NotFound desc = could not find container \"3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41\": container with ID starting with 3d21a22a247d21e6dc4ea29d06dd4c355d9891ba101c9feb61dab99f87adea41 not found: ID does not exist"
Sep 11 18:11:08.421905 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.421744    2576 scope.go:117] "RemoveContainer" containerID="d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b"
Sep 11 18:11:08.429655 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.429636    2576 scope.go:117] "RemoveContainer" containerID="d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b"
Sep 11 18:11:08.429914 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:08.429896    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b\": container with ID starting with d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b not found: ID does not exist" containerID="d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b"
Sep 11 18:11:08.429994 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.429919    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b"} err="failed to get container status \"d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b\": rpc error: code = NotFound desc = could not find container \"d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b\": container with ID starting with d4bc2f2b9ee68e50394e9d6d0d7f207941125c813a896ccf83e254009beb0f7b not found: ID does not exist"
Sep 11 18:11:08.439494 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.439468    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"]
Sep 11 18:11:08.443874 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.443854    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7"]
Sep 11 18:11:08.467414 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.467376    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"]
Sep 11 18:11:08.468744 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.468718    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:08.474283 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:08.474256    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj"]
Sep 11 18:11:09.656252 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:09.656218    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:10.239780 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:10.239748    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25afd15c-1a86-475d-80ed-de71016e6c7e" path="/var/lib/kubelet/pods/25afd15c-1a86-475d-80ed-de71016e6c7e/volumes"
Sep 11 18:11:10.240112 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:10.240099    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb161548-7942-4cf8-afe3-79153253e805" path="/var/lib/kubelet/pods/cb161548-7942-4cf8-afe3-79153253e805/volumes"
Sep 11 18:11:10.670949 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:10.670907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:12.333036 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:12.332998    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:13.486301 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:13.486264    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:13.855831 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:13.855798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:13.955756 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:13.955712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:14.326894 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:14.326852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:14.538381 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:14.538342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:14.753778 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:14.753666    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:14.859781 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:14.859748    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:15.040125 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:15.040032    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:16.783213 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:16.783177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:17.413036 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:17.413005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:17.589443 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:17.589407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:18.010487 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:18.010453    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:19.201891 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:19.201833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:20.254431 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254396    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"]
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254803    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95038938-0c36-407d-a53c-dc4d7d1a3a81" containerName="payload-pre-processing"
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254816    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95038938-0c36-407d-a53c-dc4d7d1a3a81" containerName="payload-pre-processing"
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254832    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb161548-7942-4cf8-afe3-79153253e805" containerName="payload-processing"
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254838    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb161548-7942-4cf8-afe3-79153253e805" containerName="payload-processing"
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254847    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01e09cf0-ec74-4a69-ad41-052aaacccabb" containerName="maas-api"
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254855    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e09cf0-ec74-4a69-ad41-052aaacccabb" containerName="maas-api"
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254871    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30012a71-39c9-489b-bb67-4ed890efb457" containerName="maas-api"
Sep 11 18:11:20.254873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254877    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="30012a71-39c9-489b-bb67-4ed890efb457" containerName="maas-api"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254883    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad920abb-53c7-4845-bdc1-d268eb8beaed" containerName="payload-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254892    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad920abb-53c7-4845-bdc1-d268eb8beaed" containerName="payload-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254903    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25afd15c-1a86-475d-80ed-de71016e6c7e" containerName="payload-pre-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254908    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="25afd15c-1a86-475d-80ed-de71016e6c7e" containerName="payload-pre-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254915    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a3b767-aab3-43f2-b787-29c868e729a1" containerName="payload-pre-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254919    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a3b767-aab3-43f2-b787-29c868e729a1" containerName="payload-pre-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254974    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="21a3b767-aab3-43f2-b787-29c868e729a1" containerName="payload-pre-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254982    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb161548-7942-4cf8-afe3-79153253e805" containerName="payload-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254989    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad920abb-53c7-4845-bdc1-d268eb8beaed" containerName="payload-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.254994    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="25afd15c-1a86-475d-80ed-de71016e6c7e" containerName="payload-pre-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.255002    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="30012a71-39c9-489b-bb67-4ed890efb457" containerName="maas-api"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.255007    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="95038938-0c36-407d-a53c-dc4d7d1a3a81" containerName="payload-pre-processing"
Sep 11 18:11:20.255200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.255014    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01e09cf0-ec74-4a69-ad41-052aaacccabb" containerName="maas-api"
Sep 11 18:11:20.259083 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.259064    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.264378 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.264351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-6ad962-serving-cert\""
Sep 11 18:11:20.277266 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.277232    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"]
Sep 11 18:11:20.309722 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.309658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:20.362611 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.362567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-metrics-certs\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.362869 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.362790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.362869 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.362829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfvqd\" (UniqueName: \"kubernetes.io/projected/03a6ad75-5345-44c4-aba6-1118d23eaefd-kube-api-access-lfvqd\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.363043 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.363023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a6ad75-5345-44c4-aba6-1118d23eaefd-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.421513 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.421477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:20.463966 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.463931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-metrics-certs\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.464123 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.463986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.464123 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:20.464088    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-serving-cert: secret "maas-api-e2e-ipp-a-6ad962-serving-cert" not found
Sep 11 18:11:20.464265 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.464121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfvqd\" (UniqueName: \"kubernetes.io/projected/03a6ad75-5345-44c4-aba6-1118d23eaefd-kube-api-access-lfvqd\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.464265 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:20.464159    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls podName:03a6ad75-5345-44c4-aba6-1118d23eaefd nodeName:}" failed. No retries permitted until 2026-09-11 18:11:20.96414097 +0000 UTC m=+1585.251675285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls") pod "maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2" (UID: "03a6ad75-5345-44c4-aba6-1118d23eaefd") : secret "maas-api-e2e-ipp-a-6ad962-serving-cert" not found
Sep 11 18:11:20.464265 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.464211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a6ad75-5345-44c4-aba6-1118d23eaefd-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.464961 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.464938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a6ad75-5345-44c4-aba6-1118d23eaefd-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.466555 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.466527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-metrics-certs\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.476719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.476671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfvqd\" (UniqueName: \"kubernetes.io/projected/03a6ad75-5345-44c4-aba6-1118d23eaefd-kube-api-access-lfvqd\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.668461 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.668428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:20.969940 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.969845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:20.972516 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:20.972484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:21.011736 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.011699    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:21.112846 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.112811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:21.137949 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.137914    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"]
Sep 11 18:11:21.141604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.141580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.144165 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.144143    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-6ad962\""
Sep 11 18:11:21.156699 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.155642    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"]
Sep 11 18:11:21.171059 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.171013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:21.271927 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.271889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.272391 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.271962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs7lj\" (UniqueName: \"kubernetes.io/projected/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-kube-api-access-rs7lj\") pod \"payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.372817 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.372774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.373011 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.372843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs7lj\" (UniqueName: \"kubernetes.io/projected/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-kube-api-access-rs7lj\") pod \"payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.373720 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.373698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.384594 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.384564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs7lj\" (UniqueName: \"kubernetes.io/projected/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-kube-api-access-rs7lj\") pod \"payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.452949 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.452870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"]
Sep 11 18:11:21.453901 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.453877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:21.455705 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:11:21.455661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a6ad75_5345_44c4_aba6_1118d23eaefd.slice/crio-890433379e8153d56dba5a1db9beda5d8125f41e46325f31ea20d419535ab02e WatchSource:0}: Error finding container 890433379e8153d56dba5a1db9beda5d8125f41e46325f31ea20d419535ab02e: Status 404 returned error can't find the container with id 890433379e8153d56dba5a1db9beda5d8125f41e46325f31ea20d419535ab02e
Sep 11 18:11:21.482942 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.482856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2" event={"ID":"03a6ad75-5345-44c4-aba6-1118d23eaefd","Type":"ContainerStarted","Data":"890433379e8153d56dba5a1db9beda5d8125f41e46325f31ea20d419535ab02e"}
Sep 11 18:11:21.736585 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:21.736499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"]
Sep 11 18:11:21.739648 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:11:21.739613    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6fabb8_1ba5_4117_bdbe_55a372c23c46.slice/crio-e37046efb7505d304fe61bb8d4ab219b19942a0ae4c96fde8e71ac4802e8ce11 WatchSource:0}: Error finding container e37046efb7505d304fe61bb8d4ab219b19942a0ae4c96fde8e71ac4802e8ce11: Status 404 returned error can't find the container with id e37046efb7505d304fe61bb8d4ab219b19942a0ae4c96fde8e71ac4802e8ce11
Sep 11 18:11:22.490609 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:22.490565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph" event={"ID":"bc6fabb8-1ba5-4117-bdbe-55a372c23c46","Type":"ContainerStarted","Data":"b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc"}
Sep 11 18:11:22.491097 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:22.490648    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:22.491097 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:22.490695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph" event={"ID":"bc6fabb8-1ba5-4117-bdbe-55a372c23c46","Type":"ContainerStarted","Data":"e37046efb7505d304fe61bb8d4ab219b19942a0ae4c96fde8e71ac4802e8ce11"}
Sep 11 18:11:22.492372 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:22.492346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2" event={"ID":"03a6ad75-5345-44c4-aba6-1118d23eaefd","Type":"ContainerStarted","Data":"44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6"}
Sep 11 18:11:22.492499 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:22.492487    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:22.528662 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:22.528605    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph" podStartSLOduration=1.528588725 podStartE2EDuration="1.528588725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:22.526988906 +0000 UTC m=+1586.814523214" watchObservedRunningTime="2026-09-11 18:11:22.528588725 +0000 UTC m=+1586.816123031"
Sep 11 18:11:22.565716 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:22.565640    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2" podStartSLOduration=2.096985186 podStartE2EDuration="2.56562079s" totalImagesPullingTime="468.635604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:22.565048815 +0000 UTC m=+1586.852583122" watchObservedRunningTime="2026-09-11 18:11:22.56562079 +0000 UTC m=+1586.853155096"
Sep 11 18:11:28.503703 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:28.503659    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:11:33.500525 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:33.500497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:11:42.799507 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:42.799470    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:43.835273 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:43.835243    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:44.298210 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:44.298173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:45.051425 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:45.051386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:47.526581 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:47.526490    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:48.294860 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:48.294825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:48.798631 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:48.798592    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:48.976466 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:48.976431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:50.921930 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:50.921890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:51.612608 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:51.612570    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:51.741402 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:51.741353    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:52.014049 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:52.013964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:53.177606 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:53.177564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:54.046533 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:54.046502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:55.459952 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:55.459912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:55.617245 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:55.617210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:55.788615 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:55.788527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:56.430746 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.430713    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:56.669812 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.669721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:11:56.788875 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.788837    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"]
Sep 11 18:11:56.793663 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.793644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:56.809518 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:56.809486    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-ipp-b-b54eb6\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-b54eb6\"" type="*v1.ConfigMap"
Sep 11 18:11:56.809518 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:56.809502    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-ipp-b-b54eb6-dockercfg-5vvww\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-b54eb6-dockercfg-5vvww\"" type="*v1.Secret"
Sep 11 18:11:56.809729 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:56.809530    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="cde6b5ad-6506-4511-8978-ff4f0a21d5f7" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:56.826208 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.826170    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"]
Sep 11 18:11:56.888318 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.888276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:56.888487 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.888430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjdrk\" (UniqueName: \"kubernetes.io/projected/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-kube-api-access-fjdrk\") pod \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:56.989197 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.989090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjdrk\" (UniqueName: \"kubernetes.io/projected/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-kube-api-access-fjdrk\") pod \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:56.989197 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:56.989144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:57.006661 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:57.006639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjdrk\" (UniqueName: \"kubernetes.io/projected/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-kube-api-access-fjdrk\") pod \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:57.990181 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:57.990141    2576 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-ipp-b-b54eb6: failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:11:57.990583 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:11:57.990240    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume podName:cde6b5ad-6506-4511-8978-ff4f0a21d5f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:58.490222393 +0000 UTC m=+1622.777756678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume") pod "payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4" (UID: "cde6b5ad-6506-4511-8978-ff4f0a21d5f7") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 18:11:58.011689 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:58.011653    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-b54eb6\""
Sep 11 18:11:58.033538 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:58.033506    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-b54eb6-dockercfg-5vvww\""
Sep 11 18:11:58.501651 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:58.501618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:58.502367 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:58.502346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:58.604172 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:58.604132    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:58.880950 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:58.880922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"]
Sep 11 18:11:58.882119 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:11:58.882090    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde6b5ad_6506_4511_8978_ff4f0a21d5f7.slice/crio-ca9be28bd3e66485cbaedab9d760fc0f69fd37c3099255457971f9adcb6d6458 WatchSource:0}: Error finding container ca9be28bd3e66485cbaedab9d760fc0f69fd37c3099255457971f9adcb6d6458: Status 404 returned error can't find the container with id ca9be28bd3e66485cbaedab9d760fc0f69fd37c3099255457971f9adcb6d6458
Sep 11 18:11:59.682179 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:59.682142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4" event={"ID":"cde6b5ad-6506-4511-8978-ff4f0a21d5f7","Type":"ContainerStarted","Data":"80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74"}
Sep 11 18:11:59.682581 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:59.682211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:11:59.682581 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:59.682231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4" event={"ID":"cde6b5ad-6506-4511-8978-ff4f0a21d5f7","Type":"ContainerStarted","Data":"ca9be28bd3e66485cbaedab9d760fc0f69fd37c3099255457971f9adcb6d6458"}
Sep 11 18:11:59.709459 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:11:59.709398    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4" podStartSLOduration=3.709384295 podStartE2EDuration="3.709384295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:59.708198505 +0000 UTC m=+1623.995732828" watchObservedRunningTime="2026-09-11 18:11:59.709384295 +0000 UTC m=+1623.996918601"
Sep 11 18:12:10.688900 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:10.688862    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:12:18.550329 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:18.550296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:12:19.560038 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:19.559998    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:12:20.262006 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:20.261973    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:12:21.173928 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:21.173886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:12:21.763140 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:21.763093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:12:21.954516 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:21.954476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:12:26.886479 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:26.886442    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdjnk_8bb792dc-ee5e-42b4-8f73-64513cfab123/payload-processing/0.log"
Sep 11 18:12:55.387333 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:12:55.387301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:08.480404 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:08.480362    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:20.169494 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:20.169403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:23.272429 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:23.272396    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph_bc6fabb8-1ba5-4117-bdbe-55a372c23c46/payload-processing/0.log"
Sep 11 18:13:23.406415 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:23.406370    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdjnk_8bb792dc-ee5e-42b4-8f73-64513cfab123/payload-processing/0.log"
Sep 11 18:13:23.819846 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:23.819800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:24.144011 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:24.143913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:24.243708 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:24.243648    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:26.523196 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:26.523153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:27.196748 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:27.196704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:27.349469 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:27.349433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:27.445106 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:27.445075    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:28.260139 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:28.260105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:29.204697 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:29.204652    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:29.788028 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:29.787996    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:30.658319 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.658283    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"]
Sep 11 18:13:30.662485 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.662459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.665218 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.665190    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-4f951a-serving-cert\""
Sep 11 18:13:30.674276 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.674245    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"]
Sep 11 18:13:30.692722 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.692686    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:30.707749 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.707720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.707903 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.707765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.707903 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.707808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587b6f62-4b00-40b2-b763-47d51e46f088-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.707903 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.707825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdmqc\" (UniqueName: \"kubernetes.io/projected/587b6f62-4b00-40b2-b763-47d51e46f088-kube-api-access-jdmqc\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.763737 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.763669    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:30.809058 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.809027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.809518 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.809098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587b6f62-4b00-40b2-b763-47d51e46f088-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.809518 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.809125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdmqc\" (UniqueName: \"kubernetes.io/projected/587b6f62-4b00-40b2-b763-47d51e46f088-kube-api-access-jdmqc\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.809518 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.809285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.809953 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.809931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587b6f62-4b00-40b2-b763-47d51e46f088-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.811747 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.811718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.811844 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.811718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.819200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.819181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdmqc\" (UniqueName: \"kubernetes.io/projected/587b6f62-4b00-40b2-b763-47d51e46f088-kube-api-access-jdmqc\") pod \"maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:30.863459 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.863429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:30.975730 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:30.975626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:31.211936 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:31.211897    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:31.257668 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:31.257639    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"]
Sep 11 18:13:31.260542 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:13:31.260500    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587b6f62_4b00_40b2_b763_47d51e46f088.slice/crio-7f18363b895ba0f30d1371ceed892ac902a6ebbc05c87ca6d205e06ed9e48634 WatchSource:0}: Error finding container 7f18363b895ba0f30d1371ceed892ac902a6ebbc05c87ca6d205e06ed9e48634: Status 404 returned error can't find the container with id 7f18363b895ba0f30d1371ceed892ac902a6ebbc05c87ca6d205e06ed9e48634
Sep 11 18:13:31.302990 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:31.302963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:32.141408 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:32.141372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6" event={"ID":"587b6f62-4b00-40b2-b763-47d51e46f088","Type":"ContainerStarted","Data":"7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353"}
Sep 11 18:13:32.141837 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:32.141422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6" event={"ID":"587b6f62-4b00-40b2-b763-47d51e46f088","Type":"ContainerStarted","Data":"7f18363b895ba0f30d1371ceed892ac902a6ebbc05c87ca6d205e06ed9e48634"}
Sep 11 18:13:32.141837 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:32.141472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:32.160375 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:32.160332    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6" podStartSLOduration=1.744217156 podStartE2EDuration="2.160312122s" totalImagesPullingTime="416.094966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:13:32.160157456 +0000 UTC m=+1716.447691764" watchObservedRunningTime="2026-09-11 18:13:32.160312122 +0000 UTC m=+1716.447846429"
Sep 11 18:13:38.152762 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:38.152732    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:13:40.788207 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:40.788171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:40.889175 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:40.889135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:52.754633 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:52.754596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:53.582797 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:53.582762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:54.294001 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:54.293963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:55.269661 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:55.269622    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:55.859865 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:55.859827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:56.657954 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:56.657915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:57.324131 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:57.324076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:58.822591 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:58.822550    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:13:59.672283 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:13:59.672250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:00.356959 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:00.356923    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:01.135875 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:01.135835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:01.841082 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:01.841043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:02.540614 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:02.540576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:08.848097 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:08.848062    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"]
Sep 11 18:14:08.848566 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:08.848289    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6" podUID="587b6f62-4b00-40b2-b763-47d51e46f088" containerName="maas-api" containerID="cri-o://7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353" gracePeriod=30
Sep 11 18:14:08.880202 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:08.880166    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:08.953980 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:08.953947    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:09.020597 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.020033    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:09.102867 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.102801    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:14:09.140984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.140937    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:09.149942 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.149912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-metrics-certs\") pod \"587b6f62-4b00-40b2-b763-47d51e46f088\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") "
Sep 11 18:14:09.150133 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.149950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdmqc\" (UniqueName: \"kubernetes.io/projected/587b6f62-4b00-40b2-b763-47d51e46f088-kube-api-access-jdmqc\") pod \"587b6f62-4b00-40b2-b763-47d51e46f088\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") "
Sep 11 18:14:09.150133 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.149987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-maas-api-tls\") pod \"587b6f62-4b00-40b2-b763-47d51e46f088\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") "
Sep 11 18:14:09.150133 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.150005    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587b6f62-4b00-40b2-b763-47d51e46f088-openshift-service-ca\") pod \"587b6f62-4b00-40b2-b763-47d51e46f088\" (UID: \"587b6f62-4b00-40b2-b763-47d51e46f088\") "
Sep 11 18:14:09.150857 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.150828    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/587b6f62-4b00-40b2-b763-47d51e46f088-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "587b6f62-4b00-40b2-b763-47d51e46f088" (UID: "587b6f62-4b00-40b2-b763-47d51e46f088"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:09.152286 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.152258    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587b6f62-4b00-40b2-b763-47d51e46f088-kube-api-access-jdmqc" (OuterVolumeSpecName: "kube-api-access-jdmqc") pod "587b6f62-4b00-40b2-b763-47d51e46f088" (UID: "587b6f62-4b00-40b2-b763-47d51e46f088"). InnerVolumeSpecName "kube-api-access-jdmqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:14:09.152811 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.152791    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "587b6f62-4b00-40b2-b763-47d51e46f088" (UID: "587b6f62-4b00-40b2-b763-47d51e46f088"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:14:09.152879 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.152812    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "587b6f62-4b00-40b2-b763-47d51e46f088" (UID: "587b6f62-4b00-40b2-b763-47d51e46f088"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:14:09.251200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.251169    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:09.251200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.251197    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdmqc\" (UniqueName: \"kubernetes.io/projected/587b6f62-4b00-40b2-b763-47d51e46f088-kube-api-access-jdmqc\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:09.251200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.251207    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587b6f62-4b00-40b2-b763-47d51e46f088-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:09.251427 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.251217    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587b6f62-4b00-40b2-b763-47d51e46f088-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:09.330463 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.330428    2576 generic.go:356] "Generic (PLEG): container finished" podID="587b6f62-4b00-40b2-b763-47d51e46f088" containerID="7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353" exitCode=0
Sep 11 18:14:09.330633 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.330474    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"
Sep 11 18:14:09.330633 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.330515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6" event={"ID":"587b6f62-4b00-40b2-b763-47d51e46f088","Type":"ContainerDied","Data":"7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353"}
Sep 11 18:14:09.330633 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.330574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6" event={"ID":"587b6f62-4b00-40b2-b763-47d51e46f088","Type":"ContainerDied","Data":"7f18363b895ba0f30d1371ceed892ac902a6ebbc05c87ca6d205e06ed9e48634"}
Sep 11 18:14:09.330633 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.330606    2576 scope.go:117] "RemoveContainer" containerID="7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353"
Sep 11 18:14:09.341308 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.341281    2576 scope.go:117] "RemoveContainer" containerID="7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353"
Sep 11 18:14:09.341723 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:14:09.341670    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353\": container with ID starting with 7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353 not found: ID does not exist" containerID="7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353"
Sep 11 18:14:09.341816 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.341736    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353"} err="failed to get container status \"7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353\": rpc error: code = NotFound desc = could not find container \"7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353\": container with ID starting with 7da6afbba52fe3f5e48e3cdcae961b98b9fc0d2527836eca6aa4d46ec0387353 not found: ID does not exist"
Sep 11 18:14:09.365490 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.365404    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"]
Sep 11 18:14:09.371946 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.371905    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4f951a-648db64f99-rtzc6"]
Sep 11 18:14:09.471761 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.471724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:09.580057 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:09.580025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:10.239637 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:10.239602    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="587b6f62-4b00-40b2-b763-47d51e46f088" path="/var/lib/kubelet/pods/587b6f62-4b00-40b2-b763-47d51e46f088/volumes"
Sep 11 18:14:10.298362 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:10.298325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:11.131686 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:11.131639    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:11.846991 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:11.846953    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:12.555500 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:12.555450    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:15.524165 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:15.524113    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:15.624395 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:15.624361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:15.841841 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:15.841807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:19.774648 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:19.774612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:20.588857 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:20.588821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:21.400093 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:21.400050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:22.173206 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:22.173170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:23.085190 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:23.085157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:23.844145 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:23.844108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:25.324000 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:25.323967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:29.848642 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:29.848605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:35.416172 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.416132    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"]
Sep 11 18:14:35.416636 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.416351    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2" podUID="03a6ad75-5345-44c4-aba6-1118d23eaefd" containerName="maas-api" containerID="cri-o://44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6" gracePeriod=30
Sep 11 18:14:35.432377 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.432346    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:35.468135 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.468049    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"]
Sep 11 18:14:35.468593 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.468298    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph" podUID="bc6fabb8-1ba5-4117-bdbe-55a372c23c46" containerName="payload-processing" containerID="cri-o://b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc" gracePeriod=30
Sep 11 18:14:35.533294 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.533254    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:35.632553 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.632507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:35.698406 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.698326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:35.732458 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.732418    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:14:35.766037 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.766010    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:14:35.885719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.885645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs7lj\" (UniqueName: \"kubernetes.io/projected/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-kube-api-access-rs7lj\") pod \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") "
Sep 11 18:14:35.885719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.885707    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-plugins-config-volume\") pod \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\" (UID: \"bc6fabb8-1ba5-4117-bdbe-55a372c23c46\") "
Sep 11 18:14:35.885984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.885749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfvqd\" (UniqueName: \"kubernetes.io/projected/03a6ad75-5345-44c4-aba6-1118d23eaefd-kube-api-access-lfvqd\") pod \"03a6ad75-5345-44c4-aba6-1118d23eaefd\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") "
Sep 11 18:14:35.885984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.885782    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-metrics-certs\") pod \"03a6ad75-5345-44c4-aba6-1118d23eaefd\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") "
Sep 11 18:14:35.885984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.885850    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a6ad75-5345-44c4-aba6-1118d23eaefd-openshift-service-ca\") pod \"03a6ad75-5345-44c4-aba6-1118d23eaefd\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") "
Sep 11 18:14:35.885984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.885889    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls\") pod \"03a6ad75-5345-44c4-aba6-1118d23eaefd\" (UID: \"03a6ad75-5345-44c4-aba6-1118d23eaefd\") "
Sep 11 18:14:35.886354 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.886302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a6ad75-5345-44c4-aba6-1118d23eaefd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03a6ad75-5345-44c4-aba6-1118d23eaefd" (UID: "03a6ad75-5345-44c4-aba6-1118d23eaefd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:35.886539 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.886510    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc6fabb8-1ba5-4117-bdbe-55a372c23c46" (UID: "bc6fabb8-1ba5-4117-bdbe-55a372c23c46"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:35.888172 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.888139    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "03a6ad75-5345-44c4-aba6-1118d23eaefd" (UID: "03a6ad75-5345-44c4-aba6-1118d23eaefd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:14:35.888278 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.888167    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-kube-api-access-rs7lj" (OuterVolumeSpecName: "kube-api-access-rs7lj") pod "bc6fabb8-1ba5-4117-bdbe-55a372c23c46" (UID: "bc6fabb8-1ba5-4117-bdbe-55a372c23c46"). InnerVolumeSpecName "kube-api-access-rs7lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:14:35.888360 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.888342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03a6ad75-5345-44c4-aba6-1118d23eaefd" (UID: "03a6ad75-5345-44c4-aba6-1118d23eaefd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:14:35.888550 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.888530    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a6ad75-5345-44c4-aba6-1118d23eaefd-kube-api-access-lfvqd" (OuterVolumeSpecName: "kube-api-access-lfvqd") pod "03a6ad75-5345-44c4-aba6-1118d23eaefd" (UID: "03a6ad75-5345-44c4-aba6-1118d23eaefd"). InnerVolumeSpecName "kube-api-access-lfvqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:14:35.987091 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.986985    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:35.987091 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.987027    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a6ad75-5345-44c4-aba6-1118d23eaefd-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:35.987091 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.987046    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a6ad75-5345-44c4-aba6-1118d23eaefd-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:35.987091 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.987060    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs7lj\" (UniqueName: \"kubernetes.io/projected/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-kube-api-access-rs7lj\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:35.987091 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.987071    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6fabb8-1ba5-4117-bdbe-55a372c23c46-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:35.987091 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:35.987080    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfvqd\" (UniqueName: \"kubernetes.io/projected/03a6ad75-5345-44c4-aba6-1118d23eaefd-kube-api-access-lfvqd\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:36.051149 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.051108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:36.152066 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.152039    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:36.482387 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.482356    2576 generic.go:356] "Generic (PLEG): container finished" podID="03a6ad75-5345-44c4-aba6-1118d23eaefd" containerID="44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6" exitCode=0
Sep 11 18:14:36.482966 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.482403    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"
Sep 11 18:14:36.482966 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.482435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2" event={"ID":"03a6ad75-5345-44c4-aba6-1118d23eaefd","Type":"ContainerDied","Data":"44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6"}
Sep 11 18:14:36.482966 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.482493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2" event={"ID":"03a6ad75-5345-44c4-aba6-1118d23eaefd","Type":"ContainerDied","Data":"890433379e8153d56dba5a1db9beda5d8125f41e46325f31ea20d419535ab02e"}
Sep 11 18:14:36.482966 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.482524    2576 scope.go:117] "RemoveContainer" containerID="44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6"
Sep 11 18:14:36.484122 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.483970    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc6fabb8-1ba5-4117-bdbe-55a372c23c46" containerID="b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc" exitCode=0
Sep 11 18:14:36.484122 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.484002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph" event={"ID":"bc6fabb8-1ba5-4117-bdbe-55a372c23c46","Type":"ContainerDied","Data":"b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc"}
Sep 11 18:14:36.484122 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.484016    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"
Sep 11 18:14:36.484122 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.484045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph" event={"ID":"bc6fabb8-1ba5-4117-bdbe-55a372c23c46","Type":"ContainerDied","Data":"e37046efb7505d304fe61bb8d4ab219b19942a0ae4c96fde8e71ac4802e8ce11"}
Sep 11 18:14:36.492041 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.492020    2576 scope.go:117] "RemoveContainer" containerID="44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6"
Sep 11 18:14:36.492401 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:14:36.492373    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6\": container with ID starting with 44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6 not found: ID does not exist" containerID="44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6"
Sep 11 18:14:36.492504 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.492409    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6"} err="failed to get container status \"44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6\": rpc error: code = NotFound desc = could not find container \"44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6\": container with ID starting with 44bece17d929e64b6db6d6e7a741cb0a165951f312539e644e56586bdce99db6 not found: ID does not exist"
Sep 11 18:14:36.492504 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.492433    2576 scope.go:117] "RemoveContainer" containerID="b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc"
Sep 11 18:14:36.500935 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.500859    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"]
Sep 11 18:14:36.502134 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.502115    2576 scope.go:117] "RemoveContainer" containerID="b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc"
Sep 11 18:14:36.509207 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:14:36.502670    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc\": container with ID starting with b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc not found: ID does not exist" containerID="b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc"
Sep 11 18:14:36.509207 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.503137    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc"} err="failed to get container status \"b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc\": rpc error: code = NotFound desc = could not find container \"b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc\": container with ID starting with b30a66f6a1dac98710ceed2e0f3e1940b87c996d34616c53b09b162f979f94fc not found: ID does not exist"
Sep 11 18:14:36.509207 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.506610    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph"]
Sep 11 18:14:36.515209 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.515172    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"]
Sep 11 18:14:36.518495 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.518463    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6ad962-699f9ddf9b-9zfg2"]
Sep 11 18:14:36.966417 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:36.966376    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:37.652772 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:37.652734    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:38.240462 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:38.240381    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a6ad75-5345-44c4-aba6-1118d23eaefd" path="/var/lib/kubelet/pods/03a6ad75-5345-44c4-aba6-1118d23eaefd/volumes"
Sep 11 18:14:38.240754 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:38.240739    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6fabb8-1ba5-4117-bdbe-55a372c23c46" path="/var/lib/kubelet/pods/bc6fabb8-1ba5-4117-bdbe-55a372c23c46/volumes"
Sep 11 18:14:38.358945 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:38.358912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:41.072978 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:41.072940    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:14:52.920994 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:14:52.920908    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:00.162297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162260    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"]
Sep 11 18:15:00.162848 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162827    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="587b6f62-4b00-40b2-b763-47d51e46f088" containerName="maas-api"
Sep 11 18:15:00.162909 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162851    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="587b6f62-4b00-40b2-b763-47d51e46f088" containerName="maas-api"
Sep 11 18:15:00.162909 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162871    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a6ad75-5345-44c4-aba6-1118d23eaefd" containerName="maas-api"
Sep 11 18:15:00.162909 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162880    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a6ad75-5345-44c4-aba6-1118d23eaefd" containerName="maas-api"
Sep 11 18:15:00.162909 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162891    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6fabb8-1ba5-4117-bdbe-55a372c23c46" containerName="payload-processing"
Sep 11 18:15:00.162909 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162900    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6fabb8-1ba5-4117-bdbe-55a372c23c46" containerName="payload-processing"
Sep 11 18:15:00.163083 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.162989    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a6ad75-5345-44c4-aba6-1118d23eaefd" containerName="maas-api"
Sep 11 18:15:00.163083 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.163001    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6fabb8-1ba5-4117-bdbe-55a372c23c46" containerName="payload-processing"
Sep 11 18:15:00.163083 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.163012    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="587b6f62-4b00-40b2-b763-47d51e46f088" containerName="maas-api"
Sep 11 18:15:00.166200 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.166181    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"]
Sep 11 18:15:00.166322 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.166301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"
Sep 11 18:15:00.169208 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.169191    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"
Sep 11 18:15:00.169719 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.169704    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4wxpj\""
Sep 11 18:15:00.178922 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.178893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"
Sep 11 18:15:00.180828 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.180595    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"]
Sep 11 18:15:00.183810 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.183784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"]
Sep 11 18:15:00.187945 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.187922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"
Sep 11 18:15:00.461096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.461071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"]
Sep 11 18:15:00.463417 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:15:00.463393    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f97f88_7034_4b9d_9ad1_6e0c11d93cc4.slice/crio-b98b7ded3714b4be98bec5b456b56cc4558c630a3e0d47b8aa2a0592d287afe8 WatchSource:0}: Error finding container b98b7ded3714b4be98bec5b456b56cc4558c630a3e0d47b8aa2a0592d287afe8: Status 404 returned error can't find the container with id b98b7ded3714b4be98bec5b456b56cc4558c630a3e0d47b8aa2a0592d287afe8
Sep 11 18:15:00.473435 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.473412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"]
Sep 11 18:15:00.476723 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:15:00.476696    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595db186_5bf2_4ac8_87e4_00c2762ea414.slice/crio-b80f9332fad4ec92d1f911b0eb007c2d2734ddbfc7dc8069fc8c24b11c909e03 WatchSource:0}: Error finding container b80f9332fad4ec92d1f911b0eb007c2d2734ddbfc7dc8069fc8c24b11c909e03: Status 404 returned error can't find the container with id b80f9332fad4ec92d1f911b0eb007c2d2734ddbfc7dc8069fc8c24b11c909e03
Sep 11 18:15:00.596412 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.596378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv" event={"ID":"54f97f88-7034-4b9d-9ad1-6e0c11d93cc4","Type":"ContainerStarted","Data":"b98b7ded3714b4be98bec5b456b56cc4558c630a3e0d47b8aa2a0592d287afe8"}
Sep 11 18:15:00.597539 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:00.597510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd" event={"ID":"595db186-5bf2-4ac8-87e4-00c2762ea414","Type":"ContainerStarted","Data":"b80f9332fad4ec92d1f911b0eb007c2d2734ddbfc7dc8069fc8c24b11c909e03"}
Sep 11 18:15:01.604714 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:01.604654    2576 generic.go:356] "Generic (PLEG): container finished" podID="595db186-5bf2-4ac8-87e4-00c2762ea414" containerID="42c515415b8c90cd5c882adff04eb6d0d9bfb30683e49d29e4eb03460612a63c" exitCode=0
Sep 11 18:15:01.605213 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:01.604717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd" event={"ID":"595db186-5bf2-4ac8-87e4-00c2762ea414","Type":"ContainerDied","Data":"42c515415b8c90cd5c882adff04eb6d0d9bfb30683e49d29e4eb03460612a63c"}
Sep 11 18:15:01.606324 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:01.606304    2576 generic.go:356] "Generic (PLEG): container finished" podID="54f97f88-7034-4b9d-9ad1-6e0c11d93cc4" containerID="154fcdfb72fe3e8862e6988fee97289b96366b8b6b3e4de2de3b36f0e3eee3df" exitCode=0
Sep 11 18:15:01.606444 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:01.606369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv" event={"ID":"54f97f88-7034-4b9d-9ad1-6e0c11d93cc4","Type":"ContainerDied","Data":"154fcdfb72fe3e8862e6988fee97289b96366b8b6b3e4de2de3b36f0e3eee3df"}
Sep 11 18:15:02.747868 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:02.747841    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"
Sep 11 18:15:02.781628 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:02.781596    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"
Sep 11 18:15:03.616895 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:03.616865    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"
Sep 11 18:15:03.616895 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:03.616882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd" event={"ID":"595db186-5bf2-4ac8-87e4-00c2762ea414","Type":"ContainerDied","Data":"b80f9332fad4ec92d1f911b0eb007c2d2734ddbfc7dc8069fc8c24b11c909e03"}
Sep 11 18:15:03.617140 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:03.616930    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b80f9332fad4ec92d1f911b0eb007c2d2734ddbfc7dc8069fc8c24b11c909e03"
Sep 11 18:15:03.618112 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:03.618089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv" event={"ID":"54f97f88-7034-4b9d-9ad1-6e0c11d93cc4","Type":"ContainerDied","Data":"b98b7ded3714b4be98bec5b456b56cc4558c630a3e0d47b8aa2a0592d287afe8"}
Sep 11 18:15:03.618112 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:03.618109    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"
Sep 11 18:15:03.618260 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:03.618127    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b98b7ded3714b4be98bec5b456b56cc4558c630a3e0d47b8aa2a0592d287afe8"
Sep 11 18:15:05.838413 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:05.838376    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:05.938533 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:05.938495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:08.602870 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:08.602837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:17.344217 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:17.344183    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:18.230003 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:18.229966    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:24.058953 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:24.058923    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:24.122833 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:24.122805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:24.399019 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:24.398921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:25.061635 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:25.061604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:26.040759 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:26.040724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:26.801938 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:26.801904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:27.560734 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:27.560696    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:28.366003 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:28.365961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:28.809601 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:28.809568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:28.870818 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:28.870785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:35.305968 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.305928    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:35.342907 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.342872    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"]
Sep 11 18:15:35.343149 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.343121    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4" podUID="cde6b5ad-6506-4511-8978-ff4f0a21d5f7" containerName="payload-pre-processing" containerID="cri-o://80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74" gracePeriod=30
Sep 11 18:15:35.405868 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.405839    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:35.506580 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.506549    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:35.570126 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.570033    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:35.603453 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.603415    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:15:35.680507 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.680469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjdrk\" (UniqueName: \"kubernetes.io/projected/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-kube-api-access-fjdrk\") pod \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") "
Sep 11 18:15:35.680705 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.680580    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume\") pod \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\" (UID: \"cde6b5ad-6506-4511-8978-ff4f0a21d5f7\") "
Sep 11 18:15:35.680952 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.680920    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cde6b5ad-6506-4511-8978-ff4f0a21d5f7" (UID: "cde6b5ad-6506-4511-8978-ff4f0a21d5f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:15:35.682912 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.682888    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-kube-api-access-fjdrk" (OuterVolumeSpecName: "kube-api-access-fjdrk") pod "cde6b5ad-6506-4511-8978-ff4f0a21d5f7" (UID: "cde6b5ad-6506-4511-8978-ff4f0a21d5f7"). InnerVolumeSpecName "kube-api-access-fjdrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:35.767754 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.767714    2576 generic.go:356] "Generic (PLEG): container finished" podID="cde6b5ad-6506-4511-8978-ff4f0a21d5f7" containerID="80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74" exitCode=0
Sep 11 18:15:35.767947 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.767767    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"
Sep 11 18:15:35.767947 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.767797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4" event={"ID":"cde6b5ad-6506-4511-8978-ff4f0a21d5f7","Type":"ContainerDied","Data":"80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74"}
Sep 11 18:15:35.767947 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.767868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4" event={"ID":"cde6b5ad-6506-4511-8978-ff4f0a21d5f7","Type":"ContainerDied","Data":"ca9be28bd3e66485cbaedab9d760fc0f69fd37c3099255457971f9adcb6d6458"}
Sep 11 18:15:35.767947 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.767899    2576 scope.go:117] "RemoveContainer" containerID="80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74"
Sep 11 18:15:35.781659 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.781625    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjdrk\" (UniqueName: \"kubernetes.io/projected/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-kube-api-access-fjdrk\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:35.781842 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.781662    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde6b5ad-6506-4511-8978-ff4f0a21d5f7-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:35.782897 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.782871    2576 scope.go:117] "RemoveContainer" containerID="80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74"
Sep 11 18:15:35.783293 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:15:35.783265    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74\": container with ID starting with 80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74 not found: ID does not exist" containerID="80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74"
Sep 11 18:15:35.783368 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.783305    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74"} err="failed to get container status \"80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74\": rpc error: code = NotFound desc = could not find container \"80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74\": container with ID starting with 80b38752382010608b6ba5a60248248cf7e9591eadd40a6161c68b1bb76e1e74 not found: ID does not exist"
Sep 11 18:15:35.809113 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.809081    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"]
Sep 11 18:15:35.821407 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.821335    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4"]
Sep 11 18:15:35.965464 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:35.965418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:36.065608 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:36.065565    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:36.239189 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:36.239106    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde6b5ad-6506-4511-8978-ff4f0a21d5f7" path="/var/lib/kubelet/pods/cde6b5ad-6506-4511-8978-ff4f0a21d5f7/volumes"
Sep 11 18:15:36.919276 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:36.919244    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:37.869737 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:37.869698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:42.108180 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:42.108140    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:42.177183 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:42.177151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:42.419928 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:42.419841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:43.169474 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:43.169436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:43.788550 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:43.788514    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:44.457703 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:44.457655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:45.200698 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:45.200642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:46.348488 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:46.348456    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:52.943577 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:52.943545    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:53.583071 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.583023    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"]
Sep 11 18:15:53.585143 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.585117    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-386935-29819175-nqdbd"]
Sep 11 18:15:53.587828 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.587807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:53.620996 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.620968    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"]
Sep 11 18:15:53.621208 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.621181    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f" podUID="d4cd2eda-4870-4b5d-88a3-3d9634baf42b" containerName="payload-processing" containerID="cri-o://7d67b2900926d04859b278a8557cdce56a95b3a86d30ed5a71d64a9305ab6335" gracePeriod=30
Sep 11 18:15:53.627963 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.627936    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"]
Sep 11 18:15:53.628269 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.628230    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh" podUID="30eb460d-0026-41fb-894b-2aeb630eeefa" containerName="payload-pre-processing" containerID="cri-o://6df5bb147bcc84a1b4db6af2934b5ba7b86b17449e572c20ec22d8ce6f8ebdb0" gracePeriod=30
Sep 11 18:15:53.666383 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.666338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:53.733899 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.733868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:53.804774 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.804740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:53.859627 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.859542    2576 generic.go:356] "Generic (PLEG): container finished" podID="d4cd2eda-4870-4b5d-88a3-3d9634baf42b" containerID="7d67b2900926d04859b278a8557cdce56a95b3a86d30ed5a71d64a9305ab6335" exitCode=0
Sep 11 18:15:53.859790 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.859621    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f" event={"ID":"d4cd2eda-4870-4b5d-88a3-3d9634baf42b","Type":"ContainerDied","Data":"7d67b2900926d04859b278a8557cdce56a95b3a86d30ed5a71d64a9305ab6335"}
Sep 11 18:15:53.861478 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.861457    2576 generic.go:356] "Generic (PLEG): container finished" podID="30eb460d-0026-41fb-894b-2aeb630eeefa" containerID="6df5bb147bcc84a1b4db6af2934b5ba7b86b17449e572c20ec22d8ce6f8ebdb0" exitCode=0
Sep 11 18:15:53.861593 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.861525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh" event={"ID":"30eb460d-0026-41fb-894b-2aeb630eeefa","Type":"ContainerDied","Data":"6df5bb147bcc84a1b4db6af2934b5ba7b86b17449e572c20ec22d8ce6f8ebdb0"}
Sep 11 18:15:53.911098 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.911069    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:15:53.913089 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:53.913061    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:15:54.044782 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.044741    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xxmh\" (UniqueName: \"kubernetes.io/projected/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-kube-api-access-8xxmh\") pod \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") "
Sep 11 18:15:54.045257 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.044804    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30eb460d-0026-41fb-894b-2aeb630eeefa-plugins-config-volume\") pod \"30eb460d-0026-41fb-894b-2aeb630eeefa\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") "
Sep 11 18:15:54.045257 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.044825    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg75c\" (UniqueName: \"kubernetes.io/projected/30eb460d-0026-41fb-894b-2aeb630eeefa-kube-api-access-lg75c\") pod \"30eb460d-0026-41fb-894b-2aeb630eeefa\" (UID: \"30eb460d-0026-41fb-894b-2aeb630eeefa\") "
Sep 11 18:15:54.045257 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.044868    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-plugins-config-volume\") pod \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\" (UID: \"d4cd2eda-4870-4b5d-88a3-3d9634baf42b\") "
Sep 11 18:15:54.045257 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.045158    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30eb460d-0026-41fb-894b-2aeb630eeefa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30eb460d-0026-41fb-894b-2aeb630eeefa" (UID: "30eb460d-0026-41fb-894b-2aeb630eeefa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:15:54.045422 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.045284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4cd2eda-4870-4b5d-88a3-3d9634baf42b" (UID: "d4cd2eda-4870-4b5d-88a3-3d9634baf42b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:15:54.047000 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.046982    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30eb460d-0026-41fb-894b-2aeb630eeefa-kube-api-access-lg75c" (OuterVolumeSpecName: "kube-api-access-lg75c") pod "30eb460d-0026-41fb-894b-2aeb630eeefa" (UID: "30eb460d-0026-41fb-894b-2aeb630eeefa"). InnerVolumeSpecName "kube-api-access-lg75c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:54.047065 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.047032    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-kube-api-access-8xxmh" (OuterVolumeSpecName: "kube-api-access-8xxmh") pod "d4cd2eda-4870-4b5d-88a3-3d9634baf42b" (UID: "d4cd2eda-4870-4b5d-88a3-3d9634baf42b"). InnerVolumeSpecName "kube-api-access-8xxmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:54.146115 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.146020    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xxmh\" (UniqueName: \"kubernetes.io/projected/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-kube-api-access-8xxmh\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:54.146115 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.146053    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30eb460d-0026-41fb-894b-2aeb630eeefa-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:54.146115 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.146067    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg75c\" (UniqueName: \"kubernetes.io/projected/30eb460d-0026-41fb-894b-2aeb630eeefa-kube-api-access-lg75c\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:54.146115 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.146081    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cd2eda-4870-4b5d-88a3-3d9634baf42b-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:54.208646 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.208610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:54.239056 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.239020    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595db186-5bf2-4ac8-87e4-00c2762ea414" path="/var/lib/kubelet/pods/595db186-5bf2-4ac8-87e4-00c2762ea414/volumes"
Sep 11 18:15:54.310437 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.310394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:54.868081 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.868053    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"
Sep 11 18:15:54.868277 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.868052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f" event={"ID":"d4cd2eda-4870-4b5d-88a3-3d9634baf42b","Type":"ContainerDied","Data":"ad331e613c83a53d1ccc12b4fd5c04b168341f12bb46d9631ce230b2aff45278"}
Sep 11 18:15:54.868277 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.868188    2576 scope.go:117] "RemoveContainer" containerID="7d67b2900926d04859b278a8557cdce56a95b3a86d30ed5a71d64a9305ab6335"
Sep 11 18:15:54.869590 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.869571    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"
Sep 11 18:15:54.869696 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.869625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh" event={"ID":"30eb460d-0026-41fb-894b-2aeb630eeefa","Type":"ContainerDied","Data":"be38950212431d681450f0b2b0a5ee856b7d548d679811e84da766420cda7cce"}
Sep 11 18:15:54.878607 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.878559    2576 scope.go:117] "RemoveContainer" containerID="6df5bb147bcc84a1b4db6af2934b5ba7b86b17449e572c20ec22d8ce6f8ebdb0"
Sep 11 18:15:54.889622 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.889564    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"]
Sep 11 18:15:54.894109 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.894081    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh"]
Sep 11 18:15:54.906574 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.906451    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"]
Sep 11 18:15:54.914363 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:54.914335    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f"]
Sep 11 18:15:55.164345 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:55.164249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:15:56.240384 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:56.240347    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30eb460d-0026-41fb-894b-2aeb630eeefa" path="/var/lib/kubelet/pods/30eb460d-0026-41fb-894b-2aeb630eeefa/volumes"
Sep 11 18:15:56.240767 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:15:56.240752    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4cd2eda-4870-4b5d-88a3-3d9634baf42b" path="/var/lib/kubelet/pods/d4cd2eda-4870-4b5d-88a3-3d9634baf42b/volumes"
Sep 11 18:16:00.252794 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:00.252759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:00.321173 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:00.321143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:00.543980 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:00.543890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:01.090715 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:01.090652    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:01.867604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:01.867567    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:02.751426 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:02.751385    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:11.523918 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.523881    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"]
Sep 11 18:16:11.524812 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.524789    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:11.527958 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.527934    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3ebea5-29819175-td6nv"]
Sep 11 18:16:11.568757 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.568725    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"]
Sep 11 18:16:11.569036 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.569004    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v" podUID="a5d7c656-05eb-4288-b84d-7f1e4f311a54" containerName="payload-processing" containerID="cri-o://c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b" gracePeriod=30
Sep 11 18:16:11.581534 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.581507    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"]
Sep 11 18:16:11.581750 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.581721    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7" podUID="aa8213aa-52d0-4925-b1e2-f25b47992082" containerName="payload-pre-processing" containerID="cri-o://4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978" gracePeriod=30
Sep 11 18:16:11.664278 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.664247    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:11.770395 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.770361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:11.862067 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.862044    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:16:11.864855 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.864835    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:16:11.865117 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.865097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:11.893975 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.893945    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7c656-05eb-4288-b84d-7f1e4f311a54-plugins-config-volume\") pod \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") "
Sep 11 18:16:11.894112 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.894050    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqxg4\" (UniqueName: \"kubernetes.io/projected/a5d7c656-05eb-4288-b84d-7f1e4f311a54-kube-api-access-wqxg4\") pod \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\" (UID: \"a5d7c656-05eb-4288-b84d-7f1e4f311a54\") "
Sep 11 18:16:11.894112 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.894093    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8213aa-52d0-4925-b1e2-f25b47992082-plugins-config-volume\") pod \"aa8213aa-52d0-4925-b1e2-f25b47992082\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") "
Sep 11 18:16:11.894234 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.894132    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn772\" (UniqueName: \"kubernetes.io/projected/aa8213aa-52d0-4925-b1e2-f25b47992082-kube-api-access-nn772\") pod \"aa8213aa-52d0-4925-b1e2-f25b47992082\" (UID: \"aa8213aa-52d0-4925-b1e2-f25b47992082\") "
Sep 11 18:16:11.894381 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.894354    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d7c656-05eb-4288-b84d-7f1e4f311a54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a5d7c656-05eb-4288-b84d-7f1e4f311a54" (UID: "a5d7c656-05eb-4288-b84d-7f1e4f311a54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:16:11.894453 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.894422    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa8213aa-52d0-4925-b1e2-f25b47992082-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa8213aa-52d0-4925-b1e2-f25b47992082" (UID: "aa8213aa-52d0-4925-b1e2-f25b47992082"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:16:11.896276 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.896248    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8213aa-52d0-4925-b1e2-f25b47992082-kube-api-access-nn772" (OuterVolumeSpecName: "kube-api-access-nn772") pod "aa8213aa-52d0-4925-b1e2-f25b47992082" (UID: "aa8213aa-52d0-4925-b1e2-f25b47992082"). InnerVolumeSpecName "kube-api-access-nn772". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:11.896410 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.896390    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d7c656-05eb-4288-b84d-7f1e4f311a54-kube-api-access-wqxg4" (OuterVolumeSpecName: "kube-api-access-wqxg4") pod "a5d7c656-05eb-4288-b84d-7f1e4f311a54" (UID: "a5d7c656-05eb-4288-b84d-7f1e4f311a54"). InnerVolumeSpecName "kube-api-access-wqxg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:11.951995 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.951954    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa8213aa-52d0-4925-b1e2-f25b47992082" containerID="4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978" exitCode=0
Sep 11 18:16:11.952162 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.951999    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"
Sep 11 18:16:11.952162 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.952033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7" event={"ID":"aa8213aa-52d0-4925-b1e2-f25b47992082","Type":"ContainerDied","Data":"4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978"}
Sep 11 18:16:11.952162 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.952091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7" event={"ID":"aa8213aa-52d0-4925-b1e2-f25b47992082","Type":"ContainerDied","Data":"8663ffd89129905f816b4ae642d68a7a7d131cd6c5d514a0b2a9e8289de33da9"}
Sep 11 18:16:11.952162 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.952127    2576 scope.go:117] "RemoveContainer" containerID="4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978"
Sep 11 18:16:11.953477 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.953448    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5d7c656-05eb-4288-b84d-7f1e4f311a54" containerID="c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b" exitCode=0
Sep 11 18:16:11.953555 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.953525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v" event={"ID":"a5d7c656-05eb-4288-b84d-7f1e4f311a54","Type":"ContainerDied","Data":"c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b"}
Sep 11 18:16:11.953616 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.953551    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"
Sep 11 18:16:11.953671 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.953556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v" event={"ID":"a5d7c656-05eb-4288-b84d-7f1e4f311a54","Type":"ContainerDied","Data":"8c33b6df3fbc2fd8aff8ae155ef0eb46deea7a6e55a471f445b486550bb7b2aa"}
Sep 11 18:16:11.962262 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.962246    2576 scope.go:117] "RemoveContainer" containerID="4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978"
Sep 11 18:16:11.962511 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:16:11.962492    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978\": container with ID starting with 4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978 not found: ID does not exist" containerID="4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978"
Sep 11 18:16:11.962576 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.962520    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978"} err="failed to get container status \"4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978\": rpc error: code = NotFound desc = could not find container \"4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978\": container with ID starting with 4e4e1563564d9fbd045ace705ccffb63a5e96e0a46d273de71c56e0e7fb19978 not found: ID does not exist"
Sep 11 18:16:11.962576 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.962536    2576 scope.go:117] "RemoveContainer" containerID="c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b"
Sep 11 18:16:11.972246 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.972225    2576 scope.go:117] "RemoveContainer" containerID="c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b"
Sep 11 18:16:11.972568 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:16:11.972546    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b\": container with ID starting with c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b not found: ID does not exist" containerID="c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b"
Sep 11 18:16:11.972656 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.972576    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b"} err="failed to get container status \"c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b\": rpc error: code = NotFound desc = could not find container \"c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b\": container with ID starting with c2bac4722a0d20b38c4ac3aef9b1bb6133279790aaa02e77a20d037d6ac62c2b not found: ID does not exist"
Sep 11 18:16:11.977318 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.977296    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"]
Sep 11 18:16:11.985305 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.985278    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7"]
Sep 11 18:16:11.995073 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.995053    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqxg4\" (UniqueName: \"kubernetes.io/projected/a5d7c656-05eb-4288-b84d-7f1e4f311a54-kube-api-access-wqxg4\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:11.995171 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.995080    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8213aa-52d0-4925-b1e2-f25b47992082-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:11.995171 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.995096    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn772\" (UniqueName: \"kubernetes.io/projected/aa8213aa-52d0-4925-b1e2-f25b47992082-kube-api-access-nn772\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:11.995171 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.995109    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7c656-05eb-4288-b84d-7f1e4f311a54-plugins-config-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:11.996386 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:11.996367    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"]
Sep 11 18:16:12.000646 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:12.000625    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v"]
Sep 11 18:16:12.238519 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:12.238489    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54f97f88-7034-4b9d-9ad1-6e0c11d93cc4" path="/var/lib/kubelet/pods/54f97f88-7034-4b9d-9ad1-6e0c11d93cc4/volumes"
Sep 11 18:16:12.238816 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:12.238803    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d7c656-05eb-4288-b84d-7f1e4f311a54" path="/var/lib/kubelet/pods/a5d7c656-05eb-4288-b84d-7f1e4f311a54/volumes"
Sep 11 18:16:12.239099 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:12.239088    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa8213aa-52d0-4925-b1e2-f25b47992082" path="/var/lib/kubelet/pods/aa8213aa-52d0-4925-b1e2-f25b47992082/volumes"
Sep 11 18:16:12.244500 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:12.244474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:12.346464 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:12.346427    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:18.271916 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:18.271827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:18.350013 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:18.349972    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:18.547137 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:18.547101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:21.163501 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.163451    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-859c5cb57-fk9k8"]
Sep 11 18:16:21.163989 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.163668    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-859c5cb57-fk9k8" podUID="4e352be0-3bab-4f02-b384-1b16251d667d" containerName="manager" containerID="cri-o://5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679" gracePeriod=30
Sep 11 18:16:21.403878 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.403848    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 18:16:21.477791 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.477692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfkbv\" (UniqueName: \"kubernetes.io/projected/4e352be0-3bab-4f02-b384-1b16251d667d-kube-api-access-rfkbv\") pod \"4e352be0-3bab-4f02-b384-1b16251d667d\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") "
Sep 11 18:16:21.477791 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.477739    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-webhook-cert\") pod \"4e352be0-3bab-4f02-b384-1b16251d667d\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") "
Sep 11 18:16:21.477996 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.477797    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-metrics-certs\") pod \"4e352be0-3bab-4f02-b384-1b16251d667d\" (UID: \"4e352be0-3bab-4f02-b384-1b16251d667d\") "
Sep 11 18:16:21.480260 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.480205    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4e352be0-3bab-4f02-b384-1b16251d667d" (UID: "4e352be0-3bab-4f02-b384-1b16251d667d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:16:21.480388 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.480312    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4e352be0-3bab-4f02-b384-1b16251d667d" (UID: "4e352be0-3bab-4f02-b384-1b16251d667d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:16:21.480388 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.480325    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e352be0-3bab-4f02-b384-1b16251d667d-kube-api-access-rfkbv" (OuterVolumeSpecName: "kube-api-access-rfkbv") pod "4e352be0-3bab-4f02-b384-1b16251d667d" (UID: "4e352be0-3bab-4f02-b384-1b16251d667d"). InnerVolumeSpecName "kube-api-access-rfkbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:21.578561 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.578529    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:21.578561 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.578555    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfkbv\" (UniqueName: \"kubernetes.io/projected/4e352be0-3bab-4f02-b384-1b16251d667d-kube-api-access-rfkbv\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:21.578561 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.578566    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e352be0-3bab-4f02-b384-1b16251d667d-webhook-cert\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:21.999235 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.999199    2576 generic.go:356] "Generic (PLEG): container finished" podID="4e352be0-3bab-4f02-b384-1b16251d667d" containerID="5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679" exitCode=0
Sep 11 18:16:21.999403 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.999244    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-fk9k8" event={"ID":"4e352be0-3bab-4f02-b384-1b16251d667d","Type":"ContainerDied","Data":"5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679"}
Sep 11 18:16:21.999403 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.999279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-859c5cb57-fk9k8" event={"ID":"4e352be0-3bab-4f02-b384-1b16251d667d","Type":"ContainerDied","Data":"69b07cf7fae513757724a603253128bc41a35647a43b2288b86355a5c6c03909"}
Sep 11 18:16:21.999403 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.999302    2576 scope.go:117] "RemoveContainer" containerID="5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679"
Sep 11 18:16:21.999403 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:21.999246    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-859c5cb57-fk9k8"
Sep 11 18:16:22.009882 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:22.009861    2576 scope.go:117] "RemoveContainer" containerID="5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679"
Sep 11 18:16:22.010167 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:16:22.010147    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679\": container with ID starting with 5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679 not found: ID does not exist" containerID="5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679"
Sep 11 18:16:22.010218 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:22.010177    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679"} err="failed to get container status \"5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679\": rpc error: code = NotFound desc = could not find container \"5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679\": container with ID starting with 5280be030dca5f8f477efc9befed061351cdbc71889313cd8715a8771834c679 not found: ID does not exist"
Sep 11 18:16:22.022046 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:22.022023    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-859c5cb57-fk9k8"]
Sep 11 18:16:22.026177 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:22.026156    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-859c5cb57-fk9k8"]
Sep 11 18:16:22.239726 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:16:22.239669    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e352be0-3bab-4f02-b384-1b16251d667d" path="/var/lib/kubelet/pods/4e352be0-3bab-4f02-b384-1b16251d667d/volumes"
Sep 11 18:17:12.835100 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:17:12.835065    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:17:14.440415 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:17:14.440381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:17:44.929509 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:17:44.929475    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:17:46.470488 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:17:46.470438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:17:48.131774 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:17:48.131738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:01.459010 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:01.458973    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"]
Sep 11 18:19:01.459506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:01.459179    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c" podUID="e55b01fe-7027-49bd-894a-b0bb80bd2005" containerName="manager" containerID="cri-o://e926c9af33725fd6e3865f8a8fbf9eb0fa3295d7cb0c4d81e49e09c407b16acd" gracePeriod=10
Sep 11 18:19:02.702116 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.702085    2576 generic.go:356] "Generic (PLEG): container finished" podID="e55b01fe-7027-49bd-894a-b0bb80bd2005" containerID="e926c9af33725fd6e3865f8a8fbf9eb0fa3295d7cb0c4d81e49e09c407b16acd" exitCode=0
Sep 11 18:19:02.702515 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.702155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c" event={"ID":"e55b01fe-7027-49bd-894a-b0bb80bd2005","Type":"ContainerDied","Data":"e926c9af33725fd6e3865f8a8fbf9eb0fa3295d7cb0c4d81e49e09c407b16acd"}
Sep 11 18:19:02.720411 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.720345    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 18:19:02.800159 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.800116    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb8bj\" (UniqueName: \"kubernetes.io/projected/e55b01fe-7027-49bd-894a-b0bb80bd2005-kube-api-access-gb8bj\") pod \"e55b01fe-7027-49bd-894a-b0bb80bd2005\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") "
Sep 11 18:19:02.802262 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.802235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55b01fe-7027-49bd-894a-b0bb80bd2005-kube-api-access-gb8bj" (OuterVolumeSpecName: "kube-api-access-gb8bj") pod "e55b01fe-7027-49bd-894a-b0bb80bd2005" (UID: "e55b01fe-7027-49bd-894a-b0bb80bd2005"). InnerVolumeSpecName "kube-api-access-gb8bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:19:02.901372 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.901332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e55b01fe-7027-49bd-894a-b0bb80bd2005-extensions-socket-volume\") pod \"e55b01fe-7027-49bd-894a-b0bb80bd2005\" (UID: \"e55b01fe-7027-49bd-894a-b0bb80bd2005\") "
Sep 11 18:19:02.901567 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.901507    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb8bj\" (UniqueName: \"kubernetes.io/projected/e55b01fe-7027-49bd-894a-b0bb80bd2005-kube-api-access-gb8bj\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:19:02.901807 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:02.901783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55b01fe-7027-49bd-894a-b0bb80bd2005-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e55b01fe-7027-49bd-894a-b0bb80bd2005" (UID: "e55b01fe-7027-49bd-894a-b0bb80bd2005"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:19:03.002537 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:03.002449    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e55b01fe-7027-49bd-894a-b0bb80bd2005-extensions-socket-volume\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:19:03.708109 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:03.708076    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"
Sep 11 18:19:03.708620 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:03.708083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c" event={"ID":"e55b01fe-7027-49bd-894a-b0bb80bd2005","Type":"ContainerDied","Data":"c58d5700c196f2aa3ab68260b09418a80432332743a3336f83d51f7463df23e7"}
Sep 11 18:19:03.708620 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:03.708222    2576 scope.go:117] "RemoveContainer" containerID="e926c9af33725fd6e3865f8a8fbf9eb0fa3295d7cb0c4d81e49e09c407b16acd"
Sep 11 18:19:03.730454 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:03.730421    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"]
Sep 11 18:19:03.734022 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:03.733995    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w5t9c"]
Sep 11 18:19:04.239094 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:19:04.239061    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e55b01fe-7027-49bd-894a-b0bb80bd2005" path="/var/lib/kubelet/pods/e55b01fe-7027-49bd-894a-b0bb80bd2005/volumes"
Sep 11 18:20:02.216454 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216408    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"]
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216887    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8213aa-52d0-4925-b1e2-f25b47992082" containerName="payload-pre-processing"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216907    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8213aa-52d0-4925-b1e2-f25b47992082" containerName="payload-pre-processing"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216917    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595db186-5bf2-4ac8-87e4-00c2762ea414" containerName="cleanup"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216926    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="595db186-5bf2-4ac8-87e4-00c2762ea414" containerName="cleanup"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216945    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d7c656-05eb-4288-b84d-7f1e4f311a54" containerName="payload-processing"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216954    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d7c656-05eb-4288-b84d-7f1e4f311a54" containerName="payload-processing"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216973    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde6b5ad-6506-4511-8978-ff4f0a21d5f7" containerName="payload-pre-processing"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216982    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde6b5ad-6506-4511-8978-ff4f0a21d5f7" containerName="payload-pre-processing"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216991    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54f97f88-7034-4b9d-9ad1-6e0c11d93cc4" containerName="cleanup"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.216999    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54f97f88-7034-4b9d-9ad1-6e0c11d93cc4" containerName="cleanup"
Sep 11 18:20:02.217008 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217012    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cd2eda-4870-4b5d-88a3-3d9634baf42b" containerName="payload-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217020    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cd2eda-4870-4b5d-88a3-3d9634baf42b" containerName="payload-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217031    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30eb460d-0026-41fb-894b-2aeb630eeefa" containerName="payload-pre-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217039    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="30eb460d-0026-41fb-894b-2aeb630eeefa" containerName="payload-pre-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217057    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55b01fe-7027-49bd-894a-b0bb80bd2005" containerName="manager"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217065    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55b01fe-7027-49bd-894a-b0bb80bd2005" containerName="manager"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217081    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e352be0-3bab-4f02-b384-1b16251d667d" containerName="manager"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217090    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e352be0-3bab-4f02-b384-1b16251d667d" containerName="manager"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217166    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e352be0-3bab-4f02-b384-1b16251d667d" containerName="manager"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217175    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="30eb460d-0026-41fb-894b-2aeb630eeefa" containerName="payload-pre-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217185    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8213aa-52d0-4925-b1e2-f25b47992082" containerName="payload-pre-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217196    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cd2eda-4870-4b5d-88a3-3d9634baf42b" containerName="payload-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217204    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="595db186-5bf2-4ac8-87e4-00c2762ea414" containerName="cleanup"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217213    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d7c656-05eb-4288-b84d-7f1e4f311a54" containerName="payload-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217222    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="54f97f88-7034-4b9d-9ad1-6e0c11d93cc4" containerName="cleanup"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217232    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde6b5ad-6506-4511-8978-ff4f0a21d5f7" containerName="payload-pre-processing"
Sep 11 18:20:02.217604 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.217242    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e55b01fe-7027-49bd-894a-b0bb80bd2005" containerName="manager"
Sep 11 18:20:02.220309 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.220289    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.222956 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.222936    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g9mpv\""
Sep 11 18:20:02.239714 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.239667    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"]
Sep 11 18:20:02.343299 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.343261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n7b2\" (UniqueName: \"kubernetes.io/projected/29ab62ba-a4e5-4114-a547-c83e36cc9f5e-kube-api-access-5n7b2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jnqs7\" (UID: \"29ab62ba-a4e5-4114-a547-c83e36cc9f5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.343486 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.343327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29ab62ba-a4e5-4114-a547-c83e36cc9f5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jnqs7\" (UID: \"29ab62ba-a4e5-4114-a547-c83e36cc9f5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.444591 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.444560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n7b2\" (UniqueName: \"kubernetes.io/projected/29ab62ba-a4e5-4114-a547-c83e36cc9f5e-kube-api-access-5n7b2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jnqs7\" (UID: \"29ab62ba-a4e5-4114-a547-c83e36cc9f5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.444795 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.444621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29ab62ba-a4e5-4114-a547-c83e36cc9f5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jnqs7\" (UID: \"29ab62ba-a4e5-4114-a547-c83e36cc9f5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.444996 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.444978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29ab62ba-a4e5-4114-a547-c83e36cc9f5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jnqs7\" (UID: \"29ab62ba-a4e5-4114-a547-c83e36cc9f5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.454754 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.454725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n7b2\" (UniqueName: \"kubernetes.io/projected/29ab62ba-a4e5-4114-a547-c83e36cc9f5e-kube-api-access-5n7b2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jnqs7\" (UID: \"29ab62ba-a4e5-4114-a547-c83e36cc9f5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.530454 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.530367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.809303 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.809209    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"]
Sep 11 18:20:02.813662 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:20:02.813618    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ab62ba_a4e5_4114_a547_c83e36cc9f5e.slice/crio-e8a6701fc153bbea2cb362026160160d20e8e5a3e036d44b1fa4f62dd970f8df WatchSource:0}: Error finding container e8a6701fc153bbea2cb362026160160d20e8e5a3e036d44b1fa4f62dd970f8df: Status 404 returned error can't find the container with id e8a6701fc153bbea2cb362026160160d20e8e5a3e036d44b1fa4f62dd970f8df
Sep 11 18:20:02.969714 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.969653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7" event={"ID":"29ab62ba-a4e5-4114-a547-c83e36cc9f5e","Type":"ContainerStarted","Data":"120da0111cd0963671b60e8b08cdc97d67932abfae3a0c822c0398be52683dd8"}
Sep 11 18:20:02.969901 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.969739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7" event={"ID":"29ab62ba-a4e5-4114-a547-c83e36cc9f5e","Type":"ContainerStarted","Data":"e8a6701fc153bbea2cb362026160160d20e8e5a3e036d44b1fa4f62dd970f8df"}
Sep 11 18:20:02.969901 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.969784    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:02.996457 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:02.996409    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7" podStartSLOduration=0.996394002 podStartE2EDuration="996.394002ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:20:02.994956742 +0000 UTC m=+2107.282491075" watchObservedRunningTime="2026-09-11 18:20:02.996394002 +0000 UTC m=+2107.283928310"
Sep 11 18:20:13.977215 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:13.977184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jnqs7"
Sep 11 18:20:55.583382 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:20:55.583287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:01.404915 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:01.404873    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:15.364172 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:15.364129    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:16.859464 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:16.859436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:18.866296 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:18.866242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:40.458696 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.458654    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"]
Sep 11 18:21:40.461873 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.461854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.492137 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.492101    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"]
Sep 11 18:21:40.536347 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.536312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-464bg\" (UniqueName: \"kubernetes.io/projected/978e6e40-372b-4797-906f-42444ea7681b-kube-api-access-464bg\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.536511 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.536365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6e40-372b-4797-906f-42444ea7681b-openshift-service-ca\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.536511 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.536430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/978e6e40-372b-4797-906f-42444ea7681b-metrics-certs\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.536511 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.536481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/978e6e40-372b-4797-906f-42444ea7681b-maas-api-tls\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.637040 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.636999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6e40-372b-4797-906f-42444ea7681b-openshift-service-ca\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.637244 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.637051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/978e6e40-372b-4797-906f-42444ea7681b-metrics-certs\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.637244 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.637186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/978e6e40-372b-4797-906f-42444ea7681b-maas-api-tls\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.637372 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.637262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-464bg\" (UniqueName: \"kubernetes.io/projected/978e6e40-372b-4797-906f-42444ea7681b-kube-api-access-464bg\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.637647 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.637627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6e40-372b-4797-906f-42444ea7681b-openshift-service-ca\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.639651 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.639633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/978e6e40-372b-4797-906f-42444ea7681b-metrics-certs\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.639770 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.639708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/978e6e40-372b-4797-906f-42444ea7681b-maas-api-tls\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.648165 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.648142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-464bg\" (UniqueName: \"kubernetes.io/projected/978e6e40-372b-4797-906f-42444ea7681b-kube-api-access-464bg\") pod \"maas-api-5c66b56868-klmzl\" (UID: \"978e6e40-372b-4797-906f-42444ea7681b\") " pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:40.774338 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:40.774231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:41.052498 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:41.052467    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"]
Sep 11 18:21:41.055916 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:21:41.055886    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978e6e40_372b_4797_906f_42444ea7681b.slice/crio-5a9338a8c212e7c35ecab9cfd085a4b56f9cd93f0ba6ef4ed1fd060425e67be7 WatchSource:0}: Error finding container 5a9338a8c212e7c35ecab9cfd085a4b56f9cd93f0ba6ef4ed1fd060425e67be7: Status 404 returned error can't find the container with id 5a9338a8c212e7c35ecab9cfd085a4b56f9cd93f0ba6ef4ed1fd060425e67be7
Sep 11 18:21:41.057149 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:41.057132    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:21:41.397787 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:41.397699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl" event={"ID":"978e6e40-372b-4797-906f-42444ea7681b","Type":"ContainerStarted","Data":"5a9338a8c212e7c35ecab9cfd085a4b56f9cd93f0ba6ef4ed1fd060425e67be7"}
Sep 11 18:21:42.404319 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:42.404281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl" event={"ID":"978e6e40-372b-4797-906f-42444ea7681b","Type":"ContainerStarted","Data":"043cc6724b2c6b7fe3d209a137486e18e7fc342f2f3d59e95da9a0a02b05b5ca"}
Sep 11 18:21:42.404755 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:42.404423    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:42.424435 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:42.424385    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl" podStartSLOduration=1.9896923229999999 podStartE2EDuration="2.424372315s" totalImagesPullingTime="434.679992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:21:42.424265644 +0000 UTC m=+2206.711799952" watchObservedRunningTime="2026-09-11 18:21:42.424372315 +0000 UTC m=+2206.711906619"
Sep 11 18:21:48.419427 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:48.419395    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c66b56868-klmzl"
Sep 11 18:21:48.481079 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:48.481042    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"]
Sep 11 18:21:48.481295 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:48.481267    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4" podUID="ae2a487f-9525-40cb-8633-5fb134f5fe07" containerName="maas-api" containerID="cri-o://249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5" gracePeriod=30
Sep 11 18:21:49.722945 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.722920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 18:21:49.814402 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.814367    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2a487f-9525-40cb-8633-5fb134f5fe07-openshift-service-ca\") pod \"ae2a487f-9525-40cb-8633-5fb134f5fe07\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") "
Sep 11 18:21:49.814402 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.814404    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-maas-api-tls\") pod \"ae2a487f-9525-40cb-8633-5fb134f5fe07\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") "
Sep 11 18:21:49.814657 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.814428    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-metrics-certs\") pod \"ae2a487f-9525-40cb-8633-5fb134f5fe07\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") "
Sep 11 18:21:49.814657 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.814465    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsswx\" (UniqueName: \"kubernetes.io/projected/ae2a487f-9525-40cb-8633-5fb134f5fe07-kube-api-access-vsswx\") pod \"ae2a487f-9525-40cb-8633-5fb134f5fe07\" (UID: \"ae2a487f-9525-40cb-8633-5fb134f5fe07\") "
Sep 11 18:21:49.814823 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.814803    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae2a487f-9525-40cb-8633-5fb134f5fe07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae2a487f-9525-40cb-8633-5fb134f5fe07" (UID: "ae2a487f-9525-40cb-8633-5fb134f5fe07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:21:49.816739 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.816708    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae2a487f-9525-40cb-8633-5fb134f5fe07" (UID: "ae2a487f-9525-40cb-8633-5fb134f5fe07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:21:49.816841 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.816777    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae2a487f-9525-40cb-8633-5fb134f5fe07" (UID: "ae2a487f-9525-40cb-8633-5fb134f5fe07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:21:49.816881 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.816841    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2a487f-9525-40cb-8633-5fb134f5fe07-kube-api-access-vsswx" (OuterVolumeSpecName: "kube-api-access-vsswx") pod "ae2a487f-9525-40cb-8633-5fb134f5fe07" (UID: "ae2a487f-9525-40cb-8633-5fb134f5fe07"). InnerVolumeSpecName "kube-api-access-vsswx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:21:49.915256 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.915225    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2a487f-9525-40cb-8633-5fb134f5fe07-openshift-service-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:21:49.915256 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.915253    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-maas-api-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:21:49.915433 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.915263    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2a487f-9525-40cb-8633-5fb134f5fe07-metrics-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:21:49.915433 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:49.915272    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsswx\" (UniqueName: \"kubernetes.io/projected/ae2a487f-9525-40cb-8633-5fb134f5fe07-kube-api-access-vsswx\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\""
Sep 11 18:21:50.444802 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.444767    2576 generic.go:356] "Generic (PLEG): container finished" podID="ae2a487f-9525-40cb-8633-5fb134f5fe07" containerID="249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5" exitCode=0
Sep 11 18:21:50.444959 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.444830    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"
Sep 11 18:21:50.444959 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.444856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4" event={"ID":"ae2a487f-9525-40cb-8633-5fb134f5fe07","Type":"ContainerDied","Data":"249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5"}
Sep 11 18:21:50.444959 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.444916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4" event={"ID":"ae2a487f-9525-40cb-8633-5fb134f5fe07","Type":"ContainerDied","Data":"24b0e99b5bd2a15cec60a126d19600003cb3106fa7ea2cfa9524c96b1e508a92"}
Sep 11 18:21:50.444959 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.444945    2576 scope.go:117] "RemoveContainer" containerID="249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5"
Sep 11 18:21:50.453393 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.453374    2576 scope.go:117] "RemoveContainer" containerID="249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5"
Sep 11 18:21:50.453653 ip-10-0-140-186 kubenswrapper[2576]: E0911 18:21:50.453634    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5\": container with ID starting with 249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5 not found: ID does not exist" containerID="249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5"
Sep 11 18:21:50.453725 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.453661    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5"} err="failed to get container status \"249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5\": rpc error: code = NotFound desc = could not find container \"249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5\": container with ID starting with 249adad219136384b157a6ee11023ef3f2525cbab0b3542851de582ea2143df5 not found: ID does not exist"
Sep 11 18:21:50.464917 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.464886    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"]
Sep 11 18:21:50.469131 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:50.469110    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-55bbb86db8-9w7q4"]
Sep 11 18:21:52.238703 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:52.238644    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae2a487f-9525-40cb-8633-5fb134f5fe07" path="/var/lib/kubelet/pods/ae2a487f-9525-40cb-8633-5fb134f5fe07/volumes"
Sep 11 18:21:56.522096 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:56.522061    2576 scope.go:117] "RemoveContainer" containerID="42c515415b8c90cd5c882adff04eb6d0d9bfb30683e49d29e4eb03460612a63c"
Sep 11 18:21:56.529939 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:21:56.529917    2576 scope.go:117] "RemoveContainer" containerID="154fcdfb72fe3e8862e6988fee97289b96366b8b6b3e4de2de3b36f0e3eee3df"
Sep 11 18:22:17.264771 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:17.264668    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-rk2qc_99c29099-af61-47d1-8e5b-e29e62f33dc7/copy-manifests/0.log"
Sep 11 18:22:17.282550 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:17.282525    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-rk2qc_99c29099-af61-47d1-8e5b-e29e62f33dc7/manager/0.log"
Sep 11 18:22:17.959995 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:17.959965    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5c66b56868-klmzl_978e6e40-372b-4797-906f-42444ea7681b/maas-api/0.log"
Sep 11 18:22:18.462497 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:18.462466    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-x9fsp_f8eea5a4-0185-45d1-8375-28be7aa80281/postgres/0.log"
Sep 11 18:22:19.429924 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:19.429891    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-brlch_043d03ae-0b74-437d-8c67-777c05ae9788/manager/0.log"
Sep 11 18:22:19.556858 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:19.556828    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-sx9fh_12250851-428d-436d-bfad-e4578f51a0bb/manager/0.log"
Sep 11 18:22:19.806560 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:19.806532    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-jnqs7_29ab62ba-a4e5-4114-a547-c83e36cc9f5e/manager/0.log"
Sep 11 18:22:20.604586 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:20.604551    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l9crn_ecb8b23b-66df-4696-a2e7-96af6287f9df/discovery/0.log"
Sep 11 18:22:20.845018 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:20.844984    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c49cb9c9-mtb4x_7f51b439-46e7-45e2-bc92-c3adfb817d2d/kube-auth-proxy/0.log"
Sep 11 18:22:21.257051 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:21.257017    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdjnk_8bb792dc-ee5e-42b4-8f73-64513cfab123/payload-processing/0.log"
Sep 11 18:22:22.034311 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:22.034278    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-l7z8w_48b13ca4-323f-4eb8-95bf-0c3ef2028423/main/0.log"
Sep 11 18:22:22.407782 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:22.407748    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4j9vf_d9b1cb5a-bf3b-4424-b978-8ab64b78a67b/main/0.log"
Sep 11 18:22:28.553035 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:28.552984    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:29.907878 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:29.907841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:32.112949 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:32.112918    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zjmng_671a78d2-e9aa-4b00-aca4-f25e8f4699df/global-pull-secret-syncer/0.log"
Sep 11 18:22:32.171389 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:32.171359    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kfn8z_fb59c355-59a2-4cdc-a5d2-081a54a1bc4d/konnectivity-agent/0.log"
Sep 11 18:22:32.350029 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:32.349997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-186.ec2.internal_f7d2b684ad7d44a72bc24378b6f38ea2/haproxy/0.log"
Sep 11 18:22:37.167739 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:37.167706    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-brlch_043d03ae-0b74-437d-8c67-777c05ae9788/manager/0.log"
Sep 11 18:22:37.197995 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:37.197963    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-sx9fh_12250851-428d-436d-bfad-e4578f51a0bb/manager/0.log"
Sep 11 18:22:37.281061 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:37.281030    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-jnqs7_29ab62ba-a4e5-4114-a547-c83e36cc9f5e/manager/0.log"
Sep 11 18:22:39.552942 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:39.552899    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2jq7_9f75b502-4e6c-4cae-a88a-e41d3f32e12c/node-exporter/0.log"
Sep 11 18:22:39.577273 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:39.577242    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2jq7_9f75b502-4e6c-4cae-a88a-e41d3f32e12c/kube-rbac-proxy/0.log"
Sep 11 18:22:39.603297 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:39.603275    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2jq7_9f75b502-4e6c-4cae-a88a-e41d3f32e12c/init-textfile/0.log"
Sep 11 18:22:42.081159 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.081125    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"]
Sep 11 18:22:42.081548 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.081432    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae2a487f-9525-40cb-8633-5fb134f5fe07" containerName="maas-api"
Sep 11 18:22:42.081548 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.081444    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2a487f-9525-40cb-8633-5fb134f5fe07" containerName="maas-api"
Sep 11 18:22:42.081548 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.081494    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae2a487f-9525-40cb-8633-5fb134f5fe07" containerName="maas-api"
Sep 11 18:22:42.084440 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.084421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.088079 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.088056    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9wf2k\"/\"default-dockercfg-zgzn2\""
Sep 11 18:22:42.088212 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.088163    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wf2k\"/\"kube-root-ca.crt\""
Sep 11 18:22:42.088761 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.088744    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wf2k\"/\"openshift-service-ca.crt\""
Sep 11 18:22:42.097593 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.097569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"]
Sep 11 18:22:42.136741 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.136699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-sys\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.136741 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.136747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-podres\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.136984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.136766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-lib-modules\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.136984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.136850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-proc\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.136984 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.136921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzwb\" (UniqueName: \"kubernetes.io/projected/0dac5191-5021-4b92-a0d8-21bb591975ff-kube-api-access-vvzwb\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237307 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-proc\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzwb\" (UniqueName: \"kubernetes.io/projected/0dac5191-5021-4b92-a0d8-21bb591975ff-kube-api-access-vvzwb\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-sys\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-podres\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-lib-modules\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-proc\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-sys\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237506 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-podres\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.237856 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.237549    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dac5191-5021-4b92-a0d8-21bb591975ff-lib-modules\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.246948 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.246923    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzwb\" (UniqueName: \"kubernetes.io/projected/0dac5191-5021-4b92-a0d8-21bb591975ff-kube-api-access-vvzwb\") pod \"perf-node-gather-daemonset-rxfpl\" (UID: \"0dac5191-5021-4b92-a0d8-21bb591975ff\") " pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.394207 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.394126    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:42.666521 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.666420    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"]
Sep 11 18:22:42.669154 ip-10-0-140-186 kubenswrapper[2576]: W0911 18:22:42.669130    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0dac5191_5021_4b92_a0d8_21bb591975ff.slice/crio-5b6b6f7939a8f0d9e377f378c5cb5abde6079c830b663e3bf090e81e5528a74d WatchSource:0}: Error finding container 5b6b6f7939a8f0d9e377f378c5cb5abde6079c830b663e3bf090e81e5528a74d: Status 404 returned error can't find the container with id 5b6b6f7939a8f0d9e377f378c5cb5abde6079c830b663e3bf090e81e5528a74d
Sep 11 18:22:42.675354 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:42.675331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl" event={"ID":"0dac5191-5021-4b92-a0d8-21bb591975ff","Type":"ContainerStarted","Data":"5b6b6f7939a8f0d9e377f378c5cb5abde6079c830b663e3bf090e81e5528a74d"}
Sep 11 18:22:43.681832 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:43.681795    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl" event={"ID":"0dac5191-5021-4b92-a0d8-21bb591975ff","Type":"ContainerStarted","Data":"d03004b185e224bacd8a3e0ad8671c439ddb85b9ec7d2b05a8266488f28ee35c"}
Sep 11 18:22:43.682217 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:43.681933    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:43.708273 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:43.708203    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl" podStartSLOduration=1.708182688 podStartE2EDuration="1.708182688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:22:43.706619214 +0000 UTC m=+2267.994153521" watchObservedRunningTime="2026-09-11 18:22:43.708182688 +0000 UTC m=+2267.995716996"
Sep 11 18:22:44.840699 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:44.840654    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5r5nc_42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3/dns/0.log"
Sep 11 18:22:44.862177 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:44.862150    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5r5nc_42cb7fd1-8a1e-4c14-9b39-b1a1d7cddcc3/kube-rbac-proxy/0.log"
Sep 11 18:22:45.050457 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:45.050431    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nvqd8_2cae0089-7c28-4f35-a755-ab5573cdf3e4/dns-node-resolver/0.log"
Sep 11 18:22:45.689670 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:45.689630    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xz5xc_345198cd-000c-4f72-9fd7-b8035c183481/node-ca/0.log"
Sep 11 18:22:47.229889 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:47.229855    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l9crn_ecb8b23b-66df-4696-a2e7-96af6287f9df/discovery/0.log"
Sep 11 18:22:47.282154 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:47.282118    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c49cb9c9-mtb4x_7f51b439-46e7-45e2-bc92-c3adfb817d2d/kube-auth-proxy/0.log"
Sep 11 18:22:47.472607 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:47.472570    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdjnk_8bb792dc-ee5e-42b4-8f73-64513cfab123/payload-processing/0.log"
Sep 11 18:22:48.444868 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:48.444836    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8rlb_eed8d103-440b-4ad5-a004-f36cb96b7a60/serve-healthcheck-canary/0.log"
Sep 11 18:22:48.947478 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:48.947440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djzfb_21785f2f-0f08-4504-8e36-ed49628ac46e/kube-rbac-proxy/0.log"
Sep 11 18:22:48.973966 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:48.973937    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djzfb_21785f2f-0f08-4504-8e36-ed49628ac46e/exporter/0.log"
Sep 11 18:22:49.001819 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:49.001792    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djzfb_21785f2f-0f08-4504-8e36-ed49628ac46e/extractor/0.log"
Sep 11 18:22:49.696369 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:49.696342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9wf2k/perf-node-gather-daemonset-rxfpl"
Sep 11 18:22:51.907262 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:51.907226    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-rk2qc_99c29099-af61-47d1-8e5b-e29e62f33dc7/manager/0.log"
Sep 11 18:22:51.929647 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:51.929622    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f44bff486-rk2qc_99c29099-af61-47d1-8e5b-e29e62f33dc7/copy-manifests/0.log"
Sep 11 18:22:53.240432 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:53.240345    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l9crn_ecb8b23b-66df-4696-a2e7-96af6287f9df/discovery/0.log"
Sep 11 18:22:53.273219 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:53.273196    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c49cb9c9-mtb4x_7f51b439-46e7-45e2-bc92-c3adfb817d2d/kube-auth-proxy/0.log"
Sep 11 18:22:53.375143 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:53.375116    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdjnk_8bb792dc-ee5e-42b4-8f73-64513cfab123/payload-processing/0.log"
Sep 11 18:22:55.483599 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:55.483571    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l9crn_ecb8b23b-66df-4696-a2e7-96af6287f9df/discovery/0.log"
Sep 11 18:22:55.523309 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:55.523285    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c49cb9c9-mtb4x_7f51b439-46e7-45e2-bc92-c3adfb817d2d/kube-auth-proxy/0.log"
Sep 11 18:22:55.626491 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:22:55.626457    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdjnk_8bb792dc-ee5e-42b4-8f73-64513cfab123/payload-processing/0.log"
Sep 11 18:23:00.157097 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.157065    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8w7wb_922f186b-ae36-4073-947a-7015e1eaa33c/kube-multus-additional-cni-plugins/0.log"
Sep 11 18:23:00.180049 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.180019    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8w7wb_922f186b-ae36-4073-947a-7015e1eaa33c/egress-router-binary-copy/0.log"
Sep 11 18:23:00.211022 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.210953    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8w7wb_922f186b-ae36-4073-947a-7015e1eaa33c/cni-plugins/0.log"
Sep 11 18:23:00.234279 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.234245    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8w7wb_922f186b-ae36-4073-947a-7015e1eaa33c/bond-cni-plugin/0.log"
Sep 11 18:23:00.257040 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.257017    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8w7wb_922f186b-ae36-4073-947a-7015e1eaa33c/routeoverride-cni/0.log"
Sep 11 18:23:00.282964 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.282944    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8w7wb_922f186b-ae36-4073-947a-7015e1eaa33c/whereabouts-cni-bincopy/0.log"
Sep 11 18:23:00.306193 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.306175    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8w7wb_922f186b-ae36-4073-947a-7015e1eaa33c/whereabouts-cni/0.log"
Sep 11 18:23:00.732872 ip-10-0-140-186 kubenswrapper[2576]: I0911 18:23:00.732841    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cqfn8_15daa995-2638-4b45-bca3-5d2518542c0b/kube-multus/0.log"